2024-09-10T20:43:43.223 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-10T20:43:43.245 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T20:43:43.345 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899648 branch: wip-hemanth-testing-2024-09-10-0723 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/backtrace} email: hyelloji@redhat.com first_in_suite: false job_id: '7899648' kernel: flavor: default kdb: 1 sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-hemanth-testing-2024-09-10-0723 ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: client: pid file: '' mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-hemanth-testing-2024-09-10-0723 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 owner: scheduled_hyelloji@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6190 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 sleep_before_teardown: 0 subset: 479/1024 suite: fs suite_branch: wip-hemanth-testing-2024-09-10-0723 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi006.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG3bYkgsBG0cXAsebJ6bU+tUJNrcXslOGNi57achBpRaTZWUz5IMprt+T23QDPT3b0Rf4Zd1n4Ytw3v/Qf0Z6Ns= smithi150.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJOEd8NaSONnCGG/6kMJK/rNhFBCmycmknMhmFxKVseKkI3AMkQZO4BLrgmvo9MM/FEpOixtc+0UIEUTdPLe+Es= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_backtrace teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_16:59:47 tube: smithi user: hyelloji verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-10T20:43:43.345 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa; will attempt to use it 2024-09-10T20:43:43.345 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks 2024-09-10T20:43:43.346 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-10T20:43:43.347 INFO:teuthology.task.internal:Checking packages... 2024-09-10T20:43:43.369 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8f219c476cb4f26fc5719c661c0323719a45cb30' 2024-09-10T20:43:43.369 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T20:43:43.369 INFO:teuthology.packaging:ref: None 2024-09-10T20:43:43.369 INFO:teuthology.packaging:tag: None 2024-09-10T20:43:43.369 INFO:teuthology.packaging:branch: wip-hemanth-testing-2024-09-10-0723 2024-09-10T20:43:43.369 INFO:teuthology.packaging:sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T20:43:43.369 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-hemanth-testing-2024-09-10-0723 2024-09-10T20:43:43.520 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4854.g8f219c47 2024-09-10T20:43:43.522 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-10T20:43:43.528 INFO:teuthology.task.internal:no buildpackages task found 2024-09-10T20:43:43.528 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-10T20:43:43.551 INFO:teuthology.task.internal:Saving configuration 2024-09-10T20:43:43.568 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-10T20:43:43.575 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-10T20:43:43.607 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi006.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899648', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 20:38:49.895752', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG3bYkgsBG0cXAsebJ6bU+tUJNrcXslOGNi57achBpRaTZWUz5IMprt+T23QDPT3b0Rf4Zd1n4Ytw3v/Qf0Z6Ns='} 2024-09-10T20:43:43.637 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi150.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899648', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 20:38:49.897187', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJOEd8NaSONnCGG/6kMJK/rNhFBCmycmknMhmFxKVseKkI3AMkQZO4BLrgmvo9MM/FEpOixtc+0UIEUTdPLe+Es='} 2024-09-10T20:43:43.638 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-10T20:43:43.645 INFO:teuthology.task.internal:roles: ubuntu@smithi006.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-10T20:43:43.645 INFO:teuthology.task.internal:roles: ubuntu@smithi150.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-10T20:43:43.645 INFO:teuthology.run_tasks:Running task console_log... 2024-09-10T20:43:43.720 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1c6507fbe0>, signals=[15]) 2024-09-10T20:43:43.720 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-10T20:43:43.726 INFO:teuthology.task.internal:Opening connections... 2024-09-10T20:43:43.726 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi006.front.sepia.ceph.com 2024-09-10T20:43:43.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T20:43:43.813 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi150.front.sepia.ceph.com 2024-09-10T20:43:43.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T20:43:43.897 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-10T20:43:43.903 DEBUG:teuthology.orchestra.run.smithi006:> uname -m 2024-09-10T20:43:43.922 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2024-09-10T20:43:43.922 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2024-09-10T20:43:43.979 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="CentOS Stream" 2024-09-10T20:43:43.979 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="9" 2024-09-10T20:43:43.979 INFO:teuthology.orchestra.run.smithi006.stdout:ID="centos" 2024-09-10T20:43:43.979 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="rhel fedora" 2024-09-10T20:43:43.979 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="9" 2024-09-10T20:43:43.979 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el9" 2024-09-10T20:43:43.980 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T20:43:43.980 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2024-09-10T20:43:43.980 INFO:teuthology.orchestra.run.smithi006.stdout:LOGO="fedora-logo-icon" 2024-09-10T20:43:43.980 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T20:43:43.980 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://centos.org/" 2024-09-10T20:43:43.980 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T20:43:43.980 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T20:43:43.980 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T20:43:43.981 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2024-09-10T20:43:44.009 DEBUG:teuthology.orchestra.run.smithi150:> uname -m 2024-09-10T20:43:44.027 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64 2024-09-10T20:43:44.027 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release 2024-09-10T20:43:44.086 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="CentOS Stream" 2024-09-10T20:43:44.086 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="9" 2024-09-10T20:43:44.086 INFO:teuthology.orchestra.run.smithi150.stdout:ID="centos" 2024-09-10T20:43:44.086 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="rhel fedora" 2024-09-10T20:43:44.086 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="9" 2024-09-10T20:43:44.086 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el9" 2024-09-10T20:43:44.086 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T20:43:44.086 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31" 2024-09-10T20:43:44.086 INFO:teuthology.orchestra.run.smithi150.stdout:LOGO="fedora-logo-icon" 2024-09-10T20:43:44.086 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T20:43:44.086 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://centos.org/" 2024-09-10T20:43:44.087 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T20:43:44.087 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T20:43:44.087 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T20:43:44.087 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2024-09-10T20:43:44.117 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-10T20:43:44.127 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-10T20:43:44.183 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-10T20:43:44.183 DEBUG:teuthology.orchestra.run.smithi006:> test '!' -e /home/ubuntu/cephtest 2024-09-10T20:43:44.185 DEBUG:teuthology.orchestra.run.smithi150:> test '!' -e /home/ubuntu/cephtest 2024-09-10T20:43:44.202 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-10T20:43:44.209 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-10T20:43:44.209 DEBUG:teuthology.orchestra.run.smithi006:> test -z $(ls -A /var/lib/ceph) 2024-09-10T20:43:44.243 DEBUG:teuthology.orchestra.run.smithi150:> test -z $(ls -A /var/lib/ceph) 2024-09-10T20:43:44.343 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-10T20:43:44.410 INFO:teuthology.run_tasks:Running task kernel... 2024-09-10T20:43:44.426 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'} 2024-09-10T20:43:44.427 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}, 'mon.b': {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}}, timeout 300 2024-09-10T20:43:44.427 DEBUG:teuthology.orchestra.run.smithi006:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T20:43:44.427 DEBUG:teuthology.orchestra.run.smithi150:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T20:43:44.445 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T20:43:44.445 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T20:43:44.446 DEBUG:teuthology.task.kernel:sha1 for mon.b is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T20:43:44.447 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-10T20:43:44.447 DEBUG:teuthology.orchestra.run.smithi150:> uname -r 2024-09-10T20:43:44.447 DEBUG:teuthology.task.kernel:sha1 for mon.a is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T20:43:44.447 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-10T20:43:44.447 DEBUG:teuthology.orchestra.run.smithi006:> uname -r 2024-09-10T20:43:44.503 INFO:teuthology.orchestra.run.smithi150.stdout:5.14.0-503.el9.x86_64 2024-09-10T20:43:44.504 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T20:43:44.504 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-10T20:43:44.504 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T20:43:44.516 INFO:teuthology.orchestra.run.smithi006.stdout:5.14.0-503.el9.x86_64 2024-09-10T20:43:44.516 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T20:43:44.516 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-10T20:43:44.516 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T20:43:44.656 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum upgrade -y linux-firmware 2024-09-10T20:43:44.666 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum upgrade -y linux-firmware 2024-09-10T20:43:46.984 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.2 MB 00:00 2024-09-10T20:43:47.264 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - BaseOS 9.6 MB/s | 8.2 MB 00:00 2024-09-10T20:43:50.398 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - AppStream 10 MB/s | 20 MB 00:02 2024-09-10T20:43:55.707 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - CRB 4.3 MB/s | 6.5 MB 00:01 2024-09-10T20:43:57.316 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 19 kB 00:00 2024-09-10T20:43:58.395 INFO:teuthology.orchestra.run.smithi150.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-10T20:44:03.759 INFO:teuthology.orchestra.run.smithi150.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-10T20:44:05.885 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2024-09-10T20:44:05.886 INFO:teuthology.orchestra.run.smithi150.stdout:Nothing to do. 2024-09-10T20:44:05.886 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2024-09-10T20:44:05.989 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on mon.b... 2024-09-10T20:44:05.989 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T20:44:06.145 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-10T20:44:06.145 DEBUG:teuthology.orchestra.run.smithi150:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-10T20:44:06.148 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi150.front.sepia.ceph.com to complete... 2024-09-10T20:44:07.384 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 20 MB 00:19 2024-09-10T20:44:11.984 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-10T20:44:13.493 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - Extras packages 77 kB/s | 19 kB 00:00 2024-09-10T20:44:14.583 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10 20:44:14 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-10T20:44:14.583 INFO:teuthology.orchestra.run.smithi150.stderr:FINISHED --2024-09-10 20:44:14-- 2024-09-10T20:44:14.584 INFO:teuthology.orchestra.run.smithi150.stderr:Total wall clock time: 8.4s 2024-09-10T20:44:14.584 INFO:teuthology.orchestra.run.smithi150.stderr:Downloaded: 1 files, 343M in 8.1s (42.6 MB/s) 2024-09-10T20:44:14.587 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on mon.b... 2024-09-10T20:44:14.587 DEBUG:teuthology.orchestra.run.smithi150:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-10T20:44:14.630 INFO:teuthology.orchestra.run.smithi006.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-10T20:44:16.729 INFO:teuthology.orchestra.run.smithi150.stdout:Verifying... ######################################## 2024-09-10T20:44:16.855 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing... ######################################## 2024-09-10T20:44:16.960 INFO:teuthology.orchestra.run.smithi150.stdout:Updating / installing... 2024-09-10T20:44:20.270 INFO:teuthology.orchestra.run.smithi006.stdout:lab-extras 19 kB/s | 1.7 kB 00:00 2024-09-10T20:44:22.534 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2024-09-10T20:44:22.535 INFO:teuthology.orchestra.run.smithi006.stdout:Nothing to do. 2024-09-10T20:44:22.535 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2024-09-10T20:44:22.627 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on mon.a... 2024-09-10T20:44:22.627 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T20:44:22.785 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-10T20:44:22.785 DEBUG:teuthology.orchestra.run.smithi006:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-10T20:44:22.788 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi006.front.sepia.ceph.com to complete... 2024-09-10T20:44:24.951 INFO:teuthology.orchestra.run.smithi150.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-10T20:44:29.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10 20:44:29 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-10T20:44:29.137 INFO:teuthology.orchestra.run.smithi006.stderr:FINISHED --2024-09-10 20:44:29-- 2024-09-10T20:44:29.138 INFO:teuthology.orchestra.run.smithi006.stderr:Total wall clock time: 6.3s 2024-09-10T20:44:29.138 INFO:teuthology.orchestra.run.smithi006.stderr:Downloaded: 1 files, 343M in 6.0s (57.0 MB/s) 2024-09-10T20:44:29.142 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on mon.a... 2024-09-10T20:44:29.142 DEBUG:teuthology.orchestra.run.smithi006:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-10T20:44:31.353 INFO:teuthology.orchestra.run.smithi006.stdout:Verifying... ######################################## 2024-09-10T20:44:31.554 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing... ######################################## 2024-09-10T20:44:31.671 INFO:teuthology.orchestra.run.smithi006.stdout:Updating / installing... 2024-09-10T20:44:39.969 INFO:teuthology.orchestra.run.smithi006.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-10T20:45:04.881 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi150.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-10T20:45:04.881 DEBUG:teuthology.orchestra.run.smithi150:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-10T20:45:04.965 INFO:teuthology.orchestra.run.smithi150.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:45:04.965 INFO:teuthology.orchestra.run.smithi150.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:45:04.965 INFO:teuthology.orchestra.run.smithi150.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:45:04.965 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:45:04.965 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-10T20:45:04.965 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-10T20:45:04.965 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-10T20:45:04.965 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-10T20:45:04.965 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-10T20:45:04.965 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-10T20:45:04.965 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-10T20:45:04.966 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-10T20:45:04.966 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-10T20:45:04.966 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-10T20:45:04.966 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-10T20:45:04.966 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-10T20:45:04.966 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-10T20:45:04.966 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-10T20:45:04.966 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-10T20:45:04.966 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-10T20:45:04.966 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-10T20:45:04.966 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-10T20:45:04.966 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-10T20:45:04.966 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-10T20:45:04.967 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-10T20:45:04.967 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-10T20:45:04.967 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-10T20:45:04.967 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-10T20:45:04.967 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-10T20:45:04.967 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-10T20:45:04.967 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-10T20:45:04.967 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-10T20:45:04.967 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-10T20:45:04.967 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-10T20:45:04.967 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-10T20:45:04.967 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-10T20:45:04.967 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-10T20:45:04.968 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-10T20:45:04.968 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-10T20:45:04.968 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-10T20:45:04.968 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-10T20:45:04.968 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-10T20:45:04.968 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-10T20:45:04.968 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-10T20:45:04.968 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-10T20:45:04.968 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-10T20:45:04.968 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-10T20:45:04.968 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-10T20:45:04.969 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-10T20:45:04.969 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-10T20:45:04.969 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-10T20:45:04.969 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-10T20:45:04.969 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-10T20:45:04.969 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-10T20:45:04.969 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-10T20:45:04.969 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-10T20:45:04.969 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-10T20:45:04.969 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-10T20:45:04.969 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-10T20:45:04.969 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-10T20:45:04.969 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-10T20:45:04.970 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-10T20:45:04.970 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-10T20:45:04.970 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-10T20:45:04.970 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-10T20:45:04.970 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-10T20:45:04.970 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-10T20:45:04.970 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-10T20:45:04.970 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-10T20:45:04.970 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-10T20:45:04.970 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-10T20:45:04.970 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-10T20:45:04.970 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-10T20:45:04.970 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-10T20:45:04.970 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-10T20:45:04.971 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-10T20:45:04.971 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-10T20:45:04.971 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-10T20:45:04.971 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-10T20:45:04.971 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-10T20:45:04.971 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-10T20:45:04.971 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-10T20:45:04.971 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-10T20:45:04.971 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-10T20:45:04.971 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-10T20:45:04.971 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-10T20:45:04.971 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-10T20:45:04.971 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-10T20:45:04.972 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-10T20:45:04.972 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-10T20:45:04.972 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-10T20:45:04.972 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-10T20:45:04.972 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-10T20:45:04.972 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-10T20:45:04.972 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-10T20:45:04.972 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-10T20:45:04.972 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-10T20:45:04.972 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-10T20:45:04.972 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-10T20:45:04.972 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-10T20:45:04.972 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-10T20:45:04.973 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-10T20:45:04.973 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-10T20:45:04.973 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-10T20:45:04.973 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-10T20:45:04.973 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-10T20:45:04.973 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-10T20:45:04.973 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-10T20:45:04.973 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-10T20:45:04.973 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-10T20:45:04.973 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-10T20:45:04.973 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-10T20:45:04.973 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-10T20:45:04.973 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-10T20:45:04.973 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-10T20:45:04.974 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-10T20:45:04.974 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-10T20:45:04.974 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-10T20:45:04.974 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-10T20:45:04.974 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-10T20:45:04.974 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-10T20:45:04.974 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-10T20:45:04.974 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-10T20:45:04.974 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-10T20:45:04.974 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-10T20:45:04.974 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-10T20:45:04.974 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-10T20:45:04.975 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-10T20:45:04.975 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-10T20:45:04.975 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-10T20:45:04.975 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-10T20:45:04.975 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-10T20:45:04.975 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-10T20:45:04.975 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-10T20:45:04.975 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-10T20:45:04.975 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-10T20:45:04.975 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-10T20:45:04.975 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-10T20:45:04.975 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-10T20:45:04.975 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-10T20:45:04.976 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-10T20:45:04.976 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-10T20:45:04.976 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-10T20:45:04.976 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-10T20:45:04.976 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-10T20:45:04.976 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-10T20:45:04.976 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-10T20:45:04.976 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-10T20:45:04.976 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-10T20:45:04.976 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-10T20:45:04.976 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-10T20:45:04.976 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-10T20:45:04.976 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-10T20:45:04.977 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-10T20:45:04.977 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-10T20:45:04.977 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-10T20:45:04.977 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-10T20:45:04.977 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-10T20:45:04.977 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-10T20:45:04.977 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-10T20:45:04.977 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-10T20:45:04.977 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-10T20:45:04.977 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-10T20:45:04.977 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-10T20:45:04.977 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-10T20:45:04.977 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-10T20:45:04.978 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-10T20:45:04.978 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-10T20:45:04.978 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-10T20:45:04.978 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-10T20:45:04.978 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-10T20:45:04.978 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-10T20:45:04.978 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-10T20:45:04.978 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-10T20:45:04.978 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-10T20:45:04.978 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-10T20:45:04.978 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-10T20:45:04.978 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-10T20:45:04.978 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-10T20:45:04.978 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-10T20:45:04.979 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-10T20:45:04.979 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-10T20:45:04.979 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-10T20:45:04.979 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-10T20:45:04.979 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-10T20:45:04.979 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-10T20:45:04.979 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-10T20:45:04.979 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-10T20:45:04.979 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-10T20:45:04.979 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-10T20:45:04.979 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-10T20:45:04.979 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-10T20:45:04.979 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-10T20:45:04.980 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-10T20:45:04.980 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-10T20:45:04.980 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-10T20:45:04.980 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-10T20:45:04.980 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-10T20:45:04.980 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-10T20:45:04.980 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-10T20:45:04.980 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-10T20:45:04.980 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-10T20:45:04.980 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-10T20:45:04.980 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-10T20:45:04.980 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-10T20:45:04.980 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-10T20:45:04.981 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-10T20:45:04.981 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-10T20:45:04.981 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-10T20:45:04.981 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-10T20:45:04.981 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-10T20:45:04.981 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-10T20:45:04.981 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-10T20:45:04.981 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-10T20:45:04.981 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-10T20:45:04.981 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-10T20:45:04.981 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-10T20:45:04.981 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-10T20:45:04.981 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-10T20:45:04.982 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-10T20:45:04.982 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-10T20:45:04.982 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-10T20:45:04.982 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-10T20:45:04.982 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-10T20:45:04.982 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-10T20:45:04.982 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-10T20:45:04.982 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-10T20:45:04.982 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-10T20:45:04.982 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-10T20:45:04.982 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-10T20:45:04.982 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-10T20:45:04.982 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-10T20:45:04.982 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-10T20:45:04.983 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-10T20:45:04.983 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-10T20:45:04.983 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-10T20:45:04.983 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-10T20:45:04.983 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-10T20:45:04.983 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-10T20:45:04.983 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-10T20:45:04.983 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-10T20:45:04.983 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-10T20:45:04.983 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-10T20:45:04.983 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-10T20:45:04.983 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-10T20:45:04.983 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-10T20:45:04.984 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-10T20:45:04.984 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-10T20:45:04.984 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-10T20:45:04.984 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-10T20:45:04.984 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-10T20:45:04.984 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-10T20:45:04.984 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-10T20:45:04.984 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-10T20:45:04.984 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-10T20:45:04.984 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-10T20:45:04.984 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-10T20:45:04.984 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-10T20:45:04.984 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-10T20:45:04.985 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-10T20:45:04.985 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-10T20:45:04.985 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-10T20:45:04.985 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-10T20:45:04.985 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-10T20:45:04.985 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-10T20:45:04.985 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-10T20:45:04.985 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-10T20:45:04.985 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-10T20:45:04.985 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-10T20:45:04.985 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-10T20:45:04.985 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-10T20:45:04.985 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-10T20:45:04.985 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-10T20:45:04.986 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-10T20:45:04.986 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-10T20:45:04.986 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-10T20:45:04.986 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-10T20:45:04.986 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-10T20:45:04.986 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-10T20:45:04.986 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-10T20:45:04.986 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-10T20:45:04.986 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-10T20:45:04.986 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-10T20:45:04.986 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-10T20:45:04.986 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-10T20:45:04.986 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-10T20:45:04.986 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-10T20:45:04.987 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-10T20:45:04.987 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-10T20:45:04.987 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-10T20:45:04.987 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-10T20:45:04.987 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-10T20:45:04.987 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-10T20:45:04.987 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-10T20:45:04.987 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-10T20:45:04.987 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-10T20:45:04.987 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-10T20:45:04.987 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-10T20:45:04.987 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-10T20:45:04.987 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-10T20:45:04.987 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-10T20:45:04.988 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-10T20:45:04.988 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-10T20:45:04.988 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-10T20:45:04.988 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-10T20:45:04.988 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-10T20:45:04.988 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-10T20:45:04.988 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-10T20:45:04.988 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-10T20:45:04.988 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-10T20:45:04.988 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-10T20:45:04.988 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-10T20:45:04.988 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-10T20:45:04.988 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-10T20:45:04.989 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-10T20:45:04.989 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-10T20:45:04.989 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-10T20:45:04.989 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-10T20:45:04.989 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-10T20:45:04.989 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-10T20:45:04.989 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-10T20:45:04.989 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-10T20:45:04.989 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-10T20:45:04.989 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-10T20:45:04.989 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-10T20:45:04.989 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-10T20:45:04.989 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-10T20:45:04.990 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-10T20:45:04.990 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-10T20:45:04.990 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-10T20:45:04.990 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-10T20:45:04.990 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-10T20:45:04.990 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-10T20:45:04.990 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-10T20:45:04.990 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-10T20:45:04.990 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-10T20:45:04.990 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-10T20:45:04.990 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-10T20:45:04.990 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-10T20:45:04.990 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-10T20:45:04.991 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-10T20:45:04.991 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-10T20:45:04.991 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-10T20:45:04.991 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-10T20:45:04.991 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-10T20:45:04.991 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-10T20:45:04.991 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-10T20:45:04.991 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-10T20:45:04.991 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-10T20:45:04.991 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-10T20:45:04.991 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-10T20:45:04.991 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-10T20:45:04.991 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-10T20:45:04.992 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-10T20:45:04.992 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-10T20:45:04.992 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-10T20:45:04.992 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-10T20:45:04.992 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-10T20:45:04.992 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-10T20:45:04.992 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-10T20:45:04.992 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-10T20:45:04.992 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-10T20:45:04.993 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-10T20:45:04.993 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-10T20:45:04.993 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-10T20:45:04.993 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-10T20:45:04.993 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-10T20:45:04.993 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-10T20:45:04.993 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-10T20:45:04.993 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-10T20:45:04.993 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-10T20:45:04.993 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-10T20:45:04.993 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-10T20:45:04.993 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-10T20:45:04.993 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-10T20:45:04.994 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-10T20:45:04.994 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-10T20:45:04.994 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-10T20:45:04.994 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-10T20:45:04.994 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-10T20:45:04.994 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-10T20:45:04.994 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-10T20:45:04.994 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-10T20:45:04.994 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-10T20:45:04.994 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-10T20:45:04.994 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-10T20:45:04.994 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-10T20:45:04.994 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-10T20:45:04.994 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-10T20:45:04.995 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-10T20:45:04.995 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-10T20:45:04.995 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-10T20:45:04.995 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-10T20:45:04.995 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-10T20:45:04.995 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-10T20:45:04.995 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-10T20:45:04.995 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-10T20:45:04.995 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-10T20:45:04.995 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-10T20:45:04.995 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-10T20:45:04.995 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-10T20:45:04.995 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-10T20:45:04.996 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-10T20:45:04.996 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-10T20:45:04.996 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-10T20:45:04.996 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-10T20:45:04.996 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-10T20:45:04.996 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-10T20:45:04.996 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-10T20:45:04.996 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-10T20:45:04.996 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-10T20:45:04.996 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-10T20:45:04.996 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-10T20:45:04.997 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-10T20:45:04.997 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-10T20:45:04.997 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-10T20:45:04.997 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-10T20:45:04.997 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-10T20:45:04.997 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-10T20:45:04.997 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-10T20:45:04.997 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-10T20:45:04.997 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-10T20:45:04.997 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-10T20:45:04.997 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-10T20:45:04.997 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-10T20:45:04.998 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-10T20:45:04.998 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-10T20:45:04.998 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-10T20:45:04.998 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-10T20:45:04.998 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-10T20:45:04.998 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-10T20:45:04.998 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-10T20:45:04.998 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-10T20:45:04.998 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-10T20:45:04.998 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-10T20:45:04.998 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-10T20:45:04.998 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-10T20:45:04.998 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-10T20:45:04.999 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-10T20:45:04.999 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-10T20:45:04.999 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-10T20:45:04.999 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-10T20:45:04.999 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-10T20:45:04.999 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-10T20:45:04.999 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-10T20:45:04.999 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-10T20:45:04.999 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-10T20:45:04.999 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-10T20:45:04.999 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-10T20:45:04.999 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-10T20:45:04.999 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-10T20:45:04.999 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-10T20:45:05.000 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-10T20:45:05.000 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-10T20:45:05.000 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-10T20:45:05.000 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-10T20:45:05.000 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-10T20:45:05.000 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-10T20:45:05.000 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-10T20:45:05.000 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-10T20:45:05.000 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-10T20:45:05.000 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-10T20:45:05.000 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-10T20:45:05.000 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-10T20:45:05.000 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-10T20:45:05.000 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-10T20:45:05.001 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-10T20:45:05.001 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-10T20:45:05.001 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-10T20:45:05.001 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-10T20:45:05.001 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-10T20:45:05.001 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-10T20:45:05.001 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-10T20:45:05.001 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-10T20:45:05.001 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-10T20:45:05.001 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-10T20:45:05.001 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-10T20:45:05.001 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-10T20:45:05.001 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-10T20:45:05.001 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-10T20:45:05.002 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-10T20:45:05.002 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-10T20:45:05.002 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-10T20:45:05.002 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-10T20:45:05.002 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-10T20:45:05.002 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-10T20:45:05.002 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-10T20:45:05.002 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-10T20:45:05.002 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-10T20:45:05.002 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-10T20:45:05.002 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-10T20:45:05.002 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-10T20:45:05.002 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-10T20:45:05.002 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-10T20:45:05.002 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-10T20:45:05.003 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-10T20:45:05.003 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-10T20:45:05.003 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-10T20:45:05.003 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-10T20:45:05.003 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-10T20:45:05.003 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-10T20:45:05.003 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-10T20:45:05.003 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-10T20:45:05.003 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-10T20:45:05.003 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-10T20:45:05.003 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-10T20:45:05.003 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-10T20:45:05.003 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-10T20:45:05.003 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-10T20:45:05.004 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-10T20:45:05.004 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-10T20:45:05.004 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-10T20:45:05.004 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-10T20:45:05.004 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-10T20:45:05.004 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-10T20:45:05.004 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-10T20:45:05.004 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-10T20:45:05.004 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-10T20:45:05.004 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-10T20:45:05.004 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-10T20:45:05.004 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-10T20:45:05.004 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-10T20:45:05.005 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-10T20:45:05.005 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-10T20:45:05.005 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-10T20:45:05.005 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-10T20:45:05.005 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-10T20:45:05.005 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-10T20:45:05.005 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-10T20:45:05.005 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-10T20:45:05.005 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-10T20:45:05.005 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-10T20:45:05.005 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-10T20:45:05.005 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-10T20:45:05.005 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-10T20:45:05.005 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-10T20:45:05.006 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-10T20:45:05.006 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-10T20:45:05.006 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-10T20:45:05.006 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-10T20:45:05.006 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-10T20:45:05.006 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-10T20:45:05.006 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-10T20:45:05.006 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-10T20:45:05.006 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-10T20:45:05.006 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-10T20:45:05.006 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-10T20:45:05.006 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-10T20:45:05.006 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-10T20:45:05.006 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-10T20:45:05.006 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-10T20:45:05.007 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-10T20:45:05.007 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-10T20:45:05.007 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-10T20:45:05.007 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-10T20:45:05.007 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-10T20:45:05.007 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-10T20:45:05.007 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-10T20:45:05.007 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-10T20:45:05.007 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-10T20:45:05.007 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-10T20:45:05.007 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-10T20:45:05.007 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-10T20:45:05.007 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-10T20:45:05.007 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-10T20:45:05.008 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-10T20:45:05.008 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-10T20:45:05.008 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-10T20:45:05.008 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-10T20:45:05.008 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-10T20:45:05.008 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-10T20:45:05.008 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-10T20:45:05.008 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-10T20:45:05.008 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-10T20:45:05.008 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-10T20:45:05.008 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-10T20:45:05.008 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-10T20:45:05.009 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-10T20:45:05.009 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-10T20:45:05.009 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-10T20:45:05.009 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-10T20:45:05.009 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-10T20:45:05.009 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-10T20:45:05.009 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-10T20:45:05.009 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-10T20:45:05.009 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-10T20:45:05.009 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-10T20:45:05.009 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-10T20:45:05.009 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-10T20:45:05.009 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-10T20:45:05.009 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-10T20:45:05.010 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-10T20:45:05.010 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-10T20:45:05.010 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-10T20:45:05.010 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-10T20:45:05.010 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-10T20:45:05.010 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-10T20:45:05.010 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-10T20:45:05.010 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-10T20:45:05.010 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-10T20:45:05.010 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-10T20:45:05.010 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-10T20:45:05.010 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-10T20:45:05.010 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-10T20:45:05.010 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-10T20:45:05.011 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-10T20:45:05.011 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-10T20:45:05.011 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-10T20:45:05.011 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-10T20:45:05.011 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-10T20:45:05.011 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-10T20:45:05.011 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-10T20:45:05.011 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-10T20:45:05.011 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-10T20:45:05.011 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-10T20:45:05.011 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-10T20:45:05.011 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-10T20:45:05.011 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-10T20:45:05.012 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-10T20:45:05.012 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-10T20:45:05.012 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-10T20:45:05.012 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-10T20:45:05.012 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-10T20:45:05.012 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-10T20:45:05.012 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-10T20:45:05.012 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-10T20:45:05.012 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-10T20:45:05.012 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-10T20:45:05.012 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-10T20:45:05.012 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-10T20:45:05.012 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-10T20:45:05.012 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-10T20:45:05.013 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-10T20:45:05.013 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-10T20:45:05.013 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-10T20:45:05.013 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-10T20:45:05.013 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-10T20:45:05.013 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-10T20:45:05.013 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-10T20:45:05.013 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-10T20:45:05.013 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-10T20:45:05.013 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-10T20:45:05.013 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-10T20:45:05.013 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-10T20:45:05.014 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-10T20:45:05.014 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-10T20:45:05.014 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-10T20:45:05.014 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-10T20:45:05.014 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-10T20:45:05.014 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-10T20:45:05.014 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-10T20:45:05.014 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-10T20:45:05.014 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-10T20:45:05.014 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-10T20:45:05.014 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-10T20:45:05.014 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-10T20:45:05.014 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-10T20:45:05.014 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-10T20:45:05.015 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-10T20:45:05.015 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-10T20:45:05.015 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-10T20:45:05.015 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-10T20:45:05.015 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-10T20:45:05.015 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-10T20:45:05.015 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-10T20:45:05.015 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-10T20:45:05.015 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-10T20:45:05.015 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-10T20:45:05.015 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-10T20:45:05.015 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-10T20:45:05.015 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-10T20:45:05.016 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-10T20:45:05.016 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-10T20:45:05.016 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-10T20:45:05.016 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-10T20:45:05.016 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-10T20:45:05.016 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-10T20:45:05.016 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-10T20:45:05.016 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-10T20:45:05.016 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-10T20:45:05.016 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-10T20:45:05.016 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-10T20:45:05.016 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-10T20:45:05.017 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-10T20:45:05.017 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-10T20:45:05.017 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-10T20:45:05.017 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-10T20:45:05.017 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-10T20:45:05.017 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-10T20:45:05.017 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-10T20:45:05.017 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-10T20:45:05.017 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-10T20:45:05.017 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-10T20:45:05.017 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-10T20:45:05.017 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-10T20:45:05.017 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-10T20:45:05.018 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-10T20:45:05.018 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-10T20:45:05.018 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-10T20:45:05.018 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-10T20:45:05.018 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-10T20:45:05.018 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-10T20:45:05.018 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-10T20:45:05.018 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-10T20:45:05.018 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-10T20:45:05.018 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-10T20:45:05.018 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-10T20:45:05.018 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-10T20:45:05.018 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-10T20:45:05.019 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-10T20:45:05.019 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-10T20:45:05.019 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-10T20:45:05.019 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-10T20:45:05.019 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-10T20:45:05.019 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-10T20:45:05.019 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-10T20:45:05.019 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-10T20:45:05.019 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-10T20:45:05.019 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-10T20:45:05.019 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-10T20:45:05.019 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-10T20:45:05.020 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-10T20:45:05.020 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-10T20:45:05.020 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-10T20:45:05.020 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-10T20:45:05.020 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-10T20:45:05.020 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-10T20:45:05.020 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-10T20:45:05.020 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-10T20:45:05.020 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-10T20:45:05.020 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-10T20:45:05.020 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-10T20:45:05.020 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-10T20:45:05.020 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-10T20:45:05.021 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-10T20:45:05.021 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-10T20:45:05.021 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-10T20:45:05.021 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-10T20:45:05.021 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-10T20:45:05.021 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-10T20:45:05.021 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-10T20:45:05.021 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-10T20:45:05.021 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-10T20:45:05.021 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-10T20:45:05.021 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-10T20:45:05.021 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-10T20:45:05.021 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-10T20:45:05.021 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-10T20:45:05.022 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-10T20:45:05.022 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-10T20:45:05.022 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-10T20:45:05.022 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-10T20:45:05.022 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-10T20:45:05.022 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-10T20:45:05.022 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-10T20:45:05.022 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-10T20:45:05.022 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-10T20:45:05.022 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-10T20:45:05.022 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-10T20:45:05.022 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-10T20:45:05.022 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-10T20:45:05.022 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-10T20:45:05.023 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-10T20:45:05.023 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-10T20:45:05.023 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-10T20:45:05.023 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-10T20:45:05.023 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-10T20:45:05.023 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-10T20:45:05.023 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-10T20:45:05.023 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-10T20:45:05.023 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-10T20:45:05.023 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-10T20:45:05.023 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-10T20:45:05.023 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-10T20:45:05.023 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-10T20:45:05.023 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-10T20:45:05.024 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-10T20:45:05.024 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-10T20:45:05.024 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-10T20:45:05.024 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-10T20:45:05.024 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-10T20:45:05.024 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-10T20:45:05.024 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-10T20:45:05.024 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-10T20:45:05.024 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-10T20:45:05.024 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-10T20:45:05.024 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-10T20:45:05.024 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-10T20:45:05.025 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-10T20:45:05.025 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-10T20:45:05.025 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-10T20:45:05.025 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-10T20:45:05.025 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-10T20:45:05.025 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-10T20:45:05.025 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-10T20:45:05.025 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-10T20:45:05.025 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-10T20:45:05.025 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-10T20:45:05.025 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-10T20:45:05.025 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-10T20:45:05.025 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-10T20:45:05.025 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-10T20:45:05.026 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-10T20:45:05.026 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-10T20:45:05.026 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-10T20:45:05.026 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-10T20:45:05.026 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-10T20:45:05.026 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-10T20:45:05.026 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-10T20:45:05.026 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-10T20:45:05.026 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-10T20:45:05.026 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-10T20:45:05.026 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-10T20:45:05.026 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-10T20:45:05.026 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-10T20:45:05.027 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-10T20:45:05.027 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-10T20:45:05.027 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-10T20:45:05.027 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-10T20:45:05.027 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-10T20:45:05.027 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-10T20:45:05.027 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-10T20:45:05.027 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-10T20:45:05.027 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-10T20:45:05.027 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-10T20:45:05.027 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-10T20:45:05.027 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-10T20:45:05.027 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-10T20:45:05.028 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-10T20:45:05.028 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-10T20:45:05.028 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-10T20:45:05.028 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-10T20:45:05.028 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-10T20:45:05.028 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-10T20:45:05.028 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-10T20:45:05.028 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-10T20:45:05.028 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-10T20:45:05.028 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-10T20:45:05.028 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-10T20:45:05.028 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-10T20:45:05.028 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-10T20:45:05.029 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-10T20:45:05.029 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-10T20:45:05.029 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-10T20:45:05.029 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-10T20:45:05.029 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-10T20:45:05.029 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-10T20:45:05.029 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-10T20:45:05.029 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-10T20:45:05.029 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-10T20:45:05.029 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-10T20:45:05.029 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-10T20:45:05.029 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-10T20:45:05.029 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-10T20:45:05.030 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-10T20:45:05.030 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-10T20:45:05.030 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-10T20:45:05.030 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-10T20:45:05.030 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-10T20:45:05.030 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-10T20:45:05.030 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-10T20:45:05.030 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-10T20:45:05.030 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-10T20:45:05.030 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-10T20:45:05.030 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-10T20:45:05.030 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-10T20:45:05.030 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-10T20:45:05.031 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-10T20:45:05.031 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-10T20:45:05.031 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-10T20:45:05.031 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-10T20:45:05.031 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-10T20:45:05.031 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-10T20:45:05.031 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-10T20:45:05.031 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-10T20:45:05.031 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-10T20:45:05.031 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-10T20:45:05.031 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-10T20:45:05.031 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-10T20:45:05.031 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-10T20:45:05.032 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-10T20:45:05.032 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-10T20:45:05.032 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-10T20:45:05.032 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-10T20:45:05.032 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-10T20:45:05.032 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-10T20:45:05.032 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-10T20:45:05.032 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-10T20:45:05.032 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-10T20:45:05.032 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-10T20:45:05.032 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-10T20:45:05.032 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-10T20:45:05.032 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-10T20:45:05.033 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-10T20:45:05.033 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-10T20:45:05.033 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-10T20:45:05.033 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-10T20:45:05.033 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-10T20:45:05.033 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-10T20:45:05.033 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-10T20:45:05.033 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-10T20:45:05.033 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-10T20:45:05.033 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-10T20:45:05.033 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-10T20:45:05.033 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-10T20:45:05.033 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-10T20:45:05.034 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-10T20:45:05.034 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-10T20:45:05.034 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-10T20:45:05.034 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-10T20:45:05.034 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-10T20:45:05.034 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-10T20:45:05.034 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-10T20:45:05.034 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-10T20:45:05.034 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-10T20:45:05.034 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-10T20:45:05.034 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-10T20:45:05.034 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-10T20:45:05.034 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-10T20:45:05.034 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-10T20:45:05.035 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-10T20:45:05.035 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-10T20:45:05.035 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-10T20:45:05.035 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-10T20:45:05.035 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-10T20:45:05.035 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-10T20:45:05.035 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-10T20:45:05.035 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-10T20:45:05.035 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-10T20:45:05.035 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-10T20:45:05.035 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-10T20:45:05.035 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-10T20:45:05.035 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-10T20:45:05.035 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-10T20:45:05.036 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-10T20:45:05.036 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-10T20:45:05.036 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-10T20:45:05.036 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-10T20:45:05.036 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-10T20:45:05.036 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-10T20:45:05.036 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-10T20:45:05.036 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-10T20:45:05.036 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-10T20:45:05.036 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-10T20:45:05.036 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-10T20:45:05.036 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-10T20:45:05.036 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-10T20:45:05.037 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-10T20:45:05.037 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-10T20:45:05.037 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-10T20:45:05.037 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-10T20:45:05.037 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-10T20:45:05.037 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-10T20:45:05.037 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-10T20:45:05.037 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-10T20:45:05.037 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-10T20:45:05.037 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-10T20:45:05.037 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-10T20:45:05.037 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-10T20:45:05.037 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-10T20:45:05.038 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-10T20:45:05.038 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-10T20:45:05.038 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-10T20:45:05.038 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-10T20:45:05.038 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-10T20:45:05.038 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-10T20:45:05.038 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-10T20:45:05.038 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-10T20:45:05.038 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-10T20:45:05.038 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-10T20:45:05.038 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-10T20:45:05.038 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-10T20:45:05.038 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-10T20:45:05.038 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-10T20:45:05.038 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-10T20:45:05.039 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-10T20:45:05.039 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-10T20:45:05.039 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-10T20:45:05.039 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-10T20:45:05.039 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-10T20:45:05.039 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-10T20:45:05.039 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-10T20:45:05.039 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-10T20:45:05.039 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-10T20:45:05.039 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-10T20:45:05.039 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-10T20:45:05.039 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-10T20:45:05.039 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-10T20:45:05.040 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-10T20:45:05.040 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-10T20:45:05.040 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-10T20:45:05.040 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-10T20:45:05.040 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-10T20:45:05.040 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-10T20:45:05.040 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-10T20:45:05.040 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-10T20:45:05.040 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-10T20:45:05.040 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-10T20:45:05.040 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-10T20:45:05.040 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-10T20:45:05.040 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-10T20:45:05.041 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-10T20:45:05.041 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-10T20:45:05.041 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-10T20:45:05.041 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-10T20:45:05.041 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-10T20:45:05.041 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-10T20:45:05.041 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-10T20:45:05.041 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-10T20:45:05.041 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-10T20:45:05.041 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-10T20:45:05.041 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-10T20:45:05.041 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-10T20:45:05.042 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-10T20:45:05.042 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-10T20:45:05.042 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-10T20:45:05.042 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-10T20:45:05.042 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-10T20:45:05.042 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-10T20:45:05.042 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-10T20:45:05.042 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-10T20:45:05.042 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-10T20:45:05.042 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-10T20:45:05.042 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-10T20:45:05.042 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-10T20:45:05.042 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-10T20:45:05.042 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-10T20:45:05.043 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-10T20:45:05.043 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-10T20:45:05.043 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-10T20:45:05.043 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-10T20:45:05.043 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-10T20:45:05.043 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-10T20:45:05.043 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-10T20:45:05.043 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-10T20:45:05.043 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-10T20:45:05.043 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-10T20:45:05.043 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-10T20:45:05.043 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-10T20:45:05.043 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-10T20:45:05.044 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-10T20:45:05.044 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-10T20:45:05.044 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-10T20:45:05.044 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-10T20:45:05.044 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-10T20:45:05.044 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-10T20:45:05.044 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-10T20:45:05.044 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-10T20:45:05.044 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-10T20:45:05.044 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-10T20:45:05.044 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-10T20:45:05.044 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-10T20:45:05.044 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-10T20:45:05.044 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-10T20:45:05.045 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-10T20:45:05.045 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-10T20:45:05.045 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-10T20:45:05.045 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-10T20:45:05.045 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-10T20:45:05.045 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-10T20:45:05.045 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-10T20:45:05.045 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-10T20:45:05.045 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-10T20:45:05.045 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-10T20:45:05.045 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-10T20:45:05.045 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-10T20:45:05.046 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-10T20:45:05.046 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-10T20:45:05.046 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-10T20:45:05.046 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-10T20:45:05.046 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-10T20:45:05.046 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-10T20:45:05.046 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-10T20:45:05.046 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-10T20:45:05.046 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-10T20:45:05.046 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-10T20:45:05.046 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-10T20:45:05.046 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-10T20:45:05.046 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-10T20:45:05.046 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-10T20:45:05.047 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-10T20:45:05.047 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-10T20:45:05.047 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-10T20:45:05.047 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-10T20:45:05.047 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-10T20:45:05.047 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-10T20:45:05.047 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-10T20:45:05.047 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-10T20:45:05.047 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-10T20:45:05.047 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-10T20:45:05.047 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-10T20:45:05.047 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-10T20:45:05.047 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-10T20:45:05.048 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-10T20:45:05.048 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-10T20:45:05.048 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-10T20:45:05.048 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-10T20:45:05.048 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-10T20:45:05.048 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-10T20:45:05.048 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-10T20:45:05.048 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-10T20:45:05.048 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-10T20:45:05.048 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-10T20:45:05.048 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-10T20:45:05.048 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-10T20:45:05.048 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-10T20:45:05.048 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-10T20:45:05.049 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-10T20:45:05.049 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-10T20:45:05.049 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-10T20:45:05.049 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-10T20:45:05.049 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-10T20:45:05.049 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-10T20:45:05.049 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-10T20:45:05.049 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-10T20:45:05.049 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-10T20:45:05.049 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-10T20:45:05.049 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-10T20:45:05.049 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-10T20:45:05.049 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-10T20:45:05.050 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-10T20:45:05.050 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-10T20:45:05.050 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-10T20:45:05.050 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-10T20:45:05.050 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-10T20:45:05.050 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-10T20:45:05.050 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-10T20:45:05.050 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-10T20:45:05.050 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-10T20:45:05.050 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-10T20:45:05.050 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-10T20:45:05.050 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-10T20:45:05.050 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-10T20:45:05.051 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-10T20:45:05.051 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-10T20:45:05.051 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-10T20:45:05.051 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-10T20:45:05.051 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-10T20:45:05.051 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-10T20:45:05.051 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-10T20:45:05.051 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-10T20:45:05.051 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-10T20:45:05.051 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-10T20:45:05.051 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-10T20:45:05.051 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-10T20:45:05.051 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-10T20:45:05.052 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-10T20:45:05.052 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-10T20:45:05.052 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-10T20:45:05.052 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-10T20:45:05.052 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-10T20:45:05.052 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-10T20:45:05.052 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-10T20:45:05.052 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-10T20:45:05.052 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-10T20:45:05.052 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-10T20:45:05.052 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-10T20:45:05.052 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-10T20:45:05.052 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-10T20:45:05.052 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-10T20:45:05.053 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-10T20:45:05.053 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-10T20:45:05.053 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-10T20:45:05.053 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-10T20:45:05.053 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-10T20:45:05.053 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-10T20:45:05.053 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-10T20:45:05.053 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-10T20:45:05.053 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-10T20:45:05.053 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-10T20:45:05.053 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-10T20:45:05.053 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-10T20:45:05.053 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-10T20:45:05.054 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-10T20:45:05.054 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-10T20:45:05.054 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-10T20:45:05.054 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-10T20:45:05.054 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-10T20:45:05.054 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-10T20:45:05.054 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-10T20:45:05.054 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-10T20:45:05.054 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-10T20:45:05.054 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-10T20:45:05.054 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-10T20:45:05.054 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-10T20:45:05.054 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-10T20:45:05.055 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-10T20:45:05.055 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-10T20:45:05.055 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-10T20:45:05.055 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-10T20:45:05.055 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-10T20:45:05.055 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-10T20:45:05.055 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-10T20:45:05.055 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-10T20:45:05.055 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-10T20:45:05.055 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-10T20:45:05.055 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-10T20:45:05.055 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-10T20:45:05.055 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-10T20:45:05.055 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-10T20:45:05.056 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-10T20:45:05.056 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-10T20:45:05.056 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-10T20:45:05.056 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-10T20:45:05.056 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-10T20:45:05.056 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-10T20:45:05.056 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-10T20:45:05.056 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-10T20:45:05.056 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-10T20:45:05.056 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-10T20:45:05.056 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-10T20:45:05.056 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-10T20:45:05.057 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-10T20:45:05.057 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-10T20:45:05.057 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-10T20:45:05.057 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-10T20:45:05.057 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-10T20:45:05.057 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-10T20:45:05.057 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-10T20:45:05.057 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-10T20:45:05.057 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-10T20:45:05.057 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-10T20:45:05.057 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-10T20:45:05.057 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-10T20:45:05.057 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-10T20:45:05.057 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-10T20:45:05.058 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-10T20:45:05.058 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-10T20:45:05.058 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-10T20:45:05.058 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-10T20:45:05.058 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-10T20:45:05.058 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-10T20:45:05.058 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-10T20:45:05.058 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-10T20:45:05.058 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-10T20:45:05.058 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-10T20:45:05.058 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-10T20:45:05.058 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-10T20:45:05.058 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-10T20:45:05.059 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-10T20:45:05.059 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-10T20:45:05.059 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-10T20:45:05.059 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-10T20:45:05.059 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-10T20:45:05.059 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-10T20:45:05.059 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-10T20:45:05.059 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-10T20:45:05.059 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-10T20:45:05.059 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-10T20:45:05.059 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-10T20:45:05.059 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-10T20:45:05.059 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-10T20:45:05.059 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-10T20:45:05.060 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-10T20:45:05.060 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-10T20:45:05.060 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-10T20:45:05.060 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-10T20:45:05.060 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-10T20:45:05.060 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-10T20:45:05.060 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-10T20:45:05.060 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-10T20:45:05.060 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-10T20:45:05.060 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-10T20:45:05.060 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-10T20:45:05.060 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-10T20:45:05.060 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-10T20:45:05.061 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-10T20:45:05.061 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-10T20:45:05.061 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-10T20:45:05.061 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-10T20:45:05.061 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-10T20:45:05.061 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-10T20:45:05.061 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-10T20:45:05.061 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-10T20:45:05.061 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-10T20:45:05.061 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-10T20:45:05.061 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-10T20:45:05.061 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-10T20:45:05.061 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-10T20:45:05.061 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-10T20:45:05.062 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-10T20:45:05.062 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-10T20:45:05.062 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-10T20:45:05.062 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-10T20:45:05.062 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-10T20:45:05.062 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-10T20:45:05.062 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-10T20:45:05.062 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-10T20:45:05.062 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-10T20:45:05.062 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-10T20:45:05.062 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-10T20:45:05.062 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-10T20:45:05.062 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-10T20:45:05.062 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-10T20:45:05.063 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-10T20:45:05.063 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-10T20:45:05.063 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-10T20:45:05.063 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-10T20:45:05.063 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-10T20:45:05.063 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-10T20:45:05.063 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-10T20:45:05.063 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-10T20:45:05.063 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-10T20:45:05.063 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-10T20:45:05.063 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-10T20:45:05.063 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-10T20:45:05.063 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-10T20:45:05.064 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-10T20:45:05.064 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-10T20:45:05.064 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-10T20:45:05.064 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-10T20:45:05.064 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-10T20:45:05.064 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-10T20:45:05.064 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-10T20:45:05.064 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-10T20:45:05.064 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-10T20:45:05.064 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-10T20:45:05.064 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-10T20:45:05.064 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-10T20:45:05.064 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-10T20:45:05.065 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-10T20:45:05.065 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-10T20:45:05.065 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-10T20:45:05.065 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-10T20:45:05.065 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-10T20:45:05.065 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-10T20:45:05.065 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-10T20:45:05.065 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-10T20:45:05.065 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-10T20:45:05.065 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-10T20:45:05.065 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-10T20:45:05.065 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-10T20:45:05.065 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-10T20:45:05.065 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-10T20:45:05.066 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-10T20:45:05.066 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-10T20:45:05.066 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-10T20:45:05.066 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-10T20:45:05.066 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-10T20:45:05.066 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-10T20:45:05.066 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-10T20:45:05.066 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-10T20:45:05.066 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-10T20:45:05.066 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-10T20:45:05.066 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-10T20:45:05.066 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-10T20:45:05.066 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-10T20:45:05.067 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-10T20:45:05.067 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-10T20:45:05.067 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-10T20:45:05.067 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-10T20:45:05.067 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-10T20:45:05.067 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-10T20:45:05.067 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-10T20:45:05.067 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-10T20:45:05.067 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-10T20:45:05.067 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-10T20:45:05.067 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-10T20:45:05.067 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-10T20:45:05.067 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-10T20:45:05.068 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-10T20:45:05.068 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-10T20:45:05.068 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-10T20:45:05.068 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-10T20:45:05.068 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-10T20:45:05.068 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-10T20:45:05.068 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-10T20:45:05.068 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-10T20:45:05.068 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-10T20:45:05.068 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-10T20:45:05.068 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-10T20:45:05.068 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-10T20:45:05.068 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-10T20:45:05.069 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-10T20:45:05.069 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-10T20:45:05.069 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-10T20:45:05.069 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-10T20:45:05.069 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-10T20:45:05.069 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-10T20:45:05.069 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-10T20:45:05.069 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-10T20:45:05.069 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-10T20:45:05.069 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-10T20:45:05.069 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-10T20:45:05.069 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-10T20:45:05.069 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-10T20:45:05.070 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-10T20:45:05.070 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-10T20:45:05.070 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-10T20:45:05.070 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-10T20:45:05.070 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-10T20:45:05.070 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-10T20:45:05.070 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-10T20:45:05.070 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-10T20:45:05.070 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-10T20:45:05.070 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-10T20:45:05.070 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-10T20:45:05.070 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-10T20:45:05.070 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-10T20:45:05.071 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-10T20:45:05.071 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-10T20:45:05.071 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-10T20:45:05.071 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-10T20:45:05.071 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-10T20:45:05.071 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-10T20:45:05.071 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-10T20:45:05.071 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-10T20:45:05.071 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-10T20:45:05.071 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-10T20:45:05.071 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-10T20:45:05.071 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-10T20:45:05.071 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-10T20:45:05.072 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-10T20:45:05.072 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-10T20:45:05.072 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-10T20:45:05.072 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-10T20:45:05.072 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-10T20:45:05.072 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-10T20:45:05.072 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-10T20:45:05.072 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-10T20:45:05.072 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-10T20:45:05.072 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-10T20:45:05.072 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-10T20:45:05.072 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-10T20:45:05.072 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-10T20:45:05.072 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-10T20:45:05.073 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-10T20:45:05.073 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-10T20:45:05.073 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-10T20:45:05.073 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-10T20:45:05.073 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-10T20:45:05.073 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-10T20:45:05.073 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-10T20:45:05.073 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-10T20:45:05.073 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-10T20:45:05.073 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-10T20:45:05.073 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-10T20:45:05.073 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-10T20:45:05.074 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-10T20:45:05.074 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-10T20:45:05.074 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-10T20:45:05.074 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-10T20:45:05.074 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-10T20:45:05.074 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-10T20:45:05.074 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-10T20:45:05.074 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-10T20:45:05.074 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-10T20:45:05.074 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-10T20:45:05.074 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-10T20:45:05.074 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-10T20:45:05.075 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-10T20:45:05.075 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-10T20:45:05.075 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-10T20:45:05.075 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-10T20:45:05.075 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-10T20:45:05.075 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-10T20:45:05.075 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-10T20:45:05.075 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-10T20:45:05.075 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-10T20:45:05.075 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-10T20:45:05.075 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-10T20:45:05.075 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-10T20:45:05.075 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-10T20:45:05.075 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-10T20:45:05.076 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-10T20:45:05.076 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-10T20:45:05.076 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-10T20:45:05.076 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-10T20:45:05.076 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-10T20:45:05.076 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-10T20:45:05.076 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-10T20:45:05.076 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-10T20:45:05.076 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-10T20:45:05.076 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-10T20:45:05.076 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-10T20:45:05.076 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-10T20:45:05.077 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-10T20:45:05.077 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-10T20:45:05.077 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-10T20:45:05.077 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-10T20:45:05.077 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-10T20:45:05.077 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-10T20:45:05.077 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-10T20:45:05.077 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-10T20:45:05.077 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-10T20:45:05.077 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-10T20:45:05.077 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-10T20:45:05.077 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-10T20:45:05.077 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-10T20:45:05.077 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-10T20:45:05.078 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-10T20:45:05.078 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-10T20:45:05.078 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-10T20:45:05.078 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-10T20:45:05.078 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-10T20:45:05.078 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-10T20:45:05.078 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-10T20:45:05.078 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-10T20:45:05.078 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-10T20:45:05.078 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-10T20:45:05.078 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-10T20:45:05.078 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-10T20:45:05.078 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-10T20:45:05.078 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-10T20:45:05.079 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-10T20:45:05.079 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-10T20:45:05.079 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-10T20:45:05.079 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-10T20:45:05.079 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-10T20:45:05.079 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-10T20:45:05.079 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-10T20:45:05.079 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-10T20:45:05.079 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-10T20:45:05.079 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-10T20:45:05.079 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-10T20:45:05.079 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-10T20:45:05.079 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-10T20:45:05.079 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-10T20:45:05.080 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-10T20:45:05.080 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-10T20:45:05.080 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-10T20:45:05.080 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-10T20:45:05.080 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-10T20:45:05.080 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-10T20:45:05.080 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-10T20:45:05.080 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-10T20:45:05.080 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-10T20:45:05.080 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-10T20:45:05.080 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-10T20:45:05.080 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-10T20:45:05.080 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-10T20:45:05.081 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-10T20:45:05.081 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-10T20:45:05.081 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-10T20:45:05.081 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-10T20:45:05.081 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-10T20:45:05.081 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-10T20:45:05.081 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-10T20:45:05.081 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-10T20:45:05.081 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-10T20:45:05.081 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-10T20:45:05.081 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-10T20:45:05.081 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-10T20:45:05.082 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-10T20:45:05.082 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-10T20:45:05.082 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-10T20:45:05.082 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-10T20:45:05.082 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-10T20:45:05.082 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-10T20:45:05.082 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-10T20:45:05.082 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-10T20:45:05.082 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-10T20:45:05.082 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-10T20:45:05.082 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-10T20:45:05.082 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-10T20:45:05.082 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-10T20:45:05.082 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-10T20:45:05.083 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-10T20:45:05.083 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-10T20:45:05.083 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-10T20:45:05.083 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-10T20:45:05.083 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-10T20:45:05.083 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-10T20:45:05.083 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-10T20:45:05.083 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-10T20:45:05.083 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-10T20:45:05.083 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-10T20:45:05.083 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-10T20:45:05.083 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-10T20:45:05.083 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-10T20:45:05.083 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-10T20:45:05.084 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-10T20:45:05.084 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-10T20:45:05.084 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-10T20:45:05.084 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-10T20:45:05.084 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-10T20:45:05.084 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-10T20:45:05.084 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-10T20:45:05.084 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-10T20:45:05.084 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-10T20:45:05.084 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-10T20:45:05.084 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-10T20:45:05.084 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-10T20:45:05.084 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-10T20:45:05.085 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-10T20:45:05.085 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-10T20:45:05.085 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-10T20:45:05.085 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-10T20:45:05.085 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-10T20:45:05.085 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-10T20:45:05.085 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-10T20:45:05.085 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-10T20:45:05.085 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-10T20:45:05.085 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-10T20:45:05.085 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-10T20:45:05.085 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-10T20:45:05.085 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-10T20:45:05.086 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-10T20:45:05.086 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-10T20:45:05.086 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-10T20:45:05.086 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-10T20:45:05.086 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-10T20:45:05.086 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-10T20:45:05.086 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-10T20:45:05.086 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-10T20:45:05.086 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-10T20:45:05.086 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-10T20:45:05.086 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-10T20:45:05.086 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-10T20:45:05.086 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-10T20:45:05.086 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-10T20:45:05.087 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-10T20:45:05.087 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-10T20:45:05.087 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-10T20:45:05.087 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-10T20:45:05.087 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-10T20:45:05.087 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-10T20:45:05.087 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-10T20:45:05.087 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-10T20:45:05.087 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-10T20:45:05.087 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-10T20:45:05.087 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-10T20:45:05.087 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-10T20:45:05.087 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-10T20:45:05.088 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-10T20:45:05.088 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-10T20:45:05.088 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-10T20:45:05.088 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-10T20:45:05.088 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-10T20:45:05.088 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-10T20:45:05.088 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-10T20:45:05.088 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-10T20:45:05.088 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-10T20:45:05.088 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-10T20:45:05.088 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-10T20:45:05.088 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-10T20:45:05.088 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-10T20:45:05.089 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-10T20:45:05.089 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-10T20:45:05.089 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-10T20:45:05.089 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-10T20:45:05.089 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-10T20:45:05.089 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-10T20:45:05.089 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-10T20:45:05.089 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-10T20:45:05.089 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-10T20:45:05.089 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-10T20:45:05.089 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-10T20:45:05.089 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-10T20:45:05.089 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-10T20:45:05.089 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-10T20:45:05.090 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-10T20:45:05.090 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-10T20:45:05.090 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-10T20:45:05.090 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-10T20:45:05.090 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-10T20:45:05.090 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-10T20:45:05.090 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-10T20:45:05.090 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-10T20:45:05.090 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-10T20:45:05.090 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-10T20:45:05.090 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-10T20:45:05.090 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-10T20:45:05.090 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-10T20:45:05.091 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-10T20:45:05.091 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-10T20:45:05.091 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-10T20:45:05.091 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-10T20:45:05.091 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-10T20:45:05.091 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-10T20:45:05.091 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-10T20:45:05.091 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-10T20:45:05.091 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-10T20:45:05.091 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-10T20:45:05.091 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-10T20:45:05.091 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-10T20:45:05.091 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-10T20:45:05.092 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-10T20:45:05.092 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-10T20:45:05.092 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-10T20:45:05.092 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-10T20:45:05.092 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-10T20:45:05.092 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-10T20:45:05.092 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-10T20:45:05.092 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-10T20:45:05.092 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-10T20:45:05.093 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-10T20:45:05.093 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-10T20:45:05.093 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-10T20:45:05.093 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-10T20:45:05.093 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-10T20:45:05.093 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-10T20:45:05.093 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-10T20:45:05.093 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-10T20:45:05.093 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-10T20:45:05.093 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-10T20:45:05.093 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-10T20:45:05.093 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-10T20:45:05.093 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-10T20:45:05.094 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-10T20:45:05.094 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-10T20:45:05.094 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-10T20:45:05.094 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-10T20:45:05.094 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-10T20:45:05.094 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-10T20:45:05.094 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-10T20:45:05.094 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-10T20:45:05.094 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-10T20:45:05.094 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-10T20:45:05.094 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-10T20:45:05.094 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-10T20:45:05.094 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-10T20:45:05.095 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-10T20:45:05.095 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-10T20:45:05.095 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-10T20:45:05.095 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-10T20:45:05.095 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-10T20:45:05.095 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-10T20:45:05.095 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-10T20:45:05.095 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-10T20:45:05.095 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-10T20:45:05.095 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-10T20:45:05.095 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-10T20:45:05.095 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-10T20:45:05.095 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-10T20:45:05.095 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-10T20:45:05.095 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-10T20:45:05.096 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-10T20:45:05.096 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-10T20:45:05.096 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-10T20:45:05.096 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-10T20:45:05.096 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-10T20:45:05.096 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-10T20:45:05.096 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-10T20:45:05.096 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-10T20:45:05.096 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-10T20:45:05.096 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-10T20:45:05.096 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-10T20:45:05.096 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-10T20:45:05.096 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-10T20:45:05.097 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-10T20:45:05.097 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-10T20:45:05.097 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-10T20:45:05.097 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-10T20:45:05.097 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-10T20:45:05.097 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-10T20:45:05.097 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-10T20:45:05.097 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-10T20:45:05.097 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-10T20:45:05.097 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-10T20:45:05.097 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-10T20:45:05.097 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-10T20:45:05.097 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-10T20:45:05.098 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-10T20:45:05.098 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-10T20:45:05.098 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-10T20:45:05.098 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-10T20:45:05.098 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-10T20:45:05.098 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-10T20:45:05.098 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-10T20:45:05.098 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-10T20:45:05.098 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-10T20:45:05.098 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-10T20:45:05.098 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-10T20:45:05.098 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-10T20:45:05.098 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-10T20:45:05.098 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-10T20:45:05.099 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-10T20:45:05.099 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-10T20:45:05.099 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-10T20:45:05.099 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-10T20:45:05.099 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-10T20:45:05.099 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-10T20:45:05.099 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-10T20:45:05.099 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-10T20:45:05.099 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-10T20:45:05.099 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-10T20:45:05.099 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-10T20:45:05.099 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-10T20:45:05.099 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-10T20:45:05.100 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-10T20:45:05.100 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-10T20:45:05.100 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-10T20:45:05.100 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-10T20:45:05.100 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-10T20:45:05.100 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-10T20:45:05.100 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-10T20:45:05.100 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-10T20:45:05.100 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-10T20:45:05.100 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-10T20:45:05.100 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-10T20:45:05.100 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-10T20:45:05.100 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-10T20:45:05.101 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-10T20:45:05.101 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-10T20:45:05.101 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-10T20:45:05.101 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-10T20:45:05.101 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-10T20:45:05.101 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-10T20:45:05.101 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-10T20:45:05.101 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-10T20:45:05.101 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-10T20:45:05.101 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-10T20:45:05.101 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-10T20:45:05.101 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-10T20:45:05.101 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-10T20:45:05.101 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-10T20:45:05.102 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-10T20:45:05.102 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-10T20:45:05.102 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-10T20:45:05.102 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-10T20:45:05.102 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-10T20:45:05.102 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-10T20:45:05.102 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-10T20:45:05.102 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-10T20:45:05.102 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-10T20:45:05.102 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-10T20:45:05.102 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-10T20:45:05.102 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-10T20:45:05.102 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-10T20:45:05.103 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-10T20:45:05.103 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-10T20:45:05.103 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-10T20:45:05.103 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-10T20:45:05.103 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-10T20:45:05.103 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-10T20:45:05.103 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-10T20:45:05.103 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-10T20:45:05.103 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-10T20:45:05.103 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-10T20:45:05.103 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-10T20:45:05.103 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-10T20:45:05.103 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-10T20:45:05.103 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-10T20:45:05.104 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-10T20:45:05.104 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-10T20:45:05.104 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-10T20:45:05.104 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-10T20:45:05.104 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-10T20:45:05.104 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-10T20:45:05.104 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-10T20:45:05.104 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-10T20:45:05.104 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-10T20:45:05.104 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-10T20:45:05.104 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-10T20:45:05.104 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-10T20:45:05.104 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-10T20:45:05.105 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-10T20:45:05.105 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-10T20:45:05.105 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-10T20:45:05.105 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-10T20:45:05.105 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-10T20:45:05.105 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-10T20:45:05.105 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-10T20:45:05.105 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-10T20:45:05.105 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-10T20:45:05.105 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-10T20:45:05.105 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-10T20:45:05.105 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-10T20:45:05.105 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-10T20:45:05.105 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-10T20:45:05.106 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-10T20:45:05.106 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-10T20:45:05.106 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-10T20:45:05.106 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-10T20:45:05.106 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-10T20:45:05.106 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-10T20:45:05.106 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-10T20:45:05.106 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-10T20:45:05.106 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-10T20:45:05.106 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-10T20:45:05.106 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-10T20:45:05.106 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-10T20:45:05.106 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-10T20:45:05.106 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-10T20:45:05.107 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-10T20:45:05.107 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-10T20:45:05.107 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-10T20:45:05.107 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-10T20:45:05.107 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-10T20:45:05.107 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-10T20:45:05.107 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-10T20:45:05.107 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-10T20:45:05.107 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-10T20:45:05.107 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-10T20:45:05.107 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-10T20:45:05.107 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-10T20:45:05.107 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-10T20:45:05.108 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-10T20:45:05.108 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-10T20:45:05.108 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-10T20:45:05.108 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-10T20:45:05.108 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-10T20:45:05.108 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-10T20:45:05.108 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-10T20:45:05.108 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-10T20:45:05.108 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-10T20:45:05.108 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-10T20:45:05.108 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-10T20:45:05.108 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-10T20:45:05.108 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-10T20:45:05.108 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-10T20:45:05.109 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-10T20:45:05.109 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-10T20:45:05.109 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-10T20:45:05.109 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-10T20:45:05.109 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-10T20:45:05.109 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-10T20:45:05.109 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-10T20:45:05.109 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-10T20:45:05.109 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-10T20:45:05.109 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-10T20:45:05.109 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-10T20:45:05.109 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-10T20:45:05.109 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-10T20:45:05.110 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-10T20:45:05.110 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-10T20:45:05.110 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-10T20:45:05.110 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-10T20:45:05.110 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-10T20:45:05.110 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-10T20:45:05.110 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-10T20:45:05.110 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-10T20:45:05.110 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-10T20:45:05.110 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-10T20:45:05.110 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-10T20:45:05.110 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-10T20:45:05.110 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-10T20:45:05.110 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-10T20:45:05.111 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-10T20:45:05.111 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-10T20:45:05.111 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-10T20:45:05.111 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-10T20:45:05.111 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-10T20:45:05.111 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-10T20:45:05.111 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-10T20:45:05.111 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-10T20:45:05.111 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-10T20:45:05.111 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-10T20:45:05.111 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-10T20:45:05.111 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-10T20:45:05.111 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-10T20:45:05.111 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-10T20:45:05.112 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-10T20:45:05.112 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-10T20:45:05.112 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-10T20:45:05.112 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-10T20:45:05.112 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-10T20:45:05.112 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-10T20:45:05.112 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-10T20:45:05.112 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-10T20:45:05.112 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-10T20:45:05.112 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-10T20:45:05.112 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-10T20:45:05.112 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T20:45:05.116 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:45:05.117 DEBUG:teuthology.orchestra.run.smithi150:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-10T20:45:05.140 INFO:teuthology.orchestra.run.smithi150.stdout:postinstall scriptlet (using /bin/sh): 2024-09-10T20:45:05.140 INFO:teuthology.orchestra.run.smithi150.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T20:45:05.140 INFO:teuthology.orchestra.run.smithi150.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T20:45:05.141 INFO:teuthology.orchestra.run.smithi150.stdout:fi 2024-09-10T20:45:05.141 INFO:teuthology.orchestra.run.smithi150.stdout:for file in vmlinuz System.map config; do 2024-09-10T20:45:05.141 INFO:teuthology.orchestra.run.smithi150.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-10T20:45:05.141 INFO:teuthology.orchestra.run.smithi150.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T20:45:05.141 INFO:teuthology.orchestra.run.smithi150.stdout: fi 2024-09-10T20:45:05.141 INFO:teuthology.orchestra.run.smithi150.stdout:done 2024-09-10T20:45:05.141 INFO:teuthology.orchestra.run.smithi150.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-10T20:45:05.141 INFO:teuthology.orchestra.run.smithi150.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-10T20:45:05.141 INFO:teuthology.orchestra.run.smithi150.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T20:45:05.141 INFO:teuthology.orchestra.run.smithi150.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T20:45:05.141 INFO:teuthology.orchestra.run.smithi150.stdout:fi 2024-09-10T20:45:05.141 INFO:teuthology.orchestra.run.smithi150.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-10T20:45:05.141 INFO:teuthology.orchestra.run.smithi150.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:45:05.142 INFO:teuthology.orchestra.run.smithi150.stdout:fi 2024-09-10T20:45:05.142 INFO:teuthology.orchestra.run.smithi150.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-10T20:45:05.142 INFO:teuthology.orchestra.run.smithi150.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T20:45:05.142 INFO:teuthology.orchestra.run.smithi150.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:45:05.142 INFO:teuthology.orchestra.run.smithi150.stdout:fi 2024-09-10T20:45:05.143 DEBUG:teuthology.orchestra.run.smithi150:> sudo rpm -qi grub2-tools 2024-09-10T20:45:05.224 INFO:teuthology.orchestra.run.smithi150.stdout:Name : grub2-tools 2024-09-10T20:45:05.224 INFO:teuthology.orchestra.run.smithi150.stdout:Epoch : 1 2024-09-10T20:45:05.224 INFO:teuthology.orchestra.run.smithi150.stdout:Version : 2.06 2024-09-10T20:45:05.224 INFO:teuthology.orchestra.run.smithi150.stdout:Release : 82.el9 2024-09-10T20:45:05.224 INFO:teuthology.orchestra.run.smithi150.stdout:Architecture: x86_64 2024-09-10T20:45:05.224 INFO:teuthology.orchestra.run.smithi150.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T20:45:05.225 INFO:teuthology.orchestra.run.smithi150.stdout:Group : Unspecified 2024-09-10T20:45:05.225 INFO:teuthology.orchestra.run.smithi150.stdout:Size : 8274670 2024-09-10T20:45:05.225 INFO:teuthology.orchestra.run.smithi150.stdout:License : GPLv3+ 2024-09-10T20:45:05.225 INFO:teuthology.orchestra.run.smithi150.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T20:45:05.225 INFO:teuthology.orchestra.run.smithi150.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T20:45:05.225 INFO:teuthology.orchestra.run.smithi150.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T20:45:05.225 INFO:teuthology.orchestra.run.smithi150.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T20:45:05.225 INFO:teuthology.orchestra.run.smithi150.stdout:Packager : builder@centos.org 2024-09-10T20:45:05.225 INFO:teuthology.orchestra.run.smithi150.stdout:Vendor : CentOS 2024-09-10T20:45:05.225 INFO:teuthology.orchestra.run.smithi150.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T20:45:05.225 INFO:teuthology.orchestra.run.smithi150.stdout:Summary : Support tools for GRUB. 2024-09-10T20:45:05.225 INFO:teuthology.orchestra.run.smithi150.stdout:Description : 2024-09-10T20:45:05.225 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:45:05.226 INFO:teuthology.orchestra.run.smithi150.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T20:45:05.226 INFO:teuthology.orchestra.run.smithi150.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T20:45:05.226 INFO:teuthology.orchestra.run.smithi150.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T20:45:05.226 INFO:teuthology.orchestra.run.smithi150.stdout:hardware devices. 2024-09-10T20:45:05.226 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:45:05.226 INFO:teuthology.orchestra.run.smithi150.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T20:45:05.227 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T20:45:05.227 INFO:teuthology.task.kernel:Updating grub on smithi150 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:45:05.227 DEBUG:teuthology.orchestra.run.smithi150:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T20:45:05.859 INFO:teuthology.orchestra.run.smithi150.stderr:Generating grub configuration file ... 2024-09-10T20:45:07.267 INFO:teuthology.orchestra.run.smithi150.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T20:45:07.299 INFO:teuthology.orchestra.run.smithi150.stderr:done 2024-09-10T20:45:07.301 DEBUG:teuthology.orchestra.run.smithi150:> mktemp 2024-09-10T20:45:07.317 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.LdwmnKgvdX 2024-09-10T20:45:07.317 DEBUG:teuthology.orchestra.run.smithi150:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.LdwmnKgvdX 2024-09-10T20:45:07.384 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.LdwmnKgvdX 2024-09-10T20:45:07.529 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.LdwmnKgvdX is 6KB 2024-09-10T20:45:07.550 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.LdwmnKgvdX 2024-09-10T20:45:07.565 DEBUG:teuthology.orchestra.run.smithi150:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T20:45:07.629 INFO:teuthology.orchestra.run.smithi150.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T20:45:07.629 INFO:teuthology.orchestra.run.smithi150.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T20:45:07.630 INFO:teuthology.orchestra.run.smithi150.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T20:45:07.630 INFO:teuthology.orchestra.run.smithi150.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-10T20:45:07.631 DEBUG:teuthology.orchestra.run.smithi150:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:45:07.788 DEBUG:teuthology.orchestra.run.smithi150:> sudo shutdown -r now 2024-09-10T20:45:20.145 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi006.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-10T20:45:20.146 DEBUG:teuthology.orchestra.run.smithi006:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-10T20:45:20.227 INFO:teuthology.orchestra.run.smithi006.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:45:20.228 INFO:teuthology.orchestra.run.smithi006.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:45:20.228 INFO:teuthology.orchestra.run.smithi006.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:45:20.228 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:45:20.228 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-10T20:45:20.228 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-10T20:45:20.228 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-10T20:45:20.228 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-10T20:45:20.228 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-10T20:45:20.228 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-10T20:45:20.228 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-10T20:45:20.228 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-10T20:45:20.229 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-10T20:45:20.229 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-10T20:45:20.229 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-10T20:45:20.229 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-10T20:45:20.229 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-10T20:45:20.229 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-10T20:45:20.229 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-10T20:45:20.229 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-10T20:45:20.229 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-10T20:45:20.229 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-10T20:45:20.229 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-10T20:45:20.229 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-10T20:45:20.229 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-10T20:45:20.229 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-10T20:45:20.230 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-10T20:45:20.230 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-10T20:45:20.230 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-10T20:45:20.230 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-10T20:45:20.230 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-10T20:45:20.230 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-10T20:45:20.230 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-10T20:45:20.230 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-10T20:45:20.230 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-10T20:45:20.230 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-10T20:45:20.230 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-10T20:45:20.230 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-10T20:45:20.230 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-10T20:45:20.231 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-10T20:45:20.231 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-10T20:45:20.231 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-10T20:45:20.231 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-10T20:45:20.231 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-10T20:45:20.231 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-10T20:45:20.231 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-10T20:45:20.231 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-10T20:45:20.231 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-10T20:45:20.231 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-10T20:45:20.231 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-10T20:45:20.231 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-10T20:45:20.231 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-10T20:45:20.231 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-10T20:45:20.232 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-10T20:45:20.232 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-10T20:45:20.232 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-10T20:45:20.232 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-10T20:45:20.232 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-10T20:45:20.232 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-10T20:45:20.232 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-10T20:45:20.232 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-10T20:45:20.232 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-10T20:45:20.232 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-10T20:45:20.232 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-10T20:45:20.232 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-10T20:45:20.233 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-10T20:45:20.233 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-10T20:45:20.233 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-10T20:45:20.233 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-10T20:45:20.233 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-10T20:45:20.233 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-10T20:45:20.233 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-10T20:45:20.233 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-10T20:45:20.233 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-10T20:45:20.233 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-10T20:45:20.233 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-10T20:45:20.233 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-10T20:45:20.233 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-10T20:45:20.234 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-10T20:45:20.234 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-10T20:45:20.234 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-10T20:45:20.234 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-10T20:45:20.234 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-10T20:45:20.234 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-10T20:45:20.234 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-10T20:45:20.234 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-10T20:45:20.234 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-10T20:45:20.234 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-10T20:45:20.234 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-10T20:45:20.234 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-10T20:45:20.234 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-10T20:45:20.234 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-10T20:45:20.235 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-10T20:45:20.235 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-10T20:45:20.235 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-10T20:45:20.235 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-10T20:45:20.235 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-10T20:45:20.235 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-10T20:45:20.235 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-10T20:45:20.235 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-10T20:45:20.235 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-10T20:45:20.235 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-10T20:45:20.235 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-10T20:45:20.235 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-10T20:45:20.235 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-10T20:45:20.235 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-10T20:45:20.236 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-10T20:45:20.236 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-10T20:45:20.236 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-10T20:45:20.236 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-10T20:45:20.236 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-10T20:45:20.236 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-10T20:45:20.236 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-10T20:45:20.236 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-10T20:45:20.236 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-10T20:45:20.236 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-10T20:45:20.236 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-10T20:45:20.236 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-10T20:45:20.236 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-10T20:45:20.236 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-10T20:45:20.237 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-10T20:45:20.237 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-10T20:45:20.237 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-10T20:45:20.237 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-10T20:45:20.237 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-10T20:45:20.237 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-10T20:45:20.237 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-10T20:45:20.237 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-10T20:45:20.237 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-10T20:45:20.237 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-10T20:45:20.237 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-10T20:45:20.237 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-10T20:45:20.237 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-10T20:45:20.238 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-10T20:45:20.238 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-10T20:45:20.238 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-10T20:45:20.238 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-10T20:45:20.238 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-10T20:45:20.238 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-10T20:45:20.238 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-10T20:45:20.238 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-10T20:45:20.238 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-10T20:45:20.238 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-10T20:45:20.238 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-10T20:45:20.238 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-10T20:45:20.238 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-10T20:45:20.238 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-10T20:45:20.239 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-10T20:45:20.239 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-10T20:45:20.239 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-10T20:45:20.239 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-10T20:45:20.239 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-10T20:45:20.239 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-10T20:45:20.239 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-10T20:45:20.239 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-10T20:45:20.239 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-10T20:45:20.239 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-10T20:45:20.239 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-10T20:45:20.239 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-10T20:45:20.239 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-10T20:45:20.240 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-10T20:45:20.240 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-10T20:45:20.240 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-10T20:45:20.240 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-10T20:45:20.240 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-10T20:45:20.240 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-10T20:45:20.240 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-10T20:45:20.240 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-10T20:45:20.240 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-10T20:45:20.240 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-10T20:45:20.240 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-10T20:45:20.240 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-10T20:45:20.240 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-10T20:45:20.241 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-10T20:45:20.241 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-10T20:45:20.241 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-10T20:45:20.241 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-10T20:45:20.241 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-10T20:45:20.241 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-10T20:45:20.241 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-10T20:45:20.241 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-10T20:45:20.241 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-10T20:45:20.241 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-10T20:45:20.241 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-10T20:45:20.241 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-10T20:45:20.241 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-10T20:45:20.241 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-10T20:45:20.242 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-10T20:45:20.242 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-10T20:45:20.242 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-10T20:45:20.242 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-10T20:45:20.242 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-10T20:45:20.242 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-10T20:45:20.242 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-10T20:45:20.242 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-10T20:45:20.242 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-10T20:45:20.242 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-10T20:45:20.242 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-10T20:45:20.242 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-10T20:45:20.242 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-10T20:45:20.242 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-10T20:45:20.243 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-10T20:45:20.243 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-10T20:45:20.243 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-10T20:45:20.243 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-10T20:45:20.243 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-10T20:45:20.243 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-10T20:45:20.243 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-10T20:45:20.243 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-10T20:45:20.243 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-10T20:45:20.243 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-10T20:45:20.243 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-10T20:45:20.243 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-10T20:45:20.243 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-10T20:45:20.243 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-10T20:45:20.244 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-10T20:45:20.244 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-10T20:45:20.244 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-10T20:45:20.244 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-10T20:45:20.244 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-10T20:45:20.244 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-10T20:45:20.244 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-10T20:45:20.244 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-10T20:45:20.244 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-10T20:45:20.244 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-10T20:45:20.244 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-10T20:45:20.244 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-10T20:45:20.244 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-10T20:45:20.244 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-10T20:45:20.245 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-10T20:45:20.245 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-10T20:45:20.245 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-10T20:45:20.245 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-10T20:45:20.245 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-10T20:45:20.245 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-10T20:45:20.245 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-10T20:45:20.245 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-10T20:45:20.245 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-10T20:45:20.245 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-10T20:45:20.245 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-10T20:45:20.245 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-10T20:45:20.245 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-10T20:45:20.245 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-10T20:45:20.246 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-10T20:45:20.246 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-10T20:45:20.246 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-10T20:45:20.246 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-10T20:45:20.246 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-10T20:45:20.246 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-10T20:45:20.246 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-10T20:45:20.246 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-10T20:45:20.246 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-10T20:45:20.246 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-10T20:45:20.246 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-10T20:45:20.246 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-10T20:45:20.246 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-10T20:45:20.246 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-10T20:45:20.247 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-10T20:45:20.247 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-10T20:45:20.247 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-10T20:45:20.247 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-10T20:45:20.247 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-10T20:45:20.247 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-10T20:45:20.247 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-10T20:45:20.247 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-10T20:45:20.247 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-10T20:45:20.247 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-10T20:45:20.247 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-10T20:45:20.247 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-10T20:45:20.247 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-10T20:45:20.247 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-10T20:45:20.248 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-10T20:45:20.248 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-10T20:45:20.248 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-10T20:45:20.248 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-10T20:45:20.248 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-10T20:45:20.248 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-10T20:45:20.248 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-10T20:45:20.248 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-10T20:45:20.248 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-10T20:45:20.248 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-10T20:45:20.248 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-10T20:45:20.248 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-10T20:45:20.248 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-10T20:45:20.248 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-10T20:45:20.249 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-10T20:45:20.249 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-10T20:45:20.249 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-10T20:45:20.249 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-10T20:45:20.249 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-10T20:45:20.249 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-10T20:45:20.249 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-10T20:45:20.249 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-10T20:45:20.249 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-10T20:45:20.249 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-10T20:45:20.249 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-10T20:45:20.249 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-10T20:45:20.249 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-10T20:45:20.249 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-10T20:45:20.250 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-10T20:45:20.250 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-10T20:45:20.250 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-10T20:45:20.250 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-10T20:45:20.250 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-10T20:45:20.250 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-10T20:45:20.250 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-10T20:45:20.250 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-10T20:45:20.250 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-10T20:45:20.250 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-10T20:45:20.250 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-10T20:45:20.250 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-10T20:45:20.250 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-10T20:45:20.250 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-10T20:45:20.251 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-10T20:45:20.251 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-10T20:45:20.251 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-10T20:45:20.251 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-10T20:45:20.251 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-10T20:45:20.251 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-10T20:45:20.251 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-10T20:45:20.251 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-10T20:45:20.251 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-10T20:45:20.251 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-10T20:45:20.251 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-10T20:45:20.251 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-10T20:45:20.251 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-10T20:45:20.251 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-10T20:45:20.251 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-10T20:45:20.252 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-10T20:45:20.252 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-10T20:45:20.252 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-10T20:45:20.252 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-10T20:45:20.252 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-10T20:45:20.252 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-10T20:45:20.252 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-10T20:45:20.252 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-10T20:45:20.252 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-10T20:45:20.252 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-10T20:45:20.252 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-10T20:45:20.252 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-10T20:45:20.252 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-10T20:45:20.252 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-10T20:45:20.253 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-10T20:45:20.253 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-10T20:45:20.253 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-10T20:45:20.253 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-10T20:45:20.253 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-10T20:45:20.253 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-10T20:45:20.253 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-10T20:45:20.253 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-10T20:45:20.253 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-10T20:45:20.253 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-10T20:45:20.253 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-10T20:45:20.253 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-10T20:45:20.253 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-10T20:45:20.254 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-10T20:45:20.254 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-10T20:45:20.254 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-10T20:45:20.254 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-10T20:45:20.254 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-10T20:45:20.254 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-10T20:45:20.254 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-10T20:45:20.254 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-10T20:45:20.254 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-10T20:45:20.254 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-10T20:45:20.254 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-10T20:45:20.254 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-10T20:45:20.254 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-10T20:45:20.254 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-10T20:45:20.254 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-10T20:45:20.255 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-10T20:45:20.255 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-10T20:45:20.255 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-10T20:45:20.255 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-10T20:45:20.255 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-10T20:45:20.255 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-10T20:45:20.255 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-10T20:45:20.255 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-10T20:45:20.255 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-10T20:45:20.255 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-10T20:45:20.255 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-10T20:45:20.255 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-10T20:45:20.255 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-10T20:45:20.256 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-10T20:45:20.256 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-10T20:45:20.256 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-10T20:45:20.256 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-10T20:45:20.256 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-10T20:45:20.256 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-10T20:45:20.256 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-10T20:45:20.256 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-10T20:45:20.256 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-10T20:45:20.256 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-10T20:45:20.256 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-10T20:45:20.256 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-10T20:45:20.256 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-10T20:45:20.257 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-10T20:45:20.257 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-10T20:45:20.257 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-10T20:45:20.257 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-10T20:45:20.257 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-10T20:45:20.257 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-10T20:45:20.257 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-10T20:45:20.257 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-10T20:45:20.257 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-10T20:45:20.257 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-10T20:45:20.257 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-10T20:45:20.257 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-10T20:45:20.257 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-10T20:45:20.257 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-10T20:45:20.258 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-10T20:45:20.258 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-10T20:45:20.258 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-10T20:45:20.258 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-10T20:45:20.258 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-10T20:45:20.258 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-10T20:45:20.258 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-10T20:45:20.258 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-10T20:45:20.258 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-10T20:45:20.258 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-10T20:45:20.258 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-10T20:45:20.258 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-10T20:45:20.258 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-10T20:45:20.259 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-10T20:45:20.259 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-10T20:45:20.259 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-10T20:45:20.259 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-10T20:45:20.259 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-10T20:45:20.259 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-10T20:45:20.259 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-10T20:45:20.259 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-10T20:45:20.259 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-10T20:45:20.259 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-10T20:45:20.259 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-10T20:45:20.259 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-10T20:45:20.259 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-10T20:45:20.260 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-10T20:45:20.260 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-10T20:45:20.260 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-10T20:45:20.260 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-10T20:45:20.260 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-10T20:45:20.260 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-10T20:45:20.260 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-10T20:45:20.260 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-10T20:45:20.260 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-10T20:45:20.260 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-10T20:45:20.260 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-10T20:45:20.260 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-10T20:45:20.260 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-10T20:45:20.260 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-10T20:45:20.260 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-10T20:45:20.261 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-10T20:45:20.261 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-10T20:45:20.261 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-10T20:45:20.261 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-10T20:45:20.261 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-10T20:45:20.261 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-10T20:45:20.261 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-10T20:45:20.261 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-10T20:45:20.261 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-10T20:45:20.261 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-10T20:45:20.261 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-10T20:45:20.261 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-10T20:45:20.261 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-10T20:45:20.261 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-10T20:45:20.262 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-10T20:45:20.262 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-10T20:45:20.262 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-10T20:45:20.262 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-10T20:45:20.262 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-10T20:45:20.262 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-10T20:45:20.262 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-10T20:45:20.262 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-10T20:45:20.262 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-10T20:45:20.262 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-10T20:45:20.262 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-10T20:45:20.262 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-10T20:45:20.262 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-10T20:45:20.262 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-10T20:45:20.263 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-10T20:45:20.263 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-10T20:45:20.263 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-10T20:45:20.263 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-10T20:45:20.263 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-10T20:45:20.263 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-10T20:45:20.263 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-10T20:45:20.263 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-10T20:45:20.263 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-10T20:45:20.263 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-10T20:45:20.263 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-10T20:45:20.263 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-10T20:45:20.264 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-10T20:45:20.264 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-10T20:45:20.264 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-10T20:45:20.264 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-10T20:45:20.264 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-10T20:45:20.264 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-10T20:45:20.264 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-10T20:45:20.264 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-10T20:45:20.264 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-10T20:45:20.264 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-10T20:45:20.264 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-10T20:45:20.264 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-10T20:45:20.264 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-10T20:45:20.264 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-10T20:45:20.265 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-10T20:45:20.265 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-10T20:45:20.265 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-10T20:45:20.265 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-10T20:45:20.265 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-10T20:45:20.265 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-10T20:45:20.265 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-10T20:45:20.265 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-10T20:45:20.265 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-10T20:45:20.265 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-10T20:45:20.265 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-10T20:45:20.265 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-10T20:45:20.265 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-10T20:45:20.266 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-10T20:45:20.266 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-10T20:45:20.266 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-10T20:45:20.266 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-10T20:45:20.266 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-10T20:45:20.266 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-10T20:45:20.266 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-10T20:45:20.266 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-10T20:45:20.266 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-10T20:45:20.266 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-10T20:45:20.266 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-10T20:45:20.266 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-10T20:45:20.266 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-10T20:45:20.266 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-10T20:45:20.267 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-10T20:45:20.267 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-10T20:45:20.267 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-10T20:45:20.267 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-10T20:45:20.267 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-10T20:45:20.267 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-10T20:45:20.267 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-10T20:45:20.267 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-10T20:45:20.267 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-10T20:45:20.267 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-10T20:45:20.267 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-10T20:45:20.267 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-10T20:45:20.267 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-10T20:45:20.268 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-10T20:45:20.268 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-10T20:45:20.268 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-10T20:45:20.268 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-10T20:45:20.268 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-10T20:45:20.268 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-10T20:45:20.268 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-10T20:45:20.268 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-10T20:45:20.268 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-10T20:45:20.268 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-10T20:45:20.268 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-10T20:45:20.268 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-10T20:45:20.268 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-10T20:45:20.268 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-10T20:45:20.269 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-10T20:45:20.269 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-10T20:45:20.269 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-10T20:45:20.269 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-10T20:45:20.269 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-10T20:45:20.269 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-10T20:45:20.269 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-10T20:45:20.269 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-10T20:45:20.269 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-10T20:45:20.269 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-10T20:45:20.269 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-10T20:45:20.269 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-10T20:45:20.269 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-10T20:45:20.269 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-10T20:45:20.270 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-10T20:45:20.270 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-10T20:45:20.270 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-10T20:45:20.270 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-10T20:45:20.270 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-10T20:45:20.270 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-10T20:45:20.270 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-10T20:45:20.270 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-10T20:45:20.270 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-10T20:45:20.270 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-10T20:45:20.270 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-10T20:45:20.270 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-10T20:45:20.270 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-10T20:45:20.271 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-10T20:45:20.271 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-10T20:45:20.271 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-10T20:45:20.271 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-10T20:45:20.271 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-10T20:45:20.271 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-10T20:45:20.271 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-10T20:45:20.271 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-10T20:45:20.271 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-10T20:45:20.271 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-10T20:45:20.271 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-10T20:45:20.271 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-10T20:45:20.271 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-10T20:45:20.271 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-10T20:45:20.272 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-10T20:45:20.272 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-10T20:45:20.272 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-10T20:45:20.272 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-10T20:45:20.272 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-10T20:45:20.272 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-10T20:45:20.272 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-10T20:45:20.272 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-10T20:45:20.272 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-10T20:45:20.272 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-10T20:45:20.272 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-10T20:45:20.272 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-10T20:45:20.272 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-10T20:45:20.272 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-10T20:45:20.273 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-10T20:45:20.273 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-10T20:45:20.273 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-10T20:45:20.273 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-10T20:45:20.273 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-10T20:45:20.273 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-10T20:45:20.273 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-10T20:45:20.273 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-10T20:45:20.273 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-10T20:45:20.273 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-10T20:45:20.273 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-10T20:45:20.273 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-10T20:45:20.273 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-10T20:45:20.273 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-10T20:45:20.274 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-10T20:45:20.274 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-10T20:45:20.274 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-10T20:45:20.274 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-10T20:45:20.274 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-10T20:45:20.274 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-10T20:45:20.274 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-10T20:45:20.274 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-10T20:45:20.274 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-10T20:45:20.274 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-10T20:45:20.274 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-10T20:45:20.274 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-10T20:45:20.274 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-10T20:45:20.274 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-10T20:45:20.275 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-10T20:45:20.275 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-10T20:45:20.275 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-10T20:45:20.275 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-10T20:45:20.275 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-10T20:45:20.275 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-10T20:45:20.275 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-10T20:45:20.275 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-10T20:45:20.275 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-10T20:45:20.275 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-10T20:45:20.275 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-10T20:45:20.275 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-10T20:45:20.275 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-10T20:45:20.275 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-10T20:45:20.276 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-10T20:45:20.276 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-10T20:45:20.276 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-10T20:45:20.276 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-10T20:45:20.276 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-10T20:45:20.276 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-10T20:45:20.276 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-10T20:45:20.276 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-10T20:45:20.276 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-10T20:45:20.276 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-10T20:45:20.276 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-10T20:45:20.276 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-10T20:45:20.276 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-10T20:45:20.277 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-10T20:45:20.277 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-10T20:45:20.277 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-10T20:45:20.277 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-10T20:45:20.277 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-10T20:45:20.277 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-10T20:45:20.277 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-10T20:45:20.277 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-10T20:45:20.277 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-10T20:45:20.277 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-10T20:45:20.277 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-10T20:45:20.277 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-10T20:45:20.277 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-10T20:45:20.277 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-10T20:45:20.278 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-10T20:45:20.278 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-10T20:45:20.278 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-10T20:45:20.278 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-10T20:45:20.278 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-10T20:45:20.278 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-10T20:45:20.278 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-10T20:45:20.278 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-10T20:45:20.278 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-10T20:45:20.278 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-10T20:45:20.278 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-10T20:45:20.278 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-10T20:45:20.278 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-10T20:45:20.278 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-10T20:45:20.279 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-10T20:45:20.279 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-10T20:45:20.279 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-10T20:45:20.279 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-10T20:45:20.279 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-10T20:45:20.279 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-10T20:45:20.279 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-10T20:45:20.279 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-10T20:45:20.279 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-10T20:45:20.279 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-10T20:45:20.279 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-10T20:45:20.279 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-10T20:45:20.279 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-10T20:45:20.280 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-10T20:45:20.280 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-10T20:45:20.280 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-10T20:45:20.280 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-10T20:45:20.280 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-10T20:45:20.280 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-10T20:45:20.280 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-10T20:45:20.280 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-10T20:45:20.280 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-10T20:45:20.280 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-10T20:45:20.280 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-10T20:45:20.280 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-10T20:45:20.280 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-10T20:45:20.281 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-10T20:45:20.281 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-10T20:45:20.281 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-10T20:45:20.281 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-10T20:45:20.281 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-10T20:45:20.281 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-10T20:45:20.281 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-10T20:45:20.281 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-10T20:45:20.281 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-10T20:45:20.281 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-10T20:45:20.281 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-10T20:45:20.281 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-10T20:45:20.281 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-10T20:45:20.282 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-10T20:45:20.282 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-10T20:45:20.282 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-10T20:45:20.282 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-10T20:45:20.282 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-10T20:45:20.282 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-10T20:45:20.282 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-10T20:45:20.282 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-10T20:45:20.282 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-10T20:45:20.282 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-10T20:45:20.282 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-10T20:45:20.282 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-10T20:45:20.282 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-10T20:45:20.282 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-10T20:45:20.283 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-10T20:45:20.283 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-10T20:45:20.283 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-10T20:45:20.283 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-10T20:45:20.283 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-10T20:45:20.283 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-10T20:45:20.283 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-10T20:45:20.283 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-10T20:45:20.283 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-10T20:45:20.283 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-10T20:45:20.283 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-10T20:45:20.283 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-10T20:45:20.283 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-10T20:45:20.283 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-10T20:45:20.284 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-10T20:45:20.284 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-10T20:45:20.284 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-10T20:45:20.284 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-10T20:45:20.284 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-10T20:45:20.284 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-10T20:45:20.284 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-10T20:45:20.284 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-10T20:45:20.284 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-10T20:45:20.284 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-10T20:45:20.284 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-10T20:45:20.284 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-10T20:45:20.284 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-10T20:45:20.284 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-10T20:45:20.285 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-10T20:45:20.285 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-10T20:45:20.285 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-10T20:45:20.285 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-10T20:45:20.285 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-10T20:45:20.285 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-10T20:45:20.285 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-10T20:45:20.285 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-10T20:45:20.285 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-10T20:45:20.285 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-10T20:45:20.285 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-10T20:45:20.285 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-10T20:45:20.285 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-10T20:45:20.285 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-10T20:45:20.286 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-10T20:45:20.286 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-10T20:45:20.286 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-10T20:45:20.286 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-10T20:45:20.286 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-10T20:45:20.286 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-10T20:45:20.286 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-10T20:45:20.286 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-10T20:45:20.286 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-10T20:45:20.286 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-10T20:45:20.286 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-10T20:45:20.286 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-10T20:45:20.286 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-10T20:45:20.286 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-10T20:45:20.287 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-10T20:45:20.287 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-10T20:45:20.287 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-10T20:45:20.287 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-10T20:45:20.287 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-10T20:45:20.287 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-10T20:45:20.287 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-10T20:45:20.287 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-10T20:45:20.287 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-10T20:45:20.287 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-10T20:45:20.287 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-10T20:45:20.287 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-10T20:45:20.287 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-10T20:45:20.287 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-10T20:45:20.288 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-10T20:45:20.288 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-10T20:45:20.288 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-10T20:45:20.288 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-10T20:45:20.288 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-10T20:45:20.288 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-10T20:45:20.288 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-10T20:45:20.288 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-10T20:45:20.288 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-10T20:45:20.288 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-10T20:45:20.288 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-10T20:45:20.288 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-10T20:45:20.288 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-10T20:45:20.288 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-10T20:45:20.289 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-10T20:45:20.289 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-10T20:45:20.289 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-10T20:45:20.289 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-10T20:45:20.289 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-10T20:45:20.289 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-10T20:45:20.289 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-10T20:45:20.289 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-10T20:45:20.289 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-10T20:45:20.289 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-10T20:45:20.289 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-10T20:45:20.289 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-10T20:45:20.289 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-10T20:45:20.289 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-10T20:45:20.290 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-10T20:45:20.290 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-10T20:45:20.290 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-10T20:45:20.290 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-10T20:45:20.290 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-10T20:45:20.290 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-10T20:45:20.290 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-10T20:45:20.290 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-10T20:45:20.290 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-10T20:45:20.290 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-10T20:45:20.290 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-10T20:45:20.290 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-10T20:45:20.290 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-10T20:45:20.290 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-10T20:45:20.291 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-10T20:45:20.291 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-10T20:45:20.291 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-10T20:45:20.291 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-10T20:45:20.291 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-10T20:45:20.291 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-10T20:45:20.291 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-10T20:45:20.291 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-10T20:45:20.291 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-10T20:45:20.291 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-10T20:45:20.291 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-10T20:45:20.291 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-10T20:45:20.291 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-10T20:45:20.291 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-10T20:45:20.292 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-10T20:45:20.292 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-10T20:45:20.292 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-10T20:45:20.292 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-10T20:45:20.292 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-10T20:45:20.292 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-10T20:45:20.292 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-10T20:45:20.292 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-10T20:45:20.292 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-10T20:45:20.292 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-10T20:45:20.292 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-10T20:45:20.292 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-10T20:45:20.292 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-10T20:45:20.292 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-10T20:45:20.292 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-10T20:45:20.293 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-10T20:45:20.293 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-10T20:45:20.293 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-10T20:45:20.293 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-10T20:45:20.293 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-10T20:45:20.293 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-10T20:45:20.293 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-10T20:45:20.293 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-10T20:45:20.293 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-10T20:45:20.293 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-10T20:45:20.293 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-10T20:45:20.293 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-10T20:45:20.293 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-10T20:45:20.293 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-10T20:45:20.293 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-10T20:45:20.294 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-10T20:45:20.294 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-10T20:45:20.294 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-10T20:45:20.294 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-10T20:45:20.294 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-10T20:45:20.294 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-10T20:45:20.294 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-10T20:45:20.294 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-10T20:45:20.294 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-10T20:45:20.294 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-10T20:45:20.294 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-10T20:45:20.294 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-10T20:45:20.294 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-10T20:45:20.294 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-10T20:45:20.295 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-10T20:45:20.295 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-10T20:45:20.295 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-10T20:45:20.295 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-10T20:45:20.295 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-10T20:45:20.295 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-10T20:45:20.295 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-10T20:45:20.295 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-10T20:45:20.295 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-10T20:45:20.295 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-10T20:45:20.295 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-10T20:45:20.295 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-10T20:45:20.295 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-10T20:45:20.295 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-10T20:45:20.295 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-10T20:45:20.296 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-10T20:45:20.296 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-10T20:45:20.296 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-10T20:45:20.296 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-10T20:45:20.296 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-10T20:45:20.296 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-10T20:45:20.296 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-10T20:45:20.296 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-10T20:45:20.296 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-10T20:45:20.296 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-10T20:45:20.296 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-10T20:45:20.296 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-10T20:45:20.296 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-10T20:45:20.296 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-10T20:45:20.296 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-10T20:45:20.297 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-10T20:45:20.297 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-10T20:45:20.297 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-10T20:45:20.297 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-10T20:45:20.297 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-10T20:45:20.297 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-10T20:45:20.297 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-10T20:45:20.297 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-10T20:45:20.297 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-10T20:45:20.297 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-10T20:45:20.297 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-10T20:45:20.297 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-10T20:45:20.297 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-10T20:45:20.297 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-10T20:45:20.298 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-10T20:45:20.298 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-10T20:45:20.298 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-10T20:45:20.298 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-10T20:45:20.298 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-10T20:45:20.298 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-10T20:45:20.298 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-10T20:45:20.298 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-10T20:45:20.298 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-10T20:45:20.298 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-10T20:45:20.298 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-10T20:45:20.298 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-10T20:45:20.298 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-10T20:45:20.298 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-10T20:45:20.299 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-10T20:45:20.299 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-10T20:45:20.299 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-10T20:45:20.299 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-10T20:45:20.299 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-10T20:45:20.299 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-10T20:45:20.299 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-10T20:45:20.299 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-10T20:45:20.299 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-10T20:45:20.299 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-10T20:45:20.299 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-10T20:45:20.299 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-10T20:45:20.299 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-10T20:45:20.299 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-10T20:45:20.299 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-10T20:45:20.300 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-10T20:45:20.300 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-10T20:45:20.300 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-10T20:45:20.300 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-10T20:45:20.300 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-10T20:45:20.300 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-10T20:45:20.300 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-10T20:45:20.300 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-10T20:45:20.300 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-10T20:45:20.300 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-10T20:45:20.300 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-10T20:45:20.300 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-10T20:45:20.300 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-10T20:45:20.300 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-10T20:45:20.301 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-10T20:45:20.301 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-10T20:45:20.301 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-10T20:45:20.301 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-10T20:45:20.301 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-10T20:45:20.301 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-10T20:45:20.301 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-10T20:45:20.301 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-10T20:45:20.301 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-10T20:45:20.301 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-10T20:45:20.301 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-10T20:45:20.301 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-10T20:45:20.301 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-10T20:45:20.301 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-10T20:45:20.302 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-10T20:45:20.302 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-10T20:45:20.302 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-10T20:45:20.302 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-10T20:45:20.302 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-10T20:45:20.302 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-10T20:45:20.302 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-10T20:45:20.302 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-10T20:45:20.302 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-10T20:45:20.302 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-10T20:45:20.302 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-10T20:45:20.302 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-10T20:45:20.302 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-10T20:45:20.302 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-10T20:45:20.303 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-10T20:45:20.303 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-10T20:45:20.303 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-10T20:45:20.303 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-10T20:45:20.303 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-10T20:45:20.303 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-10T20:45:20.303 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-10T20:45:20.303 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-10T20:45:20.303 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-10T20:45:20.303 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-10T20:45:20.303 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-10T20:45:20.303 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-10T20:45:20.303 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-10T20:45:20.303 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-10T20:45:20.304 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-10T20:45:20.304 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-10T20:45:20.304 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-10T20:45:20.304 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-10T20:45:20.304 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-10T20:45:20.304 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-10T20:45:20.304 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-10T20:45:20.304 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-10T20:45:20.304 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-10T20:45:20.304 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-10T20:45:20.304 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-10T20:45:20.304 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-10T20:45:20.304 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-10T20:45:20.305 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-10T20:45:20.305 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-10T20:45:20.305 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-10T20:45:20.305 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-10T20:45:20.305 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-10T20:45:20.305 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-10T20:45:20.305 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-10T20:45:20.305 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-10T20:45:20.305 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-10T20:45:20.305 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-10T20:45:20.305 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-10T20:45:20.305 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-10T20:45:20.305 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-10T20:45:20.306 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-10T20:45:20.306 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-10T20:45:20.306 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-10T20:45:20.306 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-10T20:45:20.306 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-10T20:45:20.306 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-10T20:45:20.306 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-10T20:45:20.306 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-10T20:45:20.306 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-10T20:45:20.306 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-10T20:45:20.306 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-10T20:45:20.306 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-10T20:45:20.306 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-10T20:45:20.306 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-10T20:45:20.307 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-10T20:45:20.307 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-10T20:45:20.307 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-10T20:45:20.307 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-10T20:45:20.307 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-10T20:45:20.307 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-10T20:45:20.307 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-10T20:45:20.307 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-10T20:45:20.307 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-10T20:45:20.307 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-10T20:45:20.307 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-10T20:45:20.307 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-10T20:45:20.307 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-10T20:45:20.307 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-10T20:45:20.308 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-10T20:45:20.308 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-10T20:45:20.308 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-10T20:45:20.308 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-10T20:45:20.308 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-10T20:45:20.308 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-10T20:45:20.308 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-10T20:45:20.308 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-10T20:45:20.308 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-10T20:45:20.308 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-10T20:45:20.308 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-10T20:45:20.308 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-10T20:45:20.308 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-10T20:45:20.308 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-10T20:45:20.309 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-10T20:45:20.309 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-10T20:45:20.309 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-10T20:45:20.309 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-10T20:45:20.309 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-10T20:45:20.309 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-10T20:45:20.309 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-10T20:45:20.309 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-10T20:45:20.309 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-10T20:45:20.309 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-10T20:45:20.309 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-10T20:45:20.309 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-10T20:45:20.309 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-10T20:45:20.309 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-10T20:45:20.310 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-10T20:45:20.310 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-10T20:45:20.310 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-10T20:45:20.310 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-10T20:45:20.310 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-10T20:45:20.310 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-10T20:45:20.310 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-10T20:45:20.310 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-10T20:45:20.310 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-10T20:45:20.310 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-10T20:45:20.310 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-10T20:45:20.310 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-10T20:45:20.310 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-10T20:45:20.311 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-10T20:45:20.311 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-10T20:45:20.311 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-10T20:45:20.311 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-10T20:45:20.311 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-10T20:45:20.311 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-10T20:45:20.311 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-10T20:45:20.311 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-10T20:45:20.311 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-10T20:45:20.311 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-10T20:45:20.311 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-10T20:45:20.311 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-10T20:45:20.311 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-10T20:45:20.311 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-10T20:45:20.312 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-10T20:45:20.312 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-10T20:45:20.312 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-10T20:45:20.312 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-10T20:45:20.312 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-10T20:45:20.312 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-10T20:45:20.312 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-10T20:45:20.312 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-10T20:45:20.312 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-10T20:45:20.312 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-10T20:45:20.312 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-10T20:45:20.312 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-10T20:45:20.312 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-10T20:45:20.313 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-10T20:45:20.313 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-10T20:45:20.313 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-10T20:45:20.313 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-10T20:45:20.313 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-10T20:45:20.313 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-10T20:45:20.313 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-10T20:45:20.313 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-10T20:45:20.313 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-10T20:45:20.313 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-10T20:45:20.313 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-10T20:45:20.313 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-10T20:45:20.313 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-10T20:45:20.313 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-10T20:45:20.314 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-10T20:45:20.314 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-10T20:45:20.314 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-10T20:45:20.314 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-10T20:45:20.314 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-10T20:45:20.314 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-10T20:45:20.314 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-10T20:45:20.314 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-10T20:45:20.314 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-10T20:45:20.314 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-10T20:45:20.314 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-10T20:45:20.314 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-10T20:45:20.314 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-10T20:45:20.314 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-10T20:45:20.315 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-10T20:45:20.315 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-10T20:45:20.315 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-10T20:45:20.315 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-10T20:45:20.315 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-10T20:45:20.315 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-10T20:45:20.315 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-10T20:45:20.315 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-10T20:45:20.315 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-10T20:45:20.315 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-10T20:45:20.315 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-10T20:45:20.315 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-10T20:45:20.315 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-10T20:45:20.315 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-10T20:45:20.316 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-10T20:45:20.316 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-10T20:45:20.316 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-10T20:45:20.316 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-10T20:45:20.316 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-10T20:45:20.316 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-10T20:45:20.316 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-10T20:45:20.316 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-10T20:45:20.316 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-10T20:45:20.316 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-10T20:45:20.316 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-10T20:45:20.316 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-10T20:45:20.316 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-10T20:45:20.316 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-10T20:45:20.317 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-10T20:45:20.317 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-10T20:45:20.317 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-10T20:45:20.317 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-10T20:45:20.317 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-10T20:45:20.317 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-10T20:45:20.317 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-10T20:45:20.317 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-10T20:45:20.317 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-10T20:45:20.317 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-10T20:45:20.317 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-10T20:45:20.317 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-10T20:45:20.317 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-10T20:45:20.318 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-10T20:45:20.318 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-10T20:45:20.318 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-10T20:45:20.318 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-10T20:45:20.318 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-10T20:45:20.318 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-10T20:45:20.318 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-10T20:45:20.318 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-10T20:45:20.318 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-10T20:45:20.318 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-10T20:45:20.318 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-10T20:45:20.318 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-10T20:45:20.318 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-10T20:45:20.318 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-10T20:45:20.319 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-10T20:45:20.319 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-10T20:45:20.319 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-10T20:45:20.319 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-10T20:45:20.319 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-10T20:45:20.319 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-10T20:45:20.319 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-10T20:45:20.319 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-10T20:45:20.319 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-10T20:45:20.319 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-10T20:45:20.319 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-10T20:45:20.319 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-10T20:45:20.319 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-10T20:45:20.319 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-10T20:45:20.319 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-10T20:45:20.319 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-10T20:45:20.320 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-10T20:45:20.320 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-10T20:45:20.320 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-10T20:45:20.320 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-10T20:45:20.320 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-10T20:45:20.320 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-10T20:45:20.320 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-10T20:45:20.320 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-10T20:45:20.320 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-10T20:45:20.320 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-10T20:45:20.320 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-10T20:45:20.320 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-10T20:45:20.320 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-10T20:45:20.320 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-10T20:45:20.320 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-10T20:45:20.321 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-10T20:45:20.321 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-10T20:45:20.321 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-10T20:45:20.321 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-10T20:45:20.321 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-10T20:45:20.321 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-10T20:45:20.321 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-10T20:45:20.321 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-10T20:45:20.321 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-10T20:45:20.321 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-10T20:45:20.321 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-10T20:45:20.321 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-10T20:45:20.321 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-10T20:45:20.321 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-10T20:45:20.322 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-10T20:45:20.322 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-10T20:45:20.322 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-10T20:45:20.322 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-10T20:45:20.322 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-10T20:45:20.322 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-10T20:45:20.322 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-10T20:45:20.322 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-10T20:45:20.322 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-10T20:45:20.322 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-10T20:45:20.322 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-10T20:45:20.322 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-10T20:45:20.322 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-10T20:45:20.322 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-10T20:45:20.322 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-10T20:45:20.323 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-10T20:45:20.323 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-10T20:45:20.323 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-10T20:45:20.323 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-10T20:45:20.323 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-10T20:45:20.323 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-10T20:45:20.323 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-10T20:45:20.323 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-10T20:45:20.323 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-10T20:45:20.323 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-10T20:45:20.323 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-10T20:45:20.323 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-10T20:45:20.323 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-10T20:45:20.323 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-10T20:45:20.323 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-10T20:45:20.323 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-10T20:45:20.324 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-10T20:45:20.324 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-10T20:45:20.324 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-10T20:45:20.324 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-10T20:45:20.324 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-10T20:45:20.324 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-10T20:45:20.324 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-10T20:45:20.324 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-10T20:45:20.324 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-10T20:45:20.324 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-10T20:45:20.324 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-10T20:45:20.324 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-10T20:45:20.324 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-10T20:45:20.324 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-10T20:45:20.325 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-10T20:45:20.325 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-10T20:45:20.325 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-10T20:45:20.325 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-10T20:45:20.325 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-10T20:45:20.325 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-10T20:45:20.325 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-10T20:45:20.325 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-10T20:45:20.325 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-10T20:45:20.325 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-10T20:45:20.325 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-10T20:45:20.325 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-10T20:45:20.325 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-10T20:45:20.325 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-10T20:45:20.326 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-10T20:45:20.326 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-10T20:45:20.326 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-10T20:45:20.326 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-10T20:45:20.326 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-10T20:45:20.326 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-10T20:45:20.326 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-10T20:45:20.326 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-10T20:45:20.326 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-10T20:45:20.326 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-10T20:45:20.326 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-10T20:45:20.326 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-10T20:45:20.326 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-10T20:45:20.326 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-10T20:45:20.327 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-10T20:45:20.327 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-10T20:45:20.327 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-10T20:45:20.327 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-10T20:45:20.327 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-10T20:45:20.327 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-10T20:45:20.327 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-10T20:45:20.327 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-10T20:45:20.327 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-10T20:45:20.327 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-10T20:45:20.327 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-10T20:45:20.327 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-10T20:45:20.327 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-10T20:45:20.327 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-10T20:45:20.328 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-10T20:45:20.328 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-10T20:45:20.328 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-10T20:45:20.328 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-10T20:45:20.328 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-10T20:45:20.328 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-10T20:45:20.328 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-10T20:45:20.328 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-10T20:45:20.328 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-10T20:45:20.328 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-10T20:45:20.328 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-10T20:45:20.328 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-10T20:45:20.328 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-10T20:45:20.329 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-10T20:45:20.329 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-10T20:45:20.329 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-10T20:45:20.329 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-10T20:45:20.329 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-10T20:45:20.329 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-10T20:45:20.329 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-10T20:45:20.329 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-10T20:45:20.329 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-10T20:45:20.329 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-10T20:45:20.329 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-10T20:45:20.329 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-10T20:45:20.329 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-10T20:45:20.330 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-10T20:45:20.330 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-10T20:45:20.330 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-10T20:45:20.330 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-10T20:45:20.330 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-10T20:45:20.330 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-10T20:45:20.330 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-10T20:45:20.330 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-10T20:45:20.330 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-10T20:45:20.330 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-10T20:45:20.330 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-10T20:45:20.330 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-10T20:45:20.330 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-10T20:45:20.330 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-10T20:45:20.330 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-10T20:45:20.331 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-10T20:45:20.331 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-10T20:45:20.331 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-10T20:45:20.331 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-10T20:45:20.331 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-10T20:45:20.331 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-10T20:45:20.331 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-10T20:45:20.331 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-10T20:45:20.331 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-10T20:45:20.331 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-10T20:45:20.331 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-10T20:45:20.331 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-10T20:45:20.331 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-10T20:45:20.331 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-10T20:45:20.331 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-10T20:45:20.332 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-10T20:45:20.332 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-10T20:45:20.332 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-10T20:45:20.332 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-10T20:45:20.332 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-10T20:45:20.332 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-10T20:45:20.332 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-10T20:45:20.332 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-10T20:45:20.332 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-10T20:45:20.332 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-10T20:45:20.332 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-10T20:45:20.332 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-10T20:45:20.332 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-10T20:45:20.332 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-10T20:45:20.333 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-10T20:45:20.333 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-10T20:45:20.333 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-10T20:45:20.333 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-10T20:45:20.333 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-10T20:45:20.333 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-10T20:45:20.333 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-10T20:45:20.333 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-10T20:45:20.333 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-10T20:45:20.333 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-10T20:45:20.333 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-10T20:45:20.333 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-10T20:45:20.333 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-10T20:45:20.333 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-10T20:45:20.334 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-10T20:45:20.334 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-10T20:45:20.334 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-10T20:45:20.334 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-10T20:45:20.334 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-10T20:45:20.334 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-10T20:45:20.334 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-10T20:45:20.334 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-10T20:45:20.334 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-10T20:45:20.334 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-10T20:45:20.334 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-10T20:45:20.334 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-10T20:45:20.334 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-10T20:45:20.334 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-10T20:45:20.335 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-10T20:45:20.335 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-10T20:45:20.335 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-10T20:45:20.335 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-10T20:45:20.335 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-10T20:45:20.335 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-10T20:45:20.335 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-10T20:45:20.335 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-10T20:45:20.335 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-10T20:45:20.335 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-10T20:45:20.335 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-10T20:45:20.335 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-10T20:45:20.335 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-10T20:45:20.335 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-10T20:45:20.336 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-10T20:45:20.336 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-10T20:45:20.336 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-10T20:45:20.336 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-10T20:45:20.336 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-10T20:45:20.336 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-10T20:45:20.336 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-10T20:45:20.336 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-10T20:45:20.336 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-10T20:45:20.336 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-10T20:45:20.336 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-10T20:45:20.336 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-10T20:45:20.336 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-10T20:45:20.336 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-10T20:45:20.336 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-10T20:45:20.337 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-10T20:45:20.337 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-10T20:45:20.337 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-10T20:45:20.337 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-10T20:45:20.337 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-10T20:45:20.337 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-10T20:45:20.337 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-10T20:45:20.337 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-10T20:45:20.337 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-10T20:45:20.337 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-10T20:45:20.337 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-10T20:45:20.337 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-10T20:45:20.337 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-10T20:45:20.338 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-10T20:45:20.338 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-10T20:45:20.338 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-10T20:45:20.338 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-10T20:45:20.338 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-10T20:45:20.338 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-10T20:45:20.338 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-10T20:45:20.338 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-10T20:45:20.338 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-10T20:45:20.338 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-10T20:45:20.338 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-10T20:45:20.338 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-10T20:45:20.338 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-10T20:45:20.338 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-10T20:45:20.338 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-10T20:45:20.338 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-10T20:45:20.339 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-10T20:45:20.339 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-10T20:45:20.339 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-10T20:45:20.339 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-10T20:45:20.339 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-10T20:45:20.339 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-10T20:45:20.339 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-10T20:45:20.339 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-10T20:45:20.339 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-10T20:45:20.339 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-10T20:45:20.339 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-10T20:45:20.339 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-10T20:45:20.339 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-10T20:45:20.339 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-10T20:45:20.340 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-10T20:45:20.340 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-10T20:45:20.340 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-10T20:45:20.340 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-10T20:45:20.340 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-10T20:45:20.340 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-10T20:45:20.340 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-10T20:45:20.340 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-10T20:45:20.340 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-10T20:45:20.340 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-10T20:45:20.340 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-10T20:45:20.340 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-10T20:45:20.340 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-10T20:45:20.340 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-10T20:45:20.341 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-10T20:45:20.341 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-10T20:45:20.341 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-10T20:45:20.341 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-10T20:45:20.341 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-10T20:45:20.341 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-10T20:45:20.341 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-10T20:45:20.341 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-10T20:45:20.341 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-10T20:45:20.341 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-10T20:45:20.341 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-10T20:45:20.341 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-10T20:45:20.341 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-10T20:45:20.341 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-10T20:45:20.341 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-10T20:45:20.342 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-10T20:45:20.342 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-10T20:45:20.342 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-10T20:45:20.342 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-10T20:45:20.342 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-10T20:45:20.342 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-10T20:45:20.342 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-10T20:45:20.342 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-10T20:45:20.342 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-10T20:45:20.342 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-10T20:45:20.342 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-10T20:45:20.342 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-10T20:45:20.342 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-10T20:45:20.343 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-10T20:45:20.343 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-10T20:45:20.343 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-10T20:45:20.343 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-10T20:45:20.343 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-10T20:45:20.343 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-10T20:45:20.343 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-10T20:45:20.343 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-10T20:45:20.343 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-10T20:45:20.343 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-10T20:45:20.343 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-10T20:45:20.343 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-10T20:45:20.343 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-10T20:45:20.343 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-10T20:45:20.344 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-10T20:45:20.344 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-10T20:45:20.344 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-10T20:45:20.344 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-10T20:45:20.344 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-10T20:45:20.344 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-10T20:45:20.344 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-10T20:45:20.344 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-10T20:45:20.344 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-10T20:45:20.344 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-10T20:45:20.344 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-10T20:45:20.344 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-10T20:45:20.344 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-10T20:45:20.344 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-10T20:45:20.345 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-10T20:45:20.345 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-10T20:45:20.345 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-10T20:45:20.345 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-10T20:45:20.345 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-10T20:45:20.345 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-10T20:45:20.345 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-10T20:45:20.345 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-10T20:45:20.345 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-10T20:45:20.345 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-10T20:45:20.345 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-10T20:45:20.345 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-10T20:45:20.345 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-10T20:45:20.346 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-10T20:45:20.346 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-10T20:45:20.346 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-10T20:45:20.346 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-10T20:45:20.346 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-10T20:45:20.346 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-10T20:45:20.346 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-10T20:45:20.346 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-10T20:45:20.346 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-10T20:45:20.346 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-10T20:45:20.346 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-10T20:45:20.346 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-10T20:45:20.346 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-10T20:45:20.346 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-10T20:45:20.347 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-10T20:45:20.347 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-10T20:45:20.347 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-10T20:45:20.347 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-10T20:45:20.347 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-10T20:45:20.347 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-10T20:45:20.347 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-10T20:45:20.347 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-10T20:45:20.347 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-10T20:45:20.347 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-10T20:45:20.347 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-10T20:45:20.347 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-10T20:45:20.347 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-10T20:45:20.347 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-10T20:45:20.348 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-10T20:45:20.348 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-10T20:45:20.348 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-10T20:45:20.348 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-10T20:45:20.348 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-10T20:45:20.348 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-10T20:45:20.348 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-10T20:45:20.348 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-10T20:45:20.348 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-10T20:45:20.348 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-10T20:45:20.348 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-10T20:45:20.348 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-10T20:45:20.348 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-10T20:45:20.348 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-10T20:45:20.348 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-10T20:45:20.349 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-10T20:45:20.349 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-10T20:45:20.349 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-10T20:45:20.349 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-10T20:45:20.349 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-10T20:45:20.349 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-10T20:45:20.349 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-10T20:45:20.349 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-10T20:45:20.349 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-10T20:45:20.349 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-10T20:45:20.349 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-10T20:45:20.349 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-10T20:45:20.349 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-10T20:45:20.349 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-10T20:45:20.350 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-10T20:45:20.350 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-10T20:45:20.350 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-10T20:45:20.350 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-10T20:45:20.350 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-10T20:45:20.350 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-10T20:45:20.350 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-10T20:45:20.350 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-10T20:45:20.350 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-10T20:45:20.350 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-10T20:45:20.350 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-10T20:45:20.350 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-10T20:45:20.350 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-10T20:45:20.351 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-10T20:45:20.351 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-10T20:45:20.351 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-10T20:45:20.351 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-10T20:45:20.351 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-10T20:45:20.351 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-10T20:45:20.351 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-10T20:45:20.351 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-10T20:45:20.351 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-10T20:45:20.351 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-10T20:45:20.351 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-10T20:45:20.351 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-10T20:45:20.351 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-10T20:45:20.351 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-10T20:45:20.351 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-10T20:45:20.352 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-10T20:45:20.352 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-10T20:45:20.352 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-10T20:45:20.352 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-10T20:45:20.352 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-10T20:45:20.352 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-10T20:45:20.352 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-10T20:45:20.352 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-10T20:45:20.352 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-10T20:45:20.352 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-10T20:45:20.352 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-10T20:45:20.352 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-10T20:45:20.352 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-10T20:45:20.352 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-10T20:45:20.352 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-10T20:45:20.353 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-10T20:45:20.353 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-10T20:45:20.353 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-10T20:45:20.353 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-10T20:45:20.353 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-10T20:45:20.353 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-10T20:45:20.353 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-10T20:45:20.353 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-10T20:45:20.353 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-10T20:45:20.353 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-10T20:45:20.353 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-10T20:45:20.353 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-10T20:45:20.353 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-10T20:45:20.353 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-10T20:45:20.354 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-10T20:45:20.354 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-10T20:45:20.354 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-10T20:45:20.354 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-10T20:45:20.354 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-10T20:45:20.354 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-10T20:45:20.354 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-10T20:45:20.354 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-10T20:45:20.354 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-10T20:45:20.354 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-10T20:45:20.354 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-10T20:45:20.354 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-10T20:45:20.354 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-10T20:45:20.354 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-10T20:45:20.355 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-10T20:45:20.355 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-10T20:45:20.355 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-10T20:45:20.355 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-10T20:45:20.355 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-10T20:45:20.355 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-10T20:45:20.355 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-10T20:45:20.355 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-10T20:45:20.355 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-10T20:45:20.355 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-10T20:45:20.355 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-10T20:45:20.355 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-10T20:45:20.355 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-10T20:45:20.355 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-10T20:45:20.355 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-10T20:45:20.356 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-10T20:45:20.356 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-10T20:45:20.356 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-10T20:45:20.356 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-10T20:45:20.356 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-10T20:45:20.356 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-10T20:45:20.356 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-10T20:45:20.356 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-10T20:45:20.356 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-10T20:45:20.356 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-10T20:45:20.356 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-10T20:45:20.356 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-10T20:45:20.356 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-10T20:45:20.356 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-10T20:45:20.357 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-10T20:45:20.357 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-10T20:45:20.357 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-10T20:45:20.357 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-10T20:45:20.357 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-10T20:45:20.357 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-10T20:45:20.357 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-10T20:45:20.357 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-10T20:45:20.357 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-10T20:45:20.357 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-10T20:45:20.357 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-10T20:45:20.357 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-10T20:45:20.357 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-10T20:45:20.357 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-10T20:45:20.358 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-10T20:45:20.358 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-10T20:45:20.358 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-10T20:45:20.358 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-10T20:45:20.358 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-10T20:45:20.358 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-10T20:45:20.358 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-10T20:45:20.358 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-10T20:45:20.358 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-10T20:45:20.358 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-10T20:45:20.358 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-10T20:45:20.358 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-10T20:45:20.358 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-10T20:45:20.358 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-10T20:45:20.359 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-10T20:45:20.359 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-10T20:45:20.359 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-10T20:45:20.359 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-10T20:45:20.359 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-10T20:45:20.359 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-10T20:45:20.359 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-10T20:45:20.359 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-10T20:45:20.359 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-10T20:45:20.359 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-10T20:45:20.359 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-10T20:45:20.359 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-10T20:45:20.359 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-10T20:45:20.360 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-10T20:45:20.360 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-10T20:45:20.360 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-10T20:45:20.360 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-10T20:45:20.360 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-10T20:45:20.360 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-10T20:45:20.360 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-10T20:45:20.360 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-10T20:45:20.360 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-10T20:45:20.360 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-10T20:45:20.360 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-10T20:45:20.360 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-10T20:45:20.360 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-10T20:45:20.361 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-10T20:45:20.361 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-10T20:45:20.361 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-10T20:45:20.361 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-10T20:45:20.361 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-10T20:45:20.361 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-10T20:45:20.361 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-10T20:45:20.361 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-10T20:45:20.361 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-10T20:45:20.361 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-10T20:45:20.361 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-10T20:45:20.361 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-10T20:45:20.361 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-10T20:45:20.361 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-10T20:45:20.362 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-10T20:45:20.362 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-10T20:45:20.362 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-10T20:45:20.362 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-10T20:45:20.362 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-10T20:45:20.362 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-10T20:45:20.362 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-10T20:45:20.362 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-10T20:45:20.362 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-10T20:45:20.362 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-10T20:45:20.362 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-10T20:45:20.362 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-10T20:45:20.362 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-10T20:45:20.363 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-10T20:45:20.363 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-10T20:45:20.363 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-10T20:45:20.363 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-10T20:45:20.363 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-10T20:45:20.363 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-10T20:45:20.363 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-10T20:45:20.363 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-10T20:45:20.363 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-10T20:45:20.363 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-10T20:45:20.363 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-10T20:45:20.363 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-10T20:45:20.363 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-10T20:45:20.363 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-10T20:45:20.364 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-10T20:45:20.364 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-10T20:45:20.364 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-10T20:45:20.364 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-10T20:45:20.364 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-10T20:45:20.364 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-10T20:45:20.364 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-10T20:45:20.364 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-10T20:45:20.364 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-10T20:45:20.364 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-10T20:45:20.364 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-10T20:45:20.364 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-10T20:45:20.364 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-10T20:45:20.365 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-10T20:45:20.365 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-10T20:45:20.365 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-10T20:45:20.365 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-10T20:45:20.365 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-10T20:45:20.365 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-10T20:45:20.365 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-10T20:45:20.365 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-10T20:45:20.365 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-10T20:45:20.365 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-10T20:45:20.365 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-10T20:45:20.365 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-10T20:45:20.365 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-10T20:45:20.365 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-10T20:45:20.365 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-10T20:45:20.365 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-10T20:45:20.366 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-10T20:45:20.366 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-10T20:45:20.366 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-10T20:45:20.366 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-10T20:45:20.366 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-10T20:45:20.366 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-10T20:45:20.366 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-10T20:45:20.366 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-10T20:45:20.366 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-10T20:45:20.366 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-10T20:45:20.366 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-10T20:45:20.366 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-10T20:45:20.366 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-10T20:45:20.367 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-10T20:45:20.367 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-10T20:45:20.367 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-10T20:45:20.367 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-10T20:45:20.367 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-10T20:45:20.367 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-10T20:45:20.367 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-10T20:45:20.367 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-10T20:45:20.367 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-10T20:45:20.367 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-10T20:45:20.367 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-10T20:45:20.367 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-10T20:45:20.367 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-10T20:45:20.367 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-10T20:45:20.367 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-10T20:45:20.368 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-10T20:45:20.368 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-10T20:45:20.368 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-10T20:45:20.368 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-10T20:45:20.368 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-10T20:45:20.368 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-10T20:45:20.368 INFO:teuthology.orchestra.run.smithi006.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T20:45:20.372 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:45:20.372 DEBUG:teuthology.orchestra.run.smithi006:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-10T20:45:20.395 INFO:teuthology.orchestra.run.smithi006.stdout:postinstall scriptlet (using /bin/sh): 2024-09-10T20:45:20.395 INFO:teuthology.orchestra.run.smithi006.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T20:45:20.395 INFO:teuthology.orchestra.run.smithi006.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T20:45:20.395 INFO:teuthology.orchestra.run.smithi006.stdout:fi 2024-09-10T20:45:20.395 INFO:teuthology.orchestra.run.smithi006.stdout:for file in vmlinuz System.map config; do 2024-09-10T20:45:20.395 INFO:teuthology.orchestra.run.smithi006.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-10T20:45:20.395 INFO:teuthology.orchestra.run.smithi006.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T20:45:20.395 INFO:teuthology.orchestra.run.smithi006.stdout: fi 2024-09-10T20:45:20.395 INFO:teuthology.orchestra.run.smithi006.stdout:done 2024-09-10T20:45:20.396 INFO:teuthology.orchestra.run.smithi006.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-10T20:45:20.396 INFO:teuthology.orchestra.run.smithi006.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-10T20:45:20.396 INFO:teuthology.orchestra.run.smithi006.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T20:45:20.396 INFO:teuthology.orchestra.run.smithi006.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T20:45:20.396 INFO:teuthology.orchestra.run.smithi006.stdout:fi 2024-09-10T20:45:20.396 INFO:teuthology.orchestra.run.smithi006.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-10T20:45:20.396 INFO:teuthology.orchestra.run.smithi006.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:45:20.396 INFO:teuthology.orchestra.run.smithi006.stdout:fi 2024-09-10T20:45:20.396 INFO:teuthology.orchestra.run.smithi006.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-10T20:45:20.396 INFO:teuthology.orchestra.run.smithi006.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T20:45:20.396 INFO:teuthology.orchestra.run.smithi006.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:45:20.396 INFO:teuthology.orchestra.run.smithi006.stdout:fi 2024-09-10T20:45:20.397 DEBUG:teuthology.orchestra.run.smithi006:> sudo rpm -qi grub2-tools 2024-09-10T20:45:20.470 INFO:teuthology.orchestra.run.smithi006.stdout:Name : grub2-tools 2024-09-10T20:45:20.470 INFO:teuthology.orchestra.run.smithi006.stdout:Epoch : 1 2024-09-10T20:45:20.470 INFO:teuthology.orchestra.run.smithi006.stdout:Version : 2.06 2024-09-10T20:45:20.470 INFO:teuthology.orchestra.run.smithi006.stdout:Release : 82.el9 2024-09-10T20:45:20.470 INFO:teuthology.orchestra.run.smithi006.stdout:Architecture: x86_64 2024-09-10T20:45:20.470 INFO:teuthology.orchestra.run.smithi006.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T20:45:20.470 INFO:teuthology.orchestra.run.smithi006.stdout:Group : Unspecified 2024-09-10T20:45:20.470 INFO:teuthology.orchestra.run.smithi006.stdout:Size : 8274670 2024-09-10T20:45:20.471 INFO:teuthology.orchestra.run.smithi006.stdout:License : GPLv3+ 2024-09-10T20:45:20.471 INFO:teuthology.orchestra.run.smithi006.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T20:45:20.471 INFO:teuthology.orchestra.run.smithi006.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T20:45:20.471 INFO:teuthology.orchestra.run.smithi006.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T20:45:20.471 INFO:teuthology.orchestra.run.smithi006.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T20:45:20.471 INFO:teuthology.orchestra.run.smithi006.stdout:Packager : builder@centos.org 2024-09-10T20:45:20.471 INFO:teuthology.orchestra.run.smithi006.stdout:Vendor : CentOS 2024-09-10T20:45:20.471 INFO:teuthology.orchestra.run.smithi006.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T20:45:20.471 INFO:teuthology.orchestra.run.smithi006.stdout:Summary : Support tools for GRUB. 2024-09-10T20:45:20.471 INFO:teuthology.orchestra.run.smithi006.stdout:Description : 2024-09-10T20:45:20.471 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:45:20.471 INFO:teuthology.orchestra.run.smithi006.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T20:45:20.471 INFO:teuthology.orchestra.run.smithi006.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T20:45:20.472 INFO:teuthology.orchestra.run.smithi006.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T20:45:20.472 INFO:teuthology.orchestra.run.smithi006.stdout:hardware devices. 2024-09-10T20:45:20.472 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:45:20.472 INFO:teuthology.orchestra.run.smithi006.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T20:45:20.472 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T20:45:20.473 INFO:teuthology.task.kernel:Updating grub on smithi006 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:45:20.473 DEBUG:teuthology.orchestra.run.smithi006:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T20:45:21.093 INFO:teuthology.orchestra.run.smithi006.stderr:Generating grub configuration file ... 2024-09-10T20:45:22.434 INFO:teuthology.orchestra.run.smithi006.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T20:45:22.471 INFO:teuthology.orchestra.run.smithi006.stderr:done 2024-09-10T20:45:22.473 DEBUG:teuthology.orchestra.run.smithi006:> mktemp 2024-09-10T20:45:22.488 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.Q8Mjlv1Zti 2024-09-10T20:45:22.488 DEBUG:teuthology.orchestra.run.smithi006:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Q8Mjlv1Zti 2024-09-10T20:45:22.554 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0666 /tmp/tmp.Q8Mjlv1Zti 2024-09-10T20:45:22.695 DEBUG:teuthology.orchestra.remote:smithi006:/tmp/tmp.Q8Mjlv1Zti is 6KB 2024-09-10T20:45:22.744 DEBUG:teuthology.orchestra.run.smithi006:> rm -fr /tmp/tmp.Q8Mjlv1Zti 2024-09-10T20:45:22.759 DEBUG:teuthology.orchestra.run.smithi006:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T20:45:22.823 INFO:teuthology.orchestra.run.smithi006.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T20:45:22.824 INFO:teuthology.orchestra.run.smithi006.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T20:45:22.824 INFO:teuthology.orchestra.run.smithi006.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T20:45:22.824 INFO:teuthology.orchestra.run.smithi006.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-10T20:45:22.825 DEBUG:teuthology.orchestra.run.smithi006:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:45:23.003 DEBUG:teuthology.orchestra.run.smithi006:> sudo shutdown -r now 2024-09-10T20:45:37.801 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-10T20:45:37.801 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-10T20:45:37.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T20:45:53.021 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-10T20:45:53.021 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-09-10T20:45:53.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T20:45:56.157 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-09-10T20:46:05.165 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-10T20:46:05.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T20:46:08.253 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-09-10T20:46:11.517 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-09-10T20:46:20.261 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-10T20:46:20.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T20:46:20.518 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-09-10T20:46:20.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T20:46:38.653 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-09-10T20:46:53.661 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-10T20:46:53.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T20:46:55.179 DEBUG:teuthology.orchestra.run.smithi150:> true 2024-09-10T20:46:55.861 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-10T20:46:55.861 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-10T20:46:55.861 DEBUG:teuthology.orchestra.run.smithi150:> uname -r 2024-09-10T20:46:55.896 INFO:teuthology.orchestra.run.smithi150.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:46:55.896 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:46:55.896 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T20:46:55.896 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T20:46:56.897 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-10T20:46:56.897 DEBUG:teuthology.orchestra.run.smithi150:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T20:46:57.008 INFO:teuthology.orchestra.run.smithi150.stdout:ttyS1 2024-09-10T20:46:57.035 DEBUG:teuthology.parallel:result is None 2024-09-10T20:47:20.530 DEBUG:teuthology.orchestra.remote:timed out 2024-09-10T20:47:32.532 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-09-10T20:47:32.533 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T20:47:32.952 DEBUG:teuthology.orchestra.run.smithi006:> true 2024-09-10T20:47:33.461 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-09-10T20:47:33.461 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-10T20:47:33.461 DEBUG:teuthology.orchestra.run.smithi006:> uname -r 2024-09-10T20:47:33.496 INFO:teuthology.orchestra.run.smithi006.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:47:33.496 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:47:33.496 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T20:47:33.496 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T20:47:34.497 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-10T20:47:34.497 DEBUG:teuthology.orchestra.run.smithi006:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T20:47:34.626 INFO:teuthology.orchestra.run.smithi006.stdout:ttyS1 2024-09-10T20:47:34.665 DEBUG:teuthology.parallel:result is None 2024-09-10T20:47:34.665 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-10T20:47:34.673 INFO:teuthology.task.internal:Creating test directory... 2024-09-10T20:47:34.673 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T20:47:34.677 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T20:47:34.718 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-10T20:47:34.725 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-10T20:47:34.747 INFO:teuthology.task.internal:Creating archive directory... 2024-09-10T20:47:34.748 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T20:47:34.755 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T20:47:34.813 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-10T20:47:34.820 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-10T20:47:34.820 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T20:47:34.837 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T20:47:34.904 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T20:47:34.916 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T20:47:34.928 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T20:47:34.939 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T20:47:34.942 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-10T20:47:34.949 INFO:teuthology.task.internal:Configuring sudo... 2024-09-10T20:47:34.949 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T20:47:34.953 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T20:47:35.009 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-10T20:47:35.018 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-10T20:47:35.018 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T20:47:35.022 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T20:47:35.056 DEBUG:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T20:47:35.168 DEBUG:teuthology.orchestra.run.smithi006:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T20:47:35.292 DEBUG:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T20:47:35.361 DEBUG:teuthology.orchestra.run.smithi006:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T20:47:35.425 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-10T20:47:35.425 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T20:47:35.480 DEBUG:teuthology.orchestra.run.smithi150:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T20:47:35.550 DEBUG:teuthology.orchestra.run.smithi150:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T20:47:35.631 DEBUG:teuthology.orchestra.run.smithi150:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T20:47:35.702 DEBUG:teuthology.orchestra.run.smithi150:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T20:47:35.764 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-10T20:47:35.764 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T20:47:35.818 DEBUG:teuthology.orchestra.run.smithi006:> sudo service rsyslog restart 2024-09-10T20:47:35.822 DEBUG:teuthology.orchestra.run.smithi150:> sudo service rsyslog restart 2024-09-10T20:47:35.952 INFO:teuthology.orchestra.run.smithi150.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T20:47:36.026 INFO:teuthology.orchestra.run.smithi006.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T20:47:36.364 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-10T20:47:36.371 INFO:teuthology.task.internal:Starting timer... 2024-09-10T20:47:36.372 INFO:teuthology.run_tasks:Running task pcp... 2024-09-10T20:47:36.384 INFO:teuthology.run_tasks:Running task selinux... 2024-09-10T20:47:36.393 DEBUG:teuthology.orchestra.run.smithi006:> sudo service auditd rotate 2024-09-10T20:47:36.486 INFO:teuthology.orchestra.run.smithi006.stdout:Rotating logs: 2024-09-10T20:47:36.489 DEBUG:teuthology.orchestra.run.smithi150:> sudo service auditd rotate 2024-09-10T20:47:36.600 INFO:teuthology.orchestra.run.smithi150.stdout:Rotating logs: 2024-09-10T20:47:36.604 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-10T20:47:36.604 DEBUG:teuthology.orchestra.run.smithi006:> /usr/sbin/getenforce 2024-09-10T20:47:36.654 INFO:teuthology.orchestra.run.smithi006.stdout:Permissive 2024-09-10T20:47:36.654 DEBUG:teuthology.orchestra.run.smithi150:> /usr/sbin/getenforce 2024-09-10T20:47:36.699 INFO:teuthology.orchestra.run.smithi150.stdout:Permissive 2024-09-10T20:47:36.700 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi006.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi150.front.sepia.ceph.com': 'permissive'} 2024-09-10T20:47:36.700 DEBUG:teuthology.orchestra.run.smithi006:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-10T20:47:36.760 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T20:47:36.760 DEBUG:teuthology.orchestra.run.smithi150:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-10T20:47:36.818 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T20:47:36.818 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-10T20:47:36.818 DEBUG:teuthology.orchestra.run.smithi006:> sudo /usr/sbin/setenforce permissive 2024-09-10T20:47:36.878 DEBUG:teuthology.orchestra.run.smithi150:> sudo /usr/sbin/setenforce permissive 2024-09-10T20:47:36.940 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-10T20:47:36.950 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-10T20:47:36.953 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-10T20:47:37.207 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-10T20:47:37.217 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-10T20:47:37.218 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi006.front.sepia.ceph.com,smithi150.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-10T20:52:21.822 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi006.front.sepia.ceph.com'), Remote(name='ubuntu@smithi150.front.sepia.ceph.com')] 2024-09-10T20:52:21.823 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-09-10T20:52:21.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T20:52:21.938 DEBUG:teuthology.orchestra.run.smithi006:> true 2024-09-10T20:52:22.043 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-09-10T20:52:22.043 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-10T20:52:22.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T20:52:22.139 DEBUG:teuthology.orchestra.run.smithi150:> true 2024-09-10T20:52:22.243 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-10T20:52:22.243 INFO:teuthology.run_tasks:Running task clock... 2024-09-10T20:52:22.254 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-10T20:52:22.255 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T20:52:22.255 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T20:52:22.260 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T20:52:22.260 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T20:52:22.318 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T20:52:22.345 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T20:52:22.347 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T20:52:22.376 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T20:52:22.398 INFO:teuthology.orchestra.run.smithi006.stderr:sudo: ntpd: command not found 2024-09-10T20:52:22.422 INFO:teuthology.orchestra.run.smithi006.stdout:506 Cannot talk to daemon 2024-09-10T20:52:22.425 INFO:teuthology.orchestra.run.smithi150.stderr:sudo: ntpd: command not found 2024-09-10T20:52:22.450 INFO:teuthology.orchestra.run.smithi150.stdout:506 Cannot talk to daemon 2024-09-10T20:52:22.452 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T20:52:22.479 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T20:52:22.481 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T20:52:22.508 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T20:52:22.584 INFO:teuthology.orchestra.run.smithi006.stderr:bash: line 1: ntpq: command not found 2024-09-10T20:52:22.589 INFO:teuthology.orchestra.run.smithi006.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T20:52:22.589 INFO:teuthology.orchestra.run.smithi006.stdout:=============================================================================== 2024-09-10T20:52:22.589 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T20:52:22.589 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T20:52:22.589 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T20:52:22.589 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T20:52:22.609 INFO:teuthology.orchestra.run.smithi150.stderr:bash: line 1: ntpq: command not found 2024-09-10T20:52:22.616 INFO:teuthology.orchestra.run.smithi150.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T20:52:22.616 INFO:teuthology.orchestra.run.smithi150.stdout:=============================================================================== 2024-09-10T20:52:22.616 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T20:52:22.616 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T20:52:22.616 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T20:52:22.616 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T20:52:22.617 INFO:teuthology.run_tasks:Running task install... 2024-09-10T20:52:22.626 DEBUG:teuthology.task.install:project ceph 2024-09-10T20:52:22.626 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}} 2024-09-10T20:52:22.626 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'} 2024-09-10T20:52:22.626 INFO:teuthology.task.install:Using flavor: default 2024-09-10T20:52:22.632 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-10T20:52:22.632 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-10T20:52:22.633 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-10T20:52:22.633 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T20:52:22.635 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-10T20:52:22.636 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T20:52:22.788 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-10T20:52:22.788 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-10T20:52:22.790 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-10T20:52:22.790 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-10T20:52:22.911 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T20:52:22.912 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-10T20:52:22.912 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T20:52:22.915 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T20:52:22.916 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-10T20:52:22.916 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T20:52:22.969 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T20:52:22.969 DEBUG:teuthology.orchestra.run.smithi006:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T20:52:22.972 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T20:52:22.973 DEBUG:teuthology.orchestra.run.smithi150:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T20:52:23.067 DEBUG:teuthology.orchestra.run.smithi006:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T20:52:23.070 DEBUG:teuthology.orchestra.run.smithi150:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T20:52:23.147 DEBUG:teuthology.orchestra.run.smithi006:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T20:52:23.148 DEBUG:teuthology.orchestra.run.smithi150:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T20:52:23.202 INFO:teuthology.orchestra.run.smithi006.stdout:check_obsoletes = 1 2024-09-10T20:52:23.203 INFO:teuthology.orchestra.run.smithi150.stdout:check_obsoletes = 1 2024-09-10T20:52:23.205 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum clean all 2024-09-10T20:52:23.207 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum clean all 2024-09-10T20:52:23.487 INFO:teuthology.orchestra.run.smithi006.stdout:45 files removed 2024-09-10T20:52:23.488 INFO:teuthology.orchestra.run.smithi150.stdout:45 files removed 2024-09-10T20:52:23.521 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T20:52:23.522 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T20:52:24.233 INFO:teuthology.orchestra.run.smithi006.stdout:ceph packages for x86_64 276 kB/s | 84 kB 00:00 2024-09-10T20:52:24.253 INFO:teuthology.orchestra.run.smithi150.stdout:ceph packages for x86_64 250 kB/s | 84 kB 00:00 2024-09-10T20:52:24.562 INFO:teuthology.orchestra.run.smithi150.stdout:ceph noarch packages 92 kB/s | 24 kB 00:00 2024-09-10T20:52:24.567 INFO:teuthology.orchestra.run.smithi006.stdout:ceph noarch packages 84 kB/s | 24 kB 00:00 2024-09-10T20:52:24.859 INFO:teuthology.orchestra.run.smithi006.stdout:ceph source packages 7.6 kB/s | 1.9 kB 00:00 2024-09-10T20:52:24.879 INFO:teuthology.orchestra.run.smithi150.stdout:ceph source packages 6.9 kB/s | 1.9 kB 00:00 2024-09-10T20:52:25.371 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.2 MB 00:00 2024-09-10T20:52:26.070 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - BaseOS 7.0 MB/s | 8.2 MB 00:01 2024-09-10T20:52:28.421 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - AppStream 17 MB/s | 20 MB 00:01 2024-09-10T20:52:29.731 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - AppStream 6.4 MB/s | 20 MB 00:03 2024-09-10T20:52:34.713 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - CRB 3.0 MB/s | 6.5 MB 00:02 2024-09-10T20:52:35.781 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - CRB 3.2 MB/s | 6.5 MB 00:02 2024-09-10T20:52:36.347 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - Extras packages 71 kB/s | 19 kB 00:00 2024-09-10T20:52:37.265 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - Extras packages 109 kB/s | 19 kB 00:00 2024-09-10T20:52:37.585 INFO:teuthology.orchestra.run.smithi006.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-10T20:52:38.970 INFO:teuthology.orchestra.run.smithi150.stdout:Extra Packages for Enterprise Linux 14 MB/s | 23 MB 00:01 2024-09-10T20:52:44.308 INFO:teuthology.orchestra.run.smithi006.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-10T20:52:45.442 INFO:teuthology.orchestra.run.smithi150.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2024-09-10T20:52:46.898 INFO:teuthology.orchestra.run.smithi006.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T20:52:46.899 INFO:teuthology.orchestra.run.smithi006.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T20:52:46.914 INFO:teuthology.orchestra.run.smithi006.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T20:52:46.915 INFO:teuthology.orchestra.run.smithi006.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T20:52:46.916 INFO:teuthology.orchestra.run.smithi006.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T20:52:46.917 INFO:teuthology.orchestra.run.smithi006.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T20:52:46.919 INFO:teuthology.orchestra.run.smithi006.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T20:52:46.922 INFO:teuthology.orchestra.run.smithi006.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T20:52:46.923 INFO:teuthology.orchestra.run.smithi006.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T20:52:46.992 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2024-09-10T20:52:47.022 INFO:teuthology.orchestra.run.smithi006.stdout:======================================================================================= 2024-09-10T20:52:47.023 INFO:teuthology.orchestra.run.smithi006.stdout: Package Arch Version Repository Size 2024-09-10T20:52:47.023 INFO:teuthology.orchestra.run.smithi006.stdout:======================================================================================= 2024-09-10T20:52:47.023 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2024-09-10T20:52:47.023 INFO:teuthology.orchestra.run.smithi006.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T20:52:47.023 INFO:teuthology.orchestra.run.smithi006.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-10T20:52:47.023 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T20:52:47.023 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-10T20:52:47.023 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-10T20:52:47.023 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-10T20:52:47.023 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-10T20:52:47.023 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-10T20:52:47.023 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-10T20:52:47.024 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-10T20:52:47.024 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-10T20:52:47.024 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-10T20:52:47.024 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-10T20:52:47.024 INFO:teuthology.orchestra.run.smithi006.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-10T20:52:47.024 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-10T20:52:47.024 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-10T20:52:47.024 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-10T20:52:47.024 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T20:52:47.024 INFO:teuthology.orchestra.run.smithi006.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T20:52:47.024 INFO:teuthology.orchestra.run.smithi006.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T20:52:47.024 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-10T20:52:47.025 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-10T20:52:47.025 INFO:teuthology.orchestra.run.smithi006.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-10T20:52:47.025 INFO:teuthology.orchestra.run.smithi006.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T20:52:47.025 INFO:teuthology.orchestra.run.smithi006.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T20:52:47.025 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T20:52:47.025 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T20:52:47.025 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T20:52:47.025 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T20:52:47.025 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-10T20:52:47.025 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-10T20:52:47.025 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-10T20:52:47.025 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-10T20:52:47.026 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-10T20:52:47.026 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T20:52:47.026 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-10T20:52:47.026 INFO:teuthology.orchestra.run.smithi006.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T20:52:47.026 INFO:teuthology.orchestra.run.smithi006.stdout:Upgrading: 2024-09-10T20:52:47.026 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T20:52:47.026 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T20:52:47.026 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T20:52:47.026 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T20:52:47.026 INFO:teuthology.orchestra.run.smithi006.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-10T20:52:47.026 INFO:teuthology.orchestra.run.smithi006.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T20:52:47.026 INFO:teuthology.orchestra.run.smithi006.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T20:52:47.027 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T20:52:47.027 INFO:teuthology.orchestra.run.smithi006.stdout:Installing dependencies: 2024-09-10T20:52:47.027 INFO:teuthology.orchestra.run.smithi006.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T20:52:47.027 INFO:teuthology.orchestra.run.smithi006.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T20:52:47.027 INFO:teuthology.orchestra.run.smithi006.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T20:52:47.027 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-10T20:52:47.027 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-10T20:52:47.027 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-10T20:52:47.027 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-10T20:52:47.027 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-10T20:52:47.027 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-10T20:52:47.027 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-10T20:52:47.028 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-10T20:52:47.028 INFO:teuthology.orchestra.run.smithi006.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T20:52:47.028 INFO:teuthology.orchestra.run.smithi006.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T20:52:47.028 INFO:teuthology.orchestra.run.smithi006.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T20:52:47.028 INFO:teuthology.orchestra.run.smithi006.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T20:52:47.028 INFO:teuthology.orchestra.run.smithi006.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T20:52:47.028 INFO:teuthology.orchestra.run.smithi006.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T20:52:47.028 INFO:teuthology.orchestra.run.smithi006.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T20:52:47.028 INFO:teuthology.orchestra.run.smithi006.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T20:52:47.028 INFO:teuthology.orchestra.run.smithi006.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-10T20:52:47.028 INFO:teuthology.orchestra.run.smithi006.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T20:52:47.028 INFO:teuthology.orchestra.run.smithi006.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-10T20:52:47.029 INFO:teuthology.orchestra.run.smithi006.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T20:52:47.029 INFO:teuthology.orchestra.run.smithi006.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T20:52:47.029 INFO:teuthology.orchestra.run.smithi006.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T20:52:47.029 INFO:teuthology.orchestra.run.smithi006.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T20:52:47.029 INFO:teuthology.orchestra.run.smithi006.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-10T20:52:47.029 INFO:teuthology.orchestra.run.smithi006.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T20:52:47.029 INFO:teuthology.orchestra.run.smithi006.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T20:52:47.029 INFO:teuthology.orchestra.run.smithi006.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T20:52:47.029 INFO:teuthology.orchestra.run.smithi006.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T20:52:47.029 INFO:teuthology.orchestra.run.smithi006.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T20:52:47.029 INFO:teuthology.orchestra.run.smithi006.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T20:52:47.029 INFO:teuthology.orchestra.run.smithi006.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T20:52:47.030 INFO:teuthology.orchestra.run.smithi006.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T20:52:47.030 INFO:teuthology.orchestra.run.smithi006.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T20:52:47.030 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T20:52:47.030 INFO:teuthology.orchestra.run.smithi006.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T20:52:47.030 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T20:52:47.030 INFO:teuthology.orchestra.run.smithi006.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T20:52:47.030 INFO:teuthology.orchestra.run.smithi006.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T20:52:47.030 INFO:teuthology.orchestra.run.smithi006.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T20:52:47.030 INFO:teuthology.orchestra.run.smithi006.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T20:52:47.030 INFO:teuthology.orchestra.run.smithi006.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T20:52:47.030 INFO:teuthology.orchestra.run.smithi006.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T20:52:47.030 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T20:52:47.030 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-10T20:52:47.031 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-10T20:52:47.031 INFO:teuthology.orchestra.run.smithi006.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T20:52:47.031 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T20:52:47.031 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T20:52:47.031 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T20:52:47.031 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T20:52:47.031 INFO:teuthology.orchestra.run.smithi006.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T20:52:47.031 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T20:52:47.031 INFO:teuthology.orchestra.run.smithi006.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T20:52:47.031 INFO:teuthology.orchestra.run.smithi006.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T20:52:47.031 INFO:teuthology.orchestra.run.smithi006.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T20:52:47.031 INFO:teuthology.orchestra.run.smithi006.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T20:52:47.031 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T20:52:47.032 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T20:52:47.032 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T20:52:47.032 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T20:52:47.032 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T20:52:47.032 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T20:52:47.032 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T20:52:47.032 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T20:52:47.032 INFO:teuthology.orchestra.run.smithi006.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T20:52:47.032 INFO:teuthology.orchestra.run.smithi006.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T20:52:47.032 INFO:teuthology.orchestra.run.smithi006.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T20:52:47.032 INFO:teuthology.orchestra.run.smithi006.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T20:52:47.032 INFO:teuthology.orchestra.run.smithi006.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T20:52:47.033 INFO:teuthology.orchestra.run.smithi006.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T20:52:47.033 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T20:52:47.033 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T20:52:47.033 INFO:teuthology.orchestra.run.smithi006.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T20:52:47.033 INFO:teuthology.orchestra.run.smithi006.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T20:52:47.033 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T20:52:47.033 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T20:52:47.033 INFO:teuthology.orchestra.run.smithi006.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T20:52:47.033 INFO:teuthology.orchestra.run.smithi006.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T20:52:47.033 INFO:teuthology.orchestra.run.smithi006.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T20:52:47.033 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T20:52:47.033 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T20:52:47.033 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T20:52:47.034 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T20:52:47.034 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T20:52:47.034 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T20:52:47.034 INFO:teuthology.orchestra.run.smithi006.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T20:52:47.034 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T20:52:47.034 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T20:52:47.034 INFO:teuthology.orchestra.run.smithi006.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T20:52:47.034 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T20:52:47.034 INFO:teuthology.orchestra.run.smithi006.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T20:52:47.034 INFO:teuthology.orchestra.run.smithi006.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T20:52:47.034 INFO:teuthology.orchestra.run.smithi006.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T20:52:47.034 INFO:teuthology.orchestra.run.smithi006.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T20:52:47.034 INFO:teuthology.orchestra.run.smithi006.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T20:52:47.035 INFO:teuthology.orchestra.run.smithi006.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T20:52:47.035 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T20:52:47.035 INFO:teuthology.orchestra.run.smithi006.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T20:52:47.035 INFO:teuthology.orchestra.run.smithi006.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T20:52:47.035 INFO:teuthology.orchestra.run.smithi006.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T20:52:47.035 INFO:teuthology.orchestra.run.smithi006.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T20:52:47.035 INFO:teuthology.orchestra.run.smithi006.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T20:52:47.035 INFO:teuthology.orchestra.run.smithi006.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T20:52:47.035 INFO:teuthology.orchestra.run.smithi006.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T20:52:47.035 INFO:teuthology.orchestra.run.smithi006.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T20:52:47.035 INFO:teuthology.orchestra.run.smithi006.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T20:52:47.035 INFO:teuthology.orchestra.run.smithi006.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T20:52:47.035 INFO:teuthology.orchestra.run.smithi006.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T20:52:47.036 INFO:teuthology.orchestra.run.smithi006.stdout:Installing weak dependencies: 2024-09-10T20:52:47.036 INFO:teuthology.orchestra.run.smithi006.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T20:52:47.036 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:52:47.036 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2024-09-10T20:52:47.036 INFO:teuthology.orchestra.run.smithi006.stdout:======================================================================================= 2024-09-10T20:52:47.036 INFO:teuthology.orchestra.run.smithi006.stdout:Install 149 Packages 2024-09-10T20:52:47.036 INFO:teuthology.orchestra.run.smithi006.stdout:Upgrade 8 Packages 2024-09-10T20:52:47.036 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:52:47.037 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 240 M 2024-09-10T20:52:47.037 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading Packages: 2024-09-10T20:52:47.959 INFO:teuthology.orchestra.run.smithi006.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 22 kB/s | 6.6 kB 00:00 2024-09-10T20:52:47.963 INFO:teuthology.orchestra.run.smithi150.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T20:52:47.964 INFO:teuthology.orchestra.run.smithi150.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T20:52:47.976 INFO:teuthology.orchestra.run.smithi150.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T20:52:47.976 INFO:teuthology.orchestra.run.smithi150.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T20:52:47.977 INFO:teuthology.orchestra.run.smithi150.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T20:52:47.977 INFO:teuthology.orchestra.run.smithi150.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T20:52:47.979 INFO:teuthology.orchestra.run.smithi150.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T20:52:47.981 INFO:teuthology.orchestra.run.smithi150.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T20:52:47.982 INFO:teuthology.orchestra.run.smithi150.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T20:52:48.047 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2024-09-10T20:52:48.067 INFO:teuthology.orchestra.run.smithi150.stdout:======================================================================================= 2024-09-10T20:52:48.067 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository Size 2024-09-10T20:52:48.067 INFO:teuthology.orchestra.run.smithi150.stdout:======================================================================================= 2024-09-10T20:52:48.067 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2024-09-10T20:52:48.067 INFO:teuthology.orchestra.run.smithi150.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T20:52:48.067 INFO:teuthology.orchestra.run.smithi150.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-10T20:52:48.067 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T20:52:48.068 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-10T20:52:48.068 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-10T20:52:48.068 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-10T20:52:48.068 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-10T20:52:48.068 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-10T20:52:48.068 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-10T20:52:48.068 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-10T20:52:48.068 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-10T20:52:48.068 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-10T20:52:48.068 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-10T20:52:48.068 INFO:teuthology.orchestra.run.smithi150.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-10T20:52:48.068 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-10T20:52:48.069 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-10T20:52:48.069 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-10T20:52:48.069 INFO:teuthology.orchestra.run.smithi150.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T20:52:48.069 INFO:teuthology.orchestra.run.smithi150.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T20:52:48.069 INFO:teuthology.orchestra.run.smithi150.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T20:52:48.069 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-10T20:52:48.069 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-10T20:52:48.069 INFO:teuthology.orchestra.run.smithi150.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-10T20:52:48.069 INFO:teuthology.orchestra.run.smithi150.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T20:52:48.069 INFO:teuthology.orchestra.run.smithi150.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T20:52:48.069 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T20:52:48.069 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T20:52:48.069 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T20:52:48.069 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T20:52:48.070 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-10T20:52:48.070 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-10T20:52:48.070 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-10T20:52:48.070 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-10T20:52:48.070 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-10T20:52:48.070 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T20:52:48.070 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-10T20:52:48.070 INFO:teuthology.orchestra.run.smithi150.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T20:52:48.070 INFO:teuthology.orchestra.run.smithi150.stdout:Upgrading: 2024-09-10T20:52:48.070 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T20:52:48.070 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T20:52:48.070 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T20:52:48.070 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T20:52:48.071 INFO:teuthology.orchestra.run.smithi150.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-10T20:52:48.071 INFO:teuthology.orchestra.run.smithi150.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T20:52:48.071 INFO:teuthology.orchestra.run.smithi150.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T20:52:48.071 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T20:52:48.071 INFO:teuthology.orchestra.run.smithi150.stdout:Installing dependencies: 2024-09-10T20:52:48.071 INFO:teuthology.orchestra.run.smithi150.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T20:52:48.071 INFO:teuthology.orchestra.run.smithi150.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T20:52:48.071 INFO:teuthology.orchestra.run.smithi150.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T20:52:48.071 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-10T20:52:48.071 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-10T20:52:48.071 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-10T20:52:48.071 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-10T20:52:48.071 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-10T20:52:48.071 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-10T20:52:48.072 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-10T20:52:48.072 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-10T20:52:48.072 INFO:teuthology.orchestra.run.smithi150.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T20:52:48.072 INFO:teuthology.orchestra.run.smithi150.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T20:52:48.072 INFO:teuthology.orchestra.run.smithi150.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T20:52:48.072 INFO:teuthology.orchestra.run.smithi150.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T20:52:48.072 INFO:teuthology.orchestra.run.smithi150.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T20:52:48.072 INFO:teuthology.orchestra.run.smithi150.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T20:52:48.072 INFO:teuthology.orchestra.run.smithi150.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T20:52:48.072 INFO:teuthology.orchestra.run.smithi150.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T20:52:48.072 INFO:teuthology.orchestra.run.smithi150.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-10T20:52:48.072 INFO:teuthology.orchestra.run.smithi150.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T20:52:48.072 INFO:teuthology.orchestra.run.smithi150.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-10T20:52:48.073 INFO:teuthology.orchestra.run.smithi150.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T20:52:48.073 INFO:teuthology.orchestra.run.smithi150.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T20:52:48.073 INFO:teuthology.orchestra.run.smithi150.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T20:52:48.073 INFO:teuthology.orchestra.run.smithi150.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T20:52:48.073 INFO:teuthology.orchestra.run.smithi150.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-10T20:52:48.073 INFO:teuthology.orchestra.run.smithi150.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T20:52:48.073 INFO:teuthology.orchestra.run.smithi150.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T20:52:48.073 INFO:teuthology.orchestra.run.smithi150.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T20:52:48.073 INFO:teuthology.orchestra.run.smithi150.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T20:52:48.073 INFO:teuthology.orchestra.run.smithi150.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T20:52:48.073 INFO:teuthology.orchestra.run.smithi150.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T20:52:48.073 INFO:teuthology.orchestra.run.smithi150.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T20:52:48.073 INFO:teuthology.orchestra.run.smithi150.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T20:52:48.073 INFO:teuthology.orchestra.run.smithi150.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T20:52:48.074 INFO:teuthology.orchestra.run.smithi150.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T20:52:48.074 INFO:teuthology.orchestra.run.smithi150.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T20:52:48.074 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T20:52:48.074 INFO:teuthology.orchestra.run.smithi150.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T20:52:48.074 INFO:teuthology.orchestra.run.smithi150.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T20:52:48.074 INFO:teuthology.orchestra.run.smithi150.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T20:52:48.074 INFO:teuthology.orchestra.run.smithi150.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T20:52:48.074 INFO:teuthology.orchestra.run.smithi150.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T20:52:48.074 INFO:teuthology.orchestra.run.smithi150.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T20:52:48.074 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T20:52:48.074 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-10T20:52:48.074 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-10T20:52:48.074 INFO:teuthology.orchestra.run.smithi150.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T20:52:48.075 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T20:52:48.075 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T20:52:48.075 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T20:52:48.075 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T20:52:48.075 INFO:teuthology.orchestra.run.smithi150.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T20:52:48.075 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T20:52:48.075 INFO:teuthology.orchestra.run.smithi150.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T20:52:48.075 INFO:teuthology.orchestra.run.smithi150.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T20:52:48.075 INFO:teuthology.orchestra.run.smithi150.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T20:52:48.075 INFO:teuthology.orchestra.run.smithi150.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T20:52:48.075 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T20:52:48.075 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T20:52:48.075 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T20:52:48.075 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T20:52:48.076 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T20:52:48.076 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T20:52:48.076 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T20:52:48.076 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T20:52:48.076 INFO:teuthology.orchestra.run.smithi150.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T20:52:48.076 INFO:teuthology.orchestra.run.smithi150.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T20:52:48.076 INFO:teuthology.orchestra.run.smithi150.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T20:52:48.076 INFO:teuthology.orchestra.run.smithi150.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T20:52:48.076 INFO:teuthology.orchestra.run.smithi150.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T20:52:48.076 INFO:teuthology.orchestra.run.smithi150.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T20:52:48.076 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T20:52:48.076 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T20:52:48.076 INFO:teuthology.orchestra.run.smithi150.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T20:52:48.077 INFO:teuthology.orchestra.run.smithi150.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T20:52:48.077 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T20:52:48.077 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T20:52:48.077 INFO:teuthology.orchestra.run.smithi150.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T20:52:48.077 INFO:teuthology.orchestra.run.smithi150.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T20:52:48.077 INFO:teuthology.orchestra.run.smithi150.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T20:52:48.077 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T20:52:48.077 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T20:52:48.077 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T20:52:48.077 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T20:52:48.077 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T20:52:48.077 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T20:52:48.077 INFO:teuthology.orchestra.run.smithi150.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T20:52:48.077 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T20:52:48.078 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T20:52:48.078 INFO:teuthology.orchestra.run.smithi150.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T20:52:48.078 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T20:52:48.078 INFO:teuthology.orchestra.run.smithi150.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T20:52:48.078 INFO:teuthology.orchestra.run.smithi150.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T20:52:48.078 INFO:teuthology.orchestra.run.smithi150.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T20:52:48.078 INFO:teuthology.orchestra.run.smithi150.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T20:52:48.078 INFO:teuthology.orchestra.run.smithi150.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T20:52:48.078 INFO:teuthology.orchestra.run.smithi150.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T20:52:48.078 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T20:52:48.078 INFO:teuthology.orchestra.run.smithi150.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T20:52:48.078 INFO:teuthology.orchestra.run.smithi150.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T20:52:48.078 INFO:teuthology.orchestra.run.smithi150.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T20:52:48.079 INFO:teuthology.orchestra.run.smithi150.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T20:52:48.079 INFO:teuthology.orchestra.run.smithi150.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T20:52:48.079 INFO:teuthology.orchestra.run.smithi150.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T20:52:48.079 INFO:teuthology.orchestra.run.smithi150.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T20:52:48.079 INFO:teuthology.orchestra.run.smithi150.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T20:52:48.079 INFO:teuthology.orchestra.run.smithi150.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T20:52:48.079 INFO:teuthology.orchestra.run.smithi150.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T20:52:48.079 INFO:teuthology.orchestra.run.smithi150.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T20:52:48.079 INFO:teuthology.orchestra.run.smithi150.stdout:Installing weak dependencies: 2024-09-10T20:52:48.079 INFO:teuthology.orchestra.run.smithi150.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T20:52:48.079 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:52:48.079 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2024-09-10T20:52:48.079 INFO:teuthology.orchestra.run.smithi150.stdout:======================================================================================= 2024-09-10T20:52:48.079 INFO:teuthology.orchestra.run.smithi150.stdout:Install 149 Packages 2024-09-10T20:52:48.080 INFO:teuthology.orchestra.run.smithi150.stdout:Upgrade 8 Packages 2024-09-10T20:52:48.080 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:52:48.080 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 240 M 2024-09-10T20:52:48.080 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2024-09-10T20:52:49.010 INFO:teuthology.orchestra.run.smithi006.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 858 kB/s | 900 kB 00:01 2024-09-10T20:52:49.185 INFO:teuthology.orchestra.run.smithi006.stdout:(3/157): ceph-immutable-object-cache-19.3.0-485 828 kB/s | 145 kB 00:00 2024-09-10T20:52:49.219 INFO:teuthology.orchestra.run.smithi150.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 20 kB/s | 6.6 kB 00:00 2024-09-10T20:52:50.361 INFO:teuthology.orchestra.run.smithi150.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 789 kB/s | 900 kB 00:01 2024-09-10T20:52:50.468 INFO:teuthology.orchestra.run.smithi006.stdout:(4/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 1.9 MB/s | 2.4 MB 00:01 2024-09-10T20:52:50.511 INFO:teuthology.orchestra.run.smithi150.stdout:(3/157): ceph-immutable-object-cache-19.3.0-485 968 kB/s | 145 kB 00:00 2024-09-10T20:52:50.868 INFO:teuthology.orchestra.run.smithi006.stdout:(5/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 1.7 MB/s | 5.5 MB 00:03 2024-09-10T20:52:50.994 INFO:teuthology.orchestra.run.smithi006.stdout:(6/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 2.9 MB/s | 1.5 MB 00:00 2024-09-10T20:52:51.853 INFO:teuthology.orchestra.run.smithi150.stdout:(4/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 1.8 MB/s | 2.4 MB 00:01 2024-09-10T20:52:51.902 INFO:teuthology.orchestra.run.smithi006.stdout:(7/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 4.6 MB/s | 4.8 MB 00:01 2024-09-10T20:52:52.695 INFO:teuthology.orchestra.run.smithi150.stdout:(5/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 1.8 MB/s | 1.5 MB 00:00 2024-09-10T20:52:54.019 INFO:teuthology.orchestra.run.smithi006.stdout:(8/157): ceph-common-19.3.0-4854.g8f219c47.el9. 3.4 MB/s | 22 MB 00:06 2024-09-10T20:52:54.136 INFO:teuthology.orchestra.run.smithi006.stdout:(9/157): ceph-selinux-19.3.0-4854.g8f219c47.el9 216 kB/s | 25 kB 00:00 2024-09-10T20:52:54.253 INFO:teuthology.orchestra.run.smithi006.stdout:(10/157): ceph-radosgw-19.3.0-4854.g8f219c47.el 4.7 MB/s | 11 MB 00:02 2024-09-10T20:52:54.384 INFO:teuthology.orchestra.run.smithi006.stdout:(11/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 1.7 MB/s | 225 kB 00:00 2024-09-10T20:52:54.503 INFO:teuthology.orchestra.run.smithi006.stdout:(12/157): cephfs-shell-19.3.0-4854.g8f219c47.el 228 kB/s | 27 kB 00:00 2024-09-10T20:52:54.620 INFO:teuthology.orchestra.run.smithi006.stdout:(13/157): libcephfs-devel-19.3.0-4854.g8f219c47 272 kB/s | 32 kB 00:00 2024-09-10T20:52:54.720 INFO:teuthology.orchestra.run.smithi150.stdout:(6/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 2.4 MB/s | 4.8 MB 00:02 2024-09-10T20:52:54.745 INFO:teuthology.orchestra.run.smithi006.stdout:(14/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 5.9 MB/s | 755 kB 00:00 2024-09-10T20:52:54.988 INFO:teuthology.orchestra.run.smithi006.stdout:(15/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x8 4.3 MB/s | 17 MB 00:03 2024-09-10T20:52:55.013 INFO:teuthology.orchestra.run.smithi006.stdout:(16/157): libcephsqlite-19.3.0-4854.g8f219c47.e 605 kB/s | 162 kB 00:00 2024-09-10T20:52:55.054 INFO:teuthology.orchestra.run.smithi006.stdout:(17/157): librados-devel-19.3.0-4854.g8f219c47. 1.9 MB/s | 127 kB 00:00 2024-09-10T20:52:55.155 INFO:teuthology.orchestra.run.smithi006.stdout:(18/157): libradosstriper1-19.3.0-4854.g8f219c4 3.5 MB/s | 507 kB 00:00 2024-09-10T20:52:55.239 INFO:teuthology.orchestra.run.smithi006.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 542 kB/s | 45 kB 00:00 2024-09-10T20:52:55.345 INFO:teuthology.orchestra.run.smithi006.stdout:(20/157): python3-ceph-common-19.3.0-4854.g8f21 1.3 MB/s | 143 kB 00:00 2024-09-10T20:52:55.489 INFO:teuthology.orchestra.run.smithi006.stdout:(21/157): python3-cephfs-19.3.0-4854.g8f219c47. 1.1 MB/s | 161 kB 00:00 2024-09-10T20:52:55.639 INFO:teuthology.orchestra.run.smithi006.stdout:(22/157): python3-rados-19.3.0-4854.g8f219c47.e 2.1 MB/s | 321 kB 00:00 2024-09-10T20:52:55.739 INFO:teuthology.orchestra.run.smithi006.stdout:(23/157): python3-rbd-19.3.0-4854.g8f219c47.el9 3.0 MB/s | 306 kB 00:00 2024-09-10T20:52:55.848 INFO:teuthology.orchestra.run.smithi006.stdout:(24/157): python3-rgw-19.3.0-4854.g8f219c47.el9 919 kB/s | 99 kB 00:00 2024-09-10T20:52:55.949 INFO:teuthology.orchestra.run.smithi006.stdout:(25/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 851 kB/s | 85 kB 00:00 2024-09-10T20:52:56.115 INFO:teuthology.orchestra.run.smithi006.stdout:(26/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 5.2 MB/s | 5.5 MB 00:01 2024-09-10T20:52:56.215 INFO:teuthology.orchestra.run.smithi006.stdout:(27/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 1.7 MB/s | 171 kB 00:00 2024-09-10T20:52:56.324 INFO:teuthology.orchestra.run.smithi006.stdout:(28/157): ceph-grafana-dashboards-19.3.0-4854.g 315 kB/s | 34 kB 00:00 2024-09-10T20:52:56.416 INFO:teuthology.orchestra.run.smithi006.stdout:(29/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 1.6 MB/s | 154 kB 00:00 2024-09-10T20:52:56.470 INFO:teuthology.orchestra.run.smithi150.stdout:(7/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 744 kB/s | 5.5 MB 00:07 2024-09-10T20:52:56.742 INFO:teuthology.orchestra.run.smithi006.stdout:(30/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 4.0 MB/s | 3.2 MB 00:00 2024-09-10T20:52:58.461 INFO:teuthology.orchestra.run.smithi006.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 4.3 MB/s | 7.4 MB 00:01 2024-09-10T20:52:58.567 INFO:teuthology.orchestra.run.smithi006.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4854.g8f 2.7 MB/s | 291 kB 00:00 2024-09-10T20:52:58.676 INFO:teuthology.orchestra.run.smithi006.stdout:(33/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 456 kB/s | 49 kB 00:00 2024-09-10T20:52:58.793 INFO:teuthology.orchestra.run.smithi006.stdout:(34/157): ceph-prometheus-alerts-19.3.0-4854.g8 141 kB/s | 16 kB 00:00 2024-09-10T20:52:59.401 INFO:teuthology.orchestra.run.smithi006.stdout:(35/157): ceph-volume-19.3.0-4854.g8f219c47.el9 469 kB/s | 285 kB 00:00 2024-09-10T20:52:59.785 INFO:teuthology.orchestra.run.smithi006.stdout:(36/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 4.2 MB/s | 14 MB 00:03 2024-09-10T20:52:59.819 INFO:teuthology.orchestra.run.smithi006.stdout:(37/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 1.8 MB/s | 783 kB 00:00 2024-09-10T20:52:59.894 INFO:teuthology.orchestra.run.smithi006.stdout:(38/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 168 kB/s | 18 kB 00:00 2024-09-10T20:52:59.919 INFO:teuthology.orchestra.run.smithi006.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 801 kB/s | 80 kB 00:00 2024-09-10T20:52:59.986 INFO:teuthology.orchestra.run.smithi006.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-10T20:53:00.037 INFO:teuthology.orchestra.run.smithi006.stdout:(41/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.0 MB/s | 253 kB 00:00 2024-09-10T20:53:00.095 INFO:teuthology.orchestra.run.smithi006.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 3.9 MB/s | 801 kB 00:00 2024-09-10T20:53:00.162 INFO:teuthology.orchestra.run.smithi006.stdout:(43/157): python3-cryptography-36.0.1-4.el9.x86 9.8 MB/s | 1.2 MB 00:00 2024-09-10T20:53:00.187 INFO:teuthology.orchestra.run.smithi006.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 106 kB 00:00 2024-09-10T20:53:00.212 INFO:teuthology.orchestra.run.smithi006.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-10T20:53:00.246 INFO:teuthology.orchestra.run.smithi006.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-10T20:53:00.271 INFO:teuthology.orchestra.run.smithi006.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-10T20:53:00.536 INFO:teuthology.orchestra.run.smithi150.stdout:(8/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x86 3.0 MB/s | 17 MB 00:05 2024-09-10T20:53:00.628 INFO:teuthology.orchestra.run.smithi150.stdout:(9/157): ceph-selinux-19.3.0-4854.g8f219c47.el9 276 kB/s | 25 kB 00:00 2024-09-10T20:53:01.147 INFO:teuthology.orchestra.run.smithi006.stdout:(48/157): automake-1.16.2-8.el9.noarch.rpm 765 kB/s | 689 kB 00:00 2024-09-10T20:53:01.180 INFO:teuthology.orchestra.run.smithi006.stdout:(49/157): bison-3.7.4-5.el9.x86_64.rpm 1.0 MB/s | 943 kB 00:00 2024-09-10T20:53:01.772 INFO:teuthology.orchestra.run.smithi006.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 37 kB/s | 22 kB 00:00 2024-09-10T20:53:02.298 INFO:teuthology.orchestra.run.smithi006.stdout:(51/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 6.2 MB/s | 50 MB 00:08 2024-09-10T20:53:02.323 INFO:teuthology.orchestra.run.smithi006.stdout:(52/157): boost-program-options-1.75.0-8.el9.x8 91 kB/s | 107 kB 00:01 2024-09-10T20:53:02.882 INFO:teuthology.orchestra.run.smithi006.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 56 kB/s | 33 kB 00:00 2024-09-10T20:53:03.007 INFO:teuthology.orchestra.run.smithi006.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 254 kB/s | 313 kB 00:01 2024-09-10T20:53:03.382 INFO:teuthology.orchestra.run.smithi006.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 36 kB/s | 18 kB 00:00 2024-09-10T20:53:03.520 INFO:teuthology.orchestra.run.smithi150.stdout:(10/157): ceph-common-19.3.0-4854.g8f219c47.el9 1.5 MB/s | 22 MB 00:14 2024-09-10T20:53:03.541 INFO:teuthology.orchestra.run.smithi006.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 21 kB/s | 11 kB 00:00 2024-09-10T20:53:03.645 INFO:teuthology.orchestra.run.smithi150.stdout:(11/157): ceph-radosgw-19.3.0-4854.g8f219c47.el 1.5 MB/s | 11 MB 00:07 2024-09-10T20:53:03.712 INFO:teuthology.orchestra.run.smithi150.stdout:(12/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 1.1 MB/s | 225 kB 00:00 2024-09-10T20:53:03.737 INFO:teuthology.orchestra.run.smithi150.stdout:(13/157): cephfs-shell-19.3.0-4854.g8f219c47.el 296 kB/s | 27 kB 00:00 2024-09-10T20:53:03.779 INFO:teuthology.orchestra.run.smithi150.stdout:(14/157): libcephfs-devel-19.3.0-4854.g8f219c47 477 kB/s | 32 kB 00:00 2024-09-10T20:53:03.896 INFO:teuthology.orchestra.run.smithi150.stdout:(15/157): libcephsqlite-19.3.0-4854.g8f219c47.e 1.4 MB/s | 162 kB 00:00 2024-09-10T20:53:03.908 INFO:teuthology.orchestra.run.smithi006.stdout:(57/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 1.9 MB/s | 3.0 MB 00:01 2024-09-10T20:53:03.972 INFO:teuthology.orchestra.run.smithi150.stdout:(16/157): librados-devel-19.3.0-4854.g8f219c47. 1.6 MB/s | 127 kB 00:00 2024-09-10T20:53:04.088 INFO:teuthology.orchestra.run.smithi150.stdout:(17/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 2.1 MB/s | 755 kB 00:00 2024-09-10T20:53:04.147 INFO:teuthology.orchestra.run.smithi150.stdout:(18/157): libradosstriper1-19.3.0-4854.g8f219c4 2.8 MB/s | 507 kB 00:00 2024-09-10T20:53:04.191 INFO:teuthology.orchestra.run.smithi006.stdout:(58/157): libnbd-1.20.2-2.el9.x86_64.rpm 211 kB/s | 171 kB 00:00 2024-09-10T20:53:04.214 INFO:teuthology.orchestra.run.smithi150.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 679 kB/s | 45 kB 00:00 2024-09-10T20:53:04.392 INFO:teuthology.orchestra.run.smithi006.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 188 kB/s | 160 kB 00:00 2024-09-10T20:53:04.431 INFO:teuthology.orchestra.run.smithi150.stdout:(20/157): python3-ceph-common-19.3.0-4854.g8f21 661 kB/s | 143 kB 00:00 2024-09-10T20:53:04.517 INFO:teuthology.orchestra.run.smithi006.stdout:(60/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 74 kB/s | 45 kB 00:00 2024-09-10T20:53:04.548 INFO:teuthology.orchestra.run.smithi150.stdout:(21/157): python3-cephfs-19.3.0-4854.g8f219c47. 1.4 MB/s | 161 kB 00:00 2024-09-10T20:53:04.723 INFO:teuthology.orchestra.run.smithi150.stdout:(22/157): python3-rados-19.3.0-4854.g8f219c47.e 1.8 MB/s | 321 kB 00:00 2024-09-10T20:53:04.899 INFO:teuthology.orchestra.run.smithi150.stdout:(23/157): python3-rbd-19.3.0-4854.g8f219c47.el9 1.7 MB/s | 306 kB 00:00 2024-09-10T20:53:04.957 INFO:teuthology.orchestra.run.smithi150.stdout:(24/157): python3-rgw-19.3.0-4854.g8f219c47.el9 1.7 MB/s | 99 kB 00:00 2024-09-10T20:53:05.024 INFO:teuthology.orchestra.run.smithi150.stdout:(25/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 1.2 MB/s | 85 kB 00:00 2024-09-10T20:53:05.084 INFO:teuthology.orchestra.run.smithi006.stdout:(61/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 43 kB/s | 24 kB 00:00 2024-09-10T20:53:05.151 INFO:teuthology.orchestra.run.smithi006.stdout:(62/157): librdkafka-1.6.1-102.el9.x86_64.rpm 691 kB/s | 662 kB 00:00 2024-09-10T20:53:05.676 INFO:teuthology.orchestra.run.smithi006.stdout:(63/157): libtool-2.4.6-46.el9.x86_64.rpm 453 kB/s | 581 kB 00:01 2024-09-10T20:53:05.726 INFO:teuthology.orchestra.run.smithi006.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 74 kB/s | 47 kB 00:00 2024-09-10T20:53:05.891 INFO:teuthology.orchestra.run.smithi150.stdout:(26/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 3.1 MB/s | 5.5 MB 00:01 2024-09-10T20:53:05.991 INFO:teuthology.orchestra.run.smithi150.stdout:(27/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 3.3 MB/s | 3.2 MB 00:00 2024-09-10T20:53:06.017 INFO:teuthology.orchestra.run.smithi150.stdout:(28/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 1.3 MB/s | 171 kB 00:00 2024-09-10T20:53:06.018 INFO:teuthology.orchestra.run.smithi006.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 337 kB/s | 292 kB 00:00 2024-09-10T20:53:06.075 INFO:teuthology.orchestra.run.smithi150.stdout:(29/157): ceph-grafana-dashboards-19.3.0-4854.g 410 kB/s | 34 kB 00:00 2024-09-10T20:53:06.126 INFO:teuthology.orchestra.run.smithi150.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 1.4 MB/s | 154 kB 00:00 2024-09-10T20:53:06.318 INFO:teuthology.orchestra.run.smithi006.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 65 kB/s | 38 kB 00:00 2024-09-10T20:53:06.460 INFO:teuthology.orchestra.run.smithi006.stdout:(67/157): lua-5.4.4-4.el9.x86_64.rpm 241 kB/s | 188 kB 00:00 2024-09-10T20:53:07.309 INFO:teuthology.orchestra.run.smithi150.stdout:(31/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 7.5 MB/s | 50 MB 00:06 2024-09-10T20:53:07.377 INFO:teuthology.orchestra.run.smithi006.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 3.6 MB/s | 4.9 MB 00:01 2024-09-10T20:53:07.426 INFO:teuthology.orchestra.run.smithi150.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4854.g8f 2.4 MB/s | 291 kB 00:00 2024-09-10T20:53:07.510 INFO:teuthology.orchestra.run.smithi150.stdout:(33/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 591 kB/s | 49 kB 00:00 2024-09-10T20:53:07.602 INFO:teuthology.orchestra.run.smithi150.stdout:(34/157): ceph-prometheus-alerts-19.3.0-4854.g8 180 kB/s | 16 kB 00:00 2024-09-10T20:53:07.653 INFO:teuthology.orchestra.run.smithi006.stdout:(69/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.3 MB/s | 4.4 MB 00:01 2024-09-10T20:53:07.685 INFO:teuthology.orchestra.run.smithi150.stdout:(35/157): ceph-volume-19.3.0-4854.g8f219c47.el9 3.3 MB/s | 285 kB 00:00 2024-09-10T20:53:07.827 INFO:teuthology.orchestra.run.smithi150.stdout:(36/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 5.4 MB/s | 783 kB 00:00 2024-09-10T20:53:07.919 INFO:teuthology.orchestra.run.smithi150.stdout:(37/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 200 kB/s | 18 kB 00:00 2024-09-10T20:53:08.028 INFO:teuthology.orchestra.run.smithi150.stdout:(38/157): ceph-mgr-diskprediction-local-19.3.0- 3.9 MB/s | 7.4 MB 00:01 2024-09-10T20:53:08.212 INFO:teuthology.orchestra.run.smithi150.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 273 kB/s | 80 kB 00:00 2024-09-10T20:53:08.361 INFO:teuthology.orchestra.run.smithi006.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 197 kB/s | 137 kB 00:00 2024-09-10T20:53:08.378 INFO:teuthology.orchestra.run.smithi150.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 191 kB 00:00 2024-09-10T20:53:08.554 INFO:teuthology.orchestra.run.smithi150.stdout:(41/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.4 MB/s | 253 kB 00:00 2024-09-10T20:53:08.588 INFO:teuthology.orchestra.run.smithi150.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 801 kB 00:00 2024-09-10T20:53:08.655 INFO:teuthology.orchestra.run.smithi150.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-09-10T20:53:08.763 INFO:teuthology.orchestra.run.smithi150.stdout:(44/157): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-09-10T20:53:08.803 INFO:teuthology.orchestra.run.smithi006.stdout:(71/157): postgresql-contrib-13.16-1.el9.x86_64 638 kB/s | 910 kB 00:01 2024-09-10T20:53:08.830 INFO:teuthology.orchestra.run.smithi150.stdout:(45/157): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-09-10T20:53:08.845 INFO:teuthology.orchestra.run.smithi006.stdout:(72/157): postgresql-13.16-1.el9.x86_64.rpm 681 kB/s | 1.6 MB 00:02 2024-09-10T20:53:09.022 INFO:teuthology.orchestra.run.smithi150.stdout:(46/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 4.8 MB/s | 14 MB 00:02 2024-09-10T20:53:09.047 INFO:teuthology.orchestra.run.smithi150.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 990 kB/s | 215 kB 00:00 2024-09-10T20:53:09.258 INFO:teuthology.orchestra.run.smithi150.stdout:(48/157): python3-cryptography-36.0.1-4.el9.x86 1.7 MB/s | 1.2 MB 00:00 2024-09-10T20:53:09.356 INFO:teuthology.orchestra.run.smithi150.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 1.1 MB/s | 107 kB 00:00 2024-09-10T20:53:09.398 INFO:teuthology.orchestra.run.smithi150.stdout:(50/157): automake-1.16.2-8.el9.noarch.rpm 1.8 MB/s | 689 kB 00:00 2024-09-10T20:53:09.424 INFO:teuthology.orchestra.run.smithi150.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 324 kB/s | 22 kB 00:00 2024-09-10T20:53:09.465 INFO:teuthology.orchestra.run.smithi150.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 2.2 MB/s | 943 kB 00:00 2024-09-10T20:53:09.493 INFO:teuthology.orchestra.run.smithi150.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 490 kB/s | 33 kB 00:00 2024-09-10T20:53:09.503 INFO:teuthology.orchestra.run.smithi006.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 133 kB/s | 87 kB 00:00 2024-09-10T20:53:09.533 INFO:teuthology.orchestra.run.smithi150.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 2.3 MB/s | 313 kB 00:00 2024-09-10T20:53:09.558 INFO:teuthology.orchestra.run.smithi150.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 272 kB/s | 18 kB 00:00 2024-09-10T20:53:09.608 INFO:teuthology.orchestra.run.smithi150.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 148 kB/s | 11 kB 00:00 2024-09-10T20:53:09.675 INFO:teuthology.orchestra.run.smithi150.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.4 MB/s | 171 kB 00:00 2024-09-10T20:53:09.734 INFO:teuthology.orchestra.run.smithi150.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-10T20:53:09.754 INFO:teuthology.orchestra.run.smithi006.stdout:(74/157): postgresql-server-13.16-1.el9.x86_64. 4.1 MB/s | 5.8 MB 00:01 2024-09-10T20:53:09.759 INFO:teuthology.orchestra.run.smithi150.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 544 kB/s | 45 kB 00:00 2024-09-10T20:53:09.804 INFO:teuthology.orchestra.run.smithi006.stdout:(75/157): protobuf-3.14.0-13.el9.x86_64.rpm 1.0 MB/s | 1.0 MB 00:00 2024-09-10T20:53:09.993 INFO:teuthology.orchestra.run.smithi150.stdout:(60/157): libtool-2.4.6-46.el9.x86_64.rpm 2.4 MB/s | 581 kB 00:00 2024-09-10T20:53:10.035 INFO:teuthology.orchestra.run.smithi150.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 2.2 MB/s | 662 kB 00:00 2024-09-10T20:53:10.060 INFO:teuthology.orchestra.run.smithi150.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 366 kB/s | 24 kB 00:00 2024-09-10T20:53:10.085 INFO:teuthology.orchestra.run.smithi150.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 950 kB/s | 47 kB 00:00 2024-09-10T20:53:10.163 INFO:teuthology.orchestra.run.smithi150.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-10T20:53:10.194 INFO:teuthology.orchestra.run.smithi150.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-09-10T20:53:10.219 INFO:teuthology.orchestra.run.smithi150.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 693 kB/s | 38 kB 00:00 2024-09-10T20:53:10.361 INFO:teuthology.orchestra.run.smithi150.stdout:(67/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.3 MB/s | 3.0 MB 00:00 2024-09-10T20:53:10.404 INFO:teuthology.orchestra.run.smithi006.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 96 kB/s | 61 kB 00:00 2024-09-10T20:53:10.646 INFO:teuthology.orchestra.run.smithi006.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 291 kB/s | 245 kB 00:00 2024-09-10T20:53:10.678 INFO:teuthology.orchestra.run.smithi150.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 5.0 MB/s | 1.6 MB 00:00 2024-09-10T20:53:10.738 INFO:teuthology.orchestra.run.smithi006.stdout:(78/157): python3-babel-2.9.1-2.el9.noarch.rpm 4.8 MB/s | 6.0 MB 00:01 2024-09-10T20:53:10.879 INFO:teuthology.orchestra.run.smithi150.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 4.4 MB/s | 910 kB 00:00 2024-09-10T20:53:11.021 INFO:teuthology.orchestra.run.smithi150.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 970 kB/s | 137 kB 00:00 2024-09-10T20:53:11.113 INFO:teuthology.orchestra.run.smithi150.stdout:(71/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 5.0 MB/s | 4.4 MB 00:00 2024-09-10T20:53:11.230 INFO:teuthology.orchestra.run.smithi006.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 45 kB/s | 26 kB 00:00 2024-09-10T20:53:11.280 INFO:teuthology.orchestra.run.smithi150.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 6.1 MB/s | 1.0 MB 00:00 2024-09-10T20:53:11.280 INFO:teuthology.orchestra.run.smithi006.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 35 kB/s | 19 kB 00:00 2024-09-10T20:53:11.331 INFO:teuthology.orchestra.run.smithi006.stdout:(81/157): python3-jinja2-2.11.3-6.el9.noarch.rp 268 kB/s | 248 kB 00:00 2024-09-10T20:53:11.338 INFO:teuthology.orchestra.run.smithi150.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-10T20:53:11.464 INFO:teuthology.orchestra.run.smithi150.stdout:(74/157): openblas-openmp-0.3.26-2.el9.x86_64.r 3.9 MB/s | 4.9 MB 00:01 2024-09-10T20:53:11.530 INFO:teuthology.orchestra.run.smithi150.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 926 kB/s | 61 kB 00:00 2024-09-10T20:53:11.623 INFO:teuthology.orchestra.run.smithi150.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.6 MB/s | 245 kB 00:00 2024-09-10T20:53:11.723 INFO:teuthology.orchestra.run.smithi150.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-09-10T20:53:11.831 INFO:teuthology.orchestra.run.smithi150.stdout:(78/157): postgresql-server-13.16-1.el9.x86_64. 7.1 MB/s | 5.8 MB 00:00 2024-09-10T20:53:11.856 INFO:teuthology.orchestra.run.smithi150.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 192 kB/s | 26 kB 00:00 2024-09-10T20:53:11.857 INFO:teuthology.orchestra.run.smithi006.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 60 kB/s | 35 kB 00:00 2024-09-10T20:53:11.882 INFO:teuthology.orchestra.run.smithi150.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 384 kB/s | 19 kB 00:00 2024-09-10T20:53:11.915 INFO:teuthology.orchestra.run.smithi150.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-10T20:53:11.966 INFO:teuthology.orchestra.run.smithi150.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 416 kB/s | 35 kB 00:00 2024-09-10T20:53:12.040 INFO:teuthology.orchestra.run.smithi006.stdout:(83/157): python3-mako-1.1.4-6.el9.noarch.rpm 213 kB/s | 172 kB 00:00 2024-09-10T20:53:12.041 INFO:teuthology.orchestra.run.smithi150.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.3 MB/s | 250 kB 00:00 2024-09-10T20:53:12.116 INFO:teuthology.orchestra.run.smithi150.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 2.9 MB/s | 222 kB 00:00 2024-09-10T20:53:12.192 INFO:teuthology.orchestra.run.smithi150.stdout:(85/157): python3-babel-2.9.1-2.el9.noarch.rpm 7.0 MB/s | 6.0 MB 00:00 2024-09-10T20:53:12.217 INFO:teuthology.orchestra.run.smithi150.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 771 kB/s | 77 kB 00:00 2024-09-10T20:53:12.250 INFO:teuthology.orchestra.run.smithi150.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 728 kB/s | 42 kB 00:00 2024-09-10T20:53:12.284 INFO:teuthology.orchestra.run.smithi150.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 3.9 MB/s | 269 kB 00:00 2024-09-10T20:53:12.309 INFO:teuthology.orchestra.run.smithi150.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-09-10T20:53:12.344 INFO:teuthology.orchestra.run.smithi150.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-09-10T20:53:12.368 INFO:teuthology.orchestra.run.smithi150.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 872 kB/s | 51 kB 00:00 2024-09-10T20:53:12.444 INFO:teuthology.orchestra.run.smithi150.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 536 kB/s | 54 kB 00:00 2024-09-10T20:53:12.502 INFO:teuthology.orchestra.run.smithi150.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 716 kB/s | 42 kB 00:00 2024-09-10T20:53:12.594 INFO:teuthology.orchestra.run.smithi150.stdout:(94/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 484 kB/s | 44 kB 00:00 2024-09-10T20:53:12.673 INFO:teuthology.orchestra.run.smithi006.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 307 kB/s | 250 kB 00:00 2024-09-10T20:53:12.702 INFO:teuthology.orchestra.run.smithi150.stdout:(95/157): qatlib-24.02.0-1.el9.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-09-10T20:53:12.774 INFO:teuthology.orchestra.run.smithi006.stdout:(85/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.5 MB/s | 5.1 MB 00:01 2024-09-10T20:53:12.778 INFO:teuthology.orchestra.run.smithi150.stdout:(96/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.9 MB/s | 5.1 MB 00:00 2024-09-10T20:53:12.803 INFO:teuthology.orchestra.run.smithi150.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 358 kB/s | 36 kB 00:00 2024-09-10T20:53:12.824 INFO:teuthology.orchestra.run.smithi006.stdout:(86/157): python3-oauthlib-3.1.1-5.el9.noarch.r 284 kB/s | 222 kB 00:00 2024-09-10T20:53:12.878 INFO:teuthology.orchestra.run.smithi150.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 474 kB/s | 47 kB 00:00 2024-09-10T20:53:12.954 INFO:teuthology.orchestra.run.smithi150.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 2.0 MB/s | 304 kB 00:00 2024-09-10T20:53:12.987 INFO:teuthology.orchestra.run.smithi150.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 533 kB/s | 58 kB 00:00 2024-09-10T20:53:13.046 INFO:teuthology.orchestra.run.smithi150.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.0 MB/s | 96 kB 00:00 2024-09-10T20:53:13.071 INFO:teuthology.orchestra.run.smithi150.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 761 kB/s | 64 kB 00:00 2024-09-10T20:53:13.122 INFO:teuthology.orchestra.run.smithi150.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 598 kB/s | 45 kB 00:00 2024-09-10T20:53:13.180 INFO:teuthology.orchestra.run.smithi150.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 206 kB/s | 22 kB 00:00 2024-09-10T20:53:13.272 INFO:teuthology.orchestra.run.smithi150.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 5.9 MB/s | 548 kB 00:00 2024-09-10T20:53:13.331 INFO:teuthology.orchestra.run.smithi150.stdout:(106/157): protobuf-compiler-3.14.0-13.el9.x86_ 4.0 MB/s | 863 kB 00:00 2024-09-10T20:53:13.332 INFO:teuthology.orchestra.run.smithi006.stdout:(87/157): python3-packaging-20.9-5.el9.noarch.r 117 kB/s | 77 kB 00:00 2024-09-10T20:53:13.381 INFO:teuthology.orchestra.run.smithi150.stdout:(107/157): gperftools-libs-2.9.1-2.el9.x86_64.r 2.8 MB/s | 309 kB 00:00 2024-09-10T20:53:13.407 INFO:teuthology.orchestra.run.smithi006.stdout:(88/157): python3-prettytable-0.7.2-27.el9.noar 67 kB/s | 42 kB 00:00 2024-09-10T20:53:13.415 INFO:teuthology.orchestra.run.smithi150.stdout:(108/157): grpc-data-1.46.7-10.el9.noarch.rpm 234 kB/s | 19 kB 00:00 2024-09-10T20:53:13.440 INFO:teuthology.orchestra.run.smithi150.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-10T20:53:13.474 INFO:teuthology.orchestra.run.smithi150.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-10T20:53:13.507 INFO:teuthology.orchestra.run.smithi150.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-10T20:53:13.541 INFO:teuthology.orchestra.run.smithi150.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-10T20:53:13.616 INFO:teuthology.orchestra.run.smithi150.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-10T20:53:13.683 INFO:teuthology.orchestra.run.smithi006.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 314 kB/s | 269 kB 00:00 2024-09-10T20:53:13.683 INFO:teuthology.orchestra.run.smithi150.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 8.1 MB/s | 548 kB 00:00 2024-09-10T20:53:13.708 INFO:teuthology.orchestra.run.smithi150.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-10T20:53:13.734 INFO:teuthology.orchestra.run.smithi150.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-10T20:53:13.751 INFO:teuthology.orchestra.run.smithi150.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 861 kB/s | 14 kB 00:00 2024-09-10T20:53:13.810 INFO:teuthology.orchestra.run.smithi150.stdout:(118/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-10T20:53:13.876 INFO:teuthology.orchestra.run.smithi150.stdout:(119/157): libarrow-9.0.0-11.el9.x86_64.rpm 9.0 MB/s | 4.4 MB 00:00 2024-09-10T20:53:13.910 INFO:teuthology.orchestra.run.smithi150.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 3.5 MB/s | 358 kB 00:00 2024-09-10T20:53:13.943 INFO:teuthology.orchestra.run.smithi150.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-09-10T20:53:13.969 INFO:teuthology.orchestra.run.smithi150.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-10T20:53:14.011 INFO:teuthology.orchestra.run.smithi150.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 3.4 MB/s | 144 kB 00:00 2024-09-10T20:53:14.036 INFO:teuthology.orchestra.run.smithi150.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 430 kB/s | 11 kB 00:00 2024-09-10T20:53:14.061 INFO:teuthology.orchestra.run.smithi150.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 714 kB/s | 18 kB 00:00 2024-09-10T20:53:14.066 INFO:teuthology.orchestra.run.smithi006.stdout:(90/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 216 kB/s | 159 kB 00:00 2024-09-10T20:53:14.087 INFO:teuthology.orchestra.run.smithi150.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 940 kB/s | 23 kB 00:00 2024-09-10T20:53:14.112 INFO:teuthology.orchestra.run.smithi150.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 790 kB/s | 19 kB 00:00 2024-09-10T20:53:14.129 INFO:teuthology.orchestra.run.smithi150.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 1.2 MB/s | 20 kB 00:00 2024-09-10T20:53:14.188 INFO:teuthology.orchestra.run.smithi150.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 8.4 MB/s | 2.0 MB 00:00 2024-09-10T20:53:14.254 INFO:teuthology.orchestra.run.smithi150.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 706 kB/s | 46 kB 00:00 2024-09-10T20:53:14.288 INFO:teuthology.orchestra.run.smithi150.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-10T20:53:14.308 INFO:teuthology.orchestra.run.smithi006.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 82 kB/s | 51 kB 00:00 2024-09-10T20:53:14.313 INFO:teuthology.orchestra.run.smithi150.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-10T20:53:14.350 INFO:teuthology.orchestra.run.smithi006.stdout:(92/157): python3-pyasn1-modules-0.4.8-6.el9.no 296 kB/s | 279 kB 00:00 2024-09-10T20:53:14.356 INFO:teuthology.orchestra.run.smithi150.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 4.5 MB/s | 1.0 MB 00:00 2024-09-10T20:53:14.381 INFO:teuthology.orchestra.run.smithi150.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 668 kB/s | 16 kB 00:00 2024-09-10T20:53:14.406 INFO:teuthology.orchestra.run.smithi150.stdout:(135/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-09-10T20:53:14.440 INFO:teuthology.orchestra.run.smithi150.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 841 kB/s | 28 kB 00:00 2024-09-10T20:53:14.465 INFO:teuthology.orchestra.run.smithi150.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-09-10T20:53:14.491 INFO:teuthology.orchestra.run.smithi150.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-10T20:53:14.516 INFO:teuthology.orchestra.run.smithi150.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-10T20:53:14.550 INFO:teuthology.orchestra.run.smithi150.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-09-10T20:53:14.575 INFO:teuthology.orchestra.run.smithi150.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 610 kB/s | 36 kB 00:00 2024-09-10T20:53:14.600 INFO:teuthology.orchestra.run.smithi150.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-10T20:53:14.626 INFO:teuthology.orchestra.run.smithi150.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-10T20:53:14.651 INFO:teuthology.orchestra.run.smithi150.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-10T20:53:14.705 INFO:teuthology.orchestra.run.smithi150.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 375 kB/s | 20 kB 00:00 2024-09-10T20:53:14.752 INFO:teuthology.orchestra.run.smithi150.stdout:(146/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-10T20:53:14.775 INFO:teuthology.orchestra.run.smithi006.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 76 kB/s | 54 kB 00:00 2024-09-10T20:53:14.927 INFO:teuthology.orchestra.run.smithi150.stdout:(147/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.4 MB/s | 16 MB 00:02 2024-09-10T20:53:14.952 INFO:teuthology.orchestra.run.smithi150.stdout:(148/157): re2-20211101-20.el9.x86_64.rpm 775 kB/s | 191 kB 00:00 2024-09-10T20:53:15.018 INFO:teuthology.orchestra.run.smithi006.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 62 kB/s | 42 kB 00:00 2024-09-10T20:53:15.028 INFO:teuthology.orchestra.run.smithi150.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 5.7 MB/s | 1.6 MB 00:00 2024-09-10T20:53:15.328 INFO:teuthology.orchestra.run.smithi150.stdout:(150/157): NetworkManager-1.49.90-1.el9.x86_64. 7.7 MB/s | 2.3 MB 00:00 2024-09-10T20:53:15.384 INFO:teuthology.orchestra.run.smithi006.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 73 kB/s | 44 kB 00:00 2024-09-10T20:53:15.536 INFO:teuthology.orchestra.run.smithi150.stdout:(151/157): NetworkManager-libnm-1.49.90-1.el9.x 8.7 MB/s | 1.8 MB 00:00 2024-09-10T20:53:15.587 INFO:teuthology.orchestra.run.smithi150.stdout:(152/157): NetworkManager-team-1.49.90-1.el9.x8 817 kB/s | 41 kB 00:00 2024-09-10T20:53:15.653 INFO:teuthology.orchestra.run.smithi150.stdout:(153/157): NetworkManager-tui-1.49.90-1.el9.x86 3.7 MB/s | 249 kB 00:00 2024-09-10T20:53:15.793 INFO:teuthology.orchestra.run.smithi006.stdout:(96/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-10T20:53:15.804 INFO:teuthology.orchestra.run.smithi150.stdout:(154/157): openssl-3.2.2-6.el9.x86_64.rpm 9.0 MB/s | 1.4 MB 00:00 2024-09-10T20:53:15.835 INFO:teuthology.orchestra.run.smithi006.stdout:(97/157): qatlib-24.02.0-1.el9.x86_64.rpm 274 kB/s | 221 kB 00:00 2024-09-10T20:53:15.854 INFO:teuthology.orchestra.run.smithi150.stdout:(155/157): librados2-19.3.0-4854.g8f219c47.el9. 3.7 MB/s | 3.5 MB 00:00 2024-09-10T20:53:16.227 INFO:teuthology.orchestra.run.smithi006.stdout:(98/157): qatlib-service-24.02.0-1.el9.x86_64.r 43 kB/s | 36 kB 00:00 2024-09-10T20:53:16.296 INFO:teuthology.orchestra.run.smithi150.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 4.9 MB/s | 2.4 MB 00:00 2024-09-10T20:53:16.385 INFO:teuthology.orchestra.run.smithi006.stdout:(99/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 82 kB/s | 47 kB 00:00 2024-09-10T20:53:16.669 INFO:teuthology.orchestra.run.smithi006.stdout:(100/157): socat-1.7.4.1-6.el9.x86_64.rpm 365 kB/s | 304 kB 00:00 2024-09-10T20:53:16.680 INFO:teuthology.orchestra.run.smithi150.stdout:(157/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 1.9 MB/s | 3.2 MB 00:01 2024-09-10T20:53:16.685 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2024-09-10T20:53:16.685 INFO:teuthology.orchestra.run.smithi150.stdout:Total 8.4 MB/s | 240 MB 00:28 2024-09-10T20:53:16.894 INFO:teuthology.orchestra.run.smithi006.stdout:(101/157): uuid-1.6.2-55.el9.x86_64.rpm 87 kB/s | 58 kB 00:00 2024-09-10T20:53:17.036 INFO:teuthology.orchestra.run.smithi006.stdout:(102/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 147 kB/s | 96 kB 00:00 2024-09-10T20:53:17.295 INFO:teuthology.orchestra.run.smithi006.stdout:(103/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 102 kB/s | 64 kB 00:00 2024-09-10T20:53:17.478 INFO:teuthology.orchestra.run.smithi006.stdout:(104/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 78 kB/s | 45 kB 00:00 2024-09-10T20:53:17.578 INFO:teuthology.orchestra.run.smithi006.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 5.4 MB/s | 548 kB 00:00 2024-09-10T20:53:17.603 INFO:teuthology.orchestra.run.smithi006.stdout:(106/157): lua-devel-5.4.4-4.el9.x86_64.rpm 39 kB/s | 22 kB 00:00 2024-09-10T20:53:17.645 INFO:teuthology.orchestra.run.smithi006.stdout:(107/157): gperftools-libs-2.9.1-2.el9.x86_64.r 4.5 MB/s | 309 kB 00:00 2024-09-10T20:53:17.696 INFO:teuthology.orchestra.run.smithi006.stdout:(108/157): grpc-data-1.46.7-10.el9.noarch.rpm 214 kB/s | 19 kB 00:00 2024-09-10T20:53:17.712 INFO:teuthology.orchestra.run.smithi006.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.6 MB/s | 26 kB 00:00 2024-09-10T20:53:17.738 INFO:teuthology.orchestra.run.smithi006.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-10T20:53:17.771 INFO:teuthology.orchestra.run.smithi006.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-10T20:53:17.805 INFO:teuthology.orchestra.run.smithi006.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-10T20:53:17.906 INFO:teuthology.orchestra.run.smithi006.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 839 kB 00:00 2024-09-10T20:53:17.964 INFO:teuthology.orchestra.run.smithi006.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 9.2 MB/s | 548 kB 00:00 2024-09-10T20:53:18.023 INFO:teuthology.orchestra.run.smithi006.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 749 kB/s | 43 kB 00:00 2024-09-10T20:53:18.082 INFO:teuthology.orchestra.run.smithi006.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 551 kB/s | 32 kB 00:00 2024-09-10T20:53:18.132 INFO:teuthology.orchestra.run.smithi006.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 284 kB/s | 14 kB 00:00 2024-09-10T20:53:18.166 INFO:teuthology.orchestra.run.smithi006.stdout:(118/157): python3-cheroot-8.6.0-4.el9.noarch.r 5.0 MB/s | 172 kB 00:00 2024-09-10T20:53:18.241 INFO:teuthology.orchestra.run.smithi006.stdout:(119/157): libarrow-9.0.0-11.el9.x86_64.rpm 7.4 MB/s | 4.4 MB 00:00 2024-09-10T20:53:18.274 INFO:teuthology.orchestra.run.smithi006.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-09-10T20:53:18.299 INFO:teuthology.orchestra.run.smithi006.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-10T20:53:18.325 INFO:teuthology.orchestra.run.smithi006.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-10T20:53:18.367 INFO:teuthology.orchestra.run.smithi006.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 3.4 MB/s | 144 kB 00:00 2024-09-10T20:53:18.408 INFO:teuthology.orchestra.run.smithi006.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 258 kB/s | 11 kB 00:00 2024-09-10T20:53:18.450 INFO:teuthology.orchestra.run.smithi006.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 426 kB/s | 18 kB 00:00 2024-09-10T20:53:18.493 INFO:teuthology.orchestra.run.smithi006.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 556 kB/s | 23 kB 00:00 2024-09-10T20:53:18.535 INFO:teuthology.orchestra.run.smithi006.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 469 kB/s | 19 kB 00:00 2024-09-10T20:53:18.576 INFO:teuthology.orchestra.run.smithi006.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 477 kB/s | 20 kB 00:00 2024-09-10T20:53:18.643 INFO:teuthology.orchestra.run.smithi006.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 5.9 MB/s | 2.0 MB 00:00 2024-09-10T20:53:18.694 INFO:teuthology.orchestra.run.smithi006.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 925 kB/s | 46 kB 00:00 2024-09-10T20:53:18.727 INFO:teuthology.orchestra.run.smithi006.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-10T20:53:18.769 INFO:teuthology.orchestra.run.smithi006.stdout:(132/157): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2024-09-10T20:53:18.770 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2024-09-10T20:53:18.811 INFO:teuthology.orchestra.run.smithi006.stdout:(133/157): python3-natsort-7.1.1-5.el9.noarch.r 691 kB/s | 58 kB 00:00 2024-09-10T20:53:18.845 INFO:teuthology.orchestra.run.smithi006.stdout:(134/157): protobuf-compiler-3.14.0-13.el9.x86_ 557 kB/s | 863 kB 00:01 2024-09-10T20:53:18.952 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2024-09-10T20:53:18.952 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2024-09-10T20:53:19.031 INFO:teuthology.orchestra.run.smithi006.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 75 kB/s | 16 kB 00:00 2024-09-10T20:53:19.071 INFO:teuthology.orchestra.run.smithi006.stdout:(136/157): python3-pecan-1.4.2-3.el9.noarch.rpm 905 kB/s | 272 kB 00:00 2024-09-10T20:53:19.113 INFO:teuthology.orchestra.run.smithi006.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 409 kB/s | 28 kB 00:00 2024-09-10T20:53:19.163 INFO:teuthology.orchestra.run.smithi006.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 343 kB/s | 31 kB 00:00 2024-09-10T20:53:19.196 INFO:teuthology.orchestra.run.smithi006.stdout:(139/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 256 kB/s | 90 kB 00:00 2024-09-10T20:53:19.247 INFO:teuthology.orchestra.run.smithi006.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 705 kB/s | 59 kB 00:00 2024-09-10T20:53:19.297 INFO:teuthology.orchestra.run.smithi006.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 356 kB/s | 36 kB 00:00 2024-09-10T20:53:19.322 INFO:teuthology.orchestra.run.smithi006.stdout:(142/157): python3-routes-2.5.1-5.el9.noarch.rp 901 kB/s | 188 kB 00:00 2024-09-10T20:53:19.348 INFO:teuthology.orchestra.run.smithi006.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 743 kB/s | 74 kB 00:00 2024-09-10T20:53:19.373 INFO:teuthology.orchestra.run.smithi006.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-10T20:53:19.415 INFO:teuthology.orchestra.run.smithi006.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 482 kB/s | 20 kB 00:00 2024-09-10T20:53:19.449 INFO:teuthology.orchestra.run.smithi006.stdout:(146/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.5 MB/s | 230 kB 00:00 2024-09-10T20:53:19.483 INFO:teuthology.orchestra.run.smithi006.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-10T20:53:19.516 INFO:teuthology.orchestra.run.smithi006.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 2.5 MB/s | 427 kB 00:00 2024-09-10T20:53:19.625 INFO:teuthology.orchestra.run.smithi006.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 9.0 MB/s | 1.6 MB 00:00 2024-09-10T20:53:19.817 INFO:teuthology.orchestra.run.smithi006.stdout:(150/157): NetworkManager-1.49.90-1.el9.x86_64. 12 MB/s | 2.3 MB 00:00 2024-09-10T20:53:19.883 INFO:teuthology.orchestra.run.smithi006.stdout:(151/157): NetworkManager-libnm-1.49.90-1.el9.x 27 MB/s | 1.8 MB 00:00 2024-09-10T20:53:19.950 INFO:teuthology.orchestra.run.smithi006.stdout:(152/157): NetworkManager-team-1.49.90-1.el9.x8 612 kB/s | 41 kB 00:00 2024-09-10T20:53:19.992 INFO:teuthology.orchestra.run.smithi006.stdout:(153/157): NetworkManager-tui-1.49.90-1.el9.x86 5.9 MB/s | 249 kB 00:00 2024-09-10T20:53:20.059 INFO:teuthology.orchestra.run.smithi006.stdout:(154/157): openssl-3.2.2-6.el9.x86_64.rpm 20 MB/s | 1.4 MB 00:00 2024-09-10T20:53:20.143 INFO:teuthology.orchestra.run.smithi006.stdout:(155/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 29 MB/s | 2.4 MB 00:00 2024-09-10T20:53:20.510 INFO:teuthology.orchestra.run.smithi006.stdout:(156/157): librados2-19.3.0-4854.g8f219c47.el9. 3.4 MB/s | 3.5 MB 00:01 2024-09-10T20:53:20.710 INFO:teuthology.orchestra.run.smithi006.stdout:(157/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 2.7 MB/s | 3.2 MB 00:01 2024-09-10T20:53:20.718 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2024-09-10T20:53:20.718 INFO:teuthology.orchestra.run.smithi006.stdout:Total 7.1 MB/s | 240 MB 00:33 2024-09-10T20:53:21.423 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2024-09-10T20:53:21.423 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2024-09-10T20:53:22.808 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2024-09-10T20:53:23.007 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction check succeeded. 2024-09-10T20:53:23.007 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2024-09-10T20:53:25.602 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded. 2024-09-10T20:53:25.603 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2024-09-10T20:53:28.236 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2024-09-10T20:53:28.427 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-10T20:53:28.477 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-10T20:53:28.551 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-10T20:53:28.595 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-10T20:53:28.627 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-10T20:53:28.682 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-10T20:53:29.053 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-10T20:53:29.161 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T20:53:29.364 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T20:53:29.395 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T20:53:29.492 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T20:53:29.537 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T20:53:29.575 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-10T20:53:29.799 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-10T20:53:29.866 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-10T20:53:29.892 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T20:53:30.069 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T20:53:30.093 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T20:53:30.208 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T20:53:30.236 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T20:53:30.274 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T20:53:30.530 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T20:53:30.705 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T20:53:30.886 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-10T20:53:31.036 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T20:53:31.141 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T20:53:31.412 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T20:53:31.551 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-10T20:53:31.608 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-10T20:53:31.652 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-10T20:53:31.735 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-10T20:53:31.788 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-10T20:53:31.827 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-10T20:53:31.882 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-10T20:53:31.920 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-10T20:53:31.962 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-10T20:53:32.050 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-10T20:53:32.114 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-10T20:53:32.150 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-10T20:53:32.196 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-10T20:53:32.278 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-10T20:53:32.311 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-10T20:53:32.338 INFO:teuthology.orchestra.run.smithi006.stdout: Preparing : 1/1 2024-09-10T20:53:32.355 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-10T20:53:32.383 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-10T20:53:32.480 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-10T20:53:32.515 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-10T20:53:32.545 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-10T20:53:32.567 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-10T20:53:32.633 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-10T20:53:32.634 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-10T20:53:32.677 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-10T20:53:32.708 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-10T20:53:32.772 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-10T20:53:32.795 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-10T20:53:32.865 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-10T20:53:33.164 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-10T20:53:33.268 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T20:53:33.415 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T20:53:33.442 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T20:53:33.497 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-10T20:53:33.556 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T20:53:33.594 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T20:53:33.615 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-10T20:53:33.630 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-10T20:53:33.650 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-10T20:53:33.695 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-10T20:53:33.733 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-10T20:53:33.786 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-10T20:53:33.850 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-10T20:53:33.913 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-10T20:53:33.939 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T20:53:33.985 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-10T20:53:34.061 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-10T20:53:34.126 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T20:53:34.157 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T20:53:34.165 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-10T20:53:34.229 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-10T20:53:34.239 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T20:53:34.266 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T20:53:34.304 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T20:53:34.315 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-10T20:53:34.354 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-10T20:53:34.390 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-10T20:53:34.448 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-10T20:53:34.500 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-10T20:53:34.551 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-10T20:53:34.601 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-10T20:53:34.695 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T20:53:34.772 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-10T20:53:34.829 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-10T20:53:34.872 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-10T20:53:34.893 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T20:53:34.991 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-10T20:53:35.030 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-10T20:53:35.064 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-10T20:53:35.097 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-10T20:53:35.127 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-10T20:53:35.152 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-10T20:53:35.186 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T20:53:35.290 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-10T20:53:35.308 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T20:53:35.444 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-10T20:53:35.501 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-10T20:53:35.541 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-10T20:53:35.586 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-10T20:53:35.588 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T20:53:35.630 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-10T20:53:35.686 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-10T20:53:35.723 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-10T20:53:35.729 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-10T20:53:35.757 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-10T20:53:35.763 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-10T20:53:35.791 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-10T20:53:35.808 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-10T20:53:35.834 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-10T20:53:35.866 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-10T20:53:35.894 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-10T20:53:35.953 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-10T20:53:35.966 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-10T20:53:36.016 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-10T20:53:36.025 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-10T20:53:36.062 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-10T20:53:36.071 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-10T20:53:36.110 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-10T20:53:36.143 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-10T20:53:36.212 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-10T20:53:36.234 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-10T20:53:36.283 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-10T20:53:36.305 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-10T20:53:36.340 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-10T20:53:36.386 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-10T20:53:36.479 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-10T20:53:36.517 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-10T20:53:36.561 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-10T20:53:36.589 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-10T20:53:36.685 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-10T20:53:36.742 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-10T20:53:36.835 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-10T20:53:36.999 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-10T20:53:37.062 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-10T20:53:37.159 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-10T20:53:37.219 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-10T20:53:37.252 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-10T20:53:37.365 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-10T20:53:37.427 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-10T20:53:37.509 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-10T20:53:37.609 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-10T20:53:37.655 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-10T20:53:37.735 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-10T20:53:37.840 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-10T20:53:37.902 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-10T20:53:37.919 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-10T20:53:37.959 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-10T20:53:37.967 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-10T20:53:38.005 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-10T20:53:38.054 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-10T20:53:38.058 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-10T20:53:38.267 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-10T20:53:38.324 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-10T20:53:38.442 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-10T20:53:38.521 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-10T20:53:38.606 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-10T20:53:38.643 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-10T20:53:38.679 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-10T20:53:38.738 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-10T20:53:38.778 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-10T20:53:38.824 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-10T20:53:38.867 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-10T20:53:38.891 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-10T20:53:39.014 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-10T20:53:39.070 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-10T20:53:39.114 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-10T20:53:39.159 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-10T20:53:39.292 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-10T20:53:39.335 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-10T20:53:39.377 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-10T20:53:39.407 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-10T20:53:39.431 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-10T20:53:39.545 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-10T20:53:39.706 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-10T20:53:39.756 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-10T20:53:39.796 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-10T20:53:39.852 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-10T20:53:39.901 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-10T20:53:39.940 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-10T20:53:39.977 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-10T20:53:40.012 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-10T20:53:40.045 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-10T20:53:40.098 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-10T20:53:40.129 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-10T20:53:40.232 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-10T20:53:40.289 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-10T20:53:40.325 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-10T20:53:40.452 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-10T20:53:40.513 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-10T20:53:40.583 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-10T20:53:40.714 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-10T20:53:40.750 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-10T20:53:40.783 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-10T20:53:41.134 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-10T20:53:41.186 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T20:53:41.298 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T20:53:41.334 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-10T20:53:41.383 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-10T20:53:41.457 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-10T20:53:41.523 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-10T20:53:41.557 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-10T20:53:41.677 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-10T20:53:41.732 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-10T20:53:41.794 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-10T20:53:41.910 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-10T20:53:41.925 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-10T20:53:41.956 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T20:53:42.055 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T20:53:42.082 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-10T20:53:42.318 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-10T20:53:42.558 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-10T20:53:42.597 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-10T20:53:42.703 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-10T20:53:43.565 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-10T20:53:43.737 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-10T20:53:44.795 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T20:53:44.829 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T20:53:45.385 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-10T20:53:45.482 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T20:53:45.485 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-10T20:53:45.522 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-10T20:53:45.526 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T20:53:45.554 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-10T20:53:45.682 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T20:53:45.682 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T20:53:45.682 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T20:53:45.682 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:53:45.735 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T20:53:45.927 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-10T20:53:45.982 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T20:53:46.087 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T20:53:46.138 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-10T20:53:46.187 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-10T20:53:46.760 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-10T20:53:46.802 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T20:53:46.901 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T20:53:46.936 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-10T20:53:49.653 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T20:53:49.691 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T20:53:50.366 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T20:53:50.411 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T20:53:50.551 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T20:53:50.551 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T20:53:50.551 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T20:53:50.551 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:53:50.604 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T20:53:58.495 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T20:53:58.496 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /sys 2024-09-10T20:53:58.496 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /proc 2024-09-10T20:53:58.496 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /mnt 2024-09-10T20:53:58.496 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /var/tmp 2024-09-10T20:53:58.496 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /home 2024-09-10T20:53:58.496 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /root 2024-09-10T20:53:58.496 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /tmp 2024-09-10T20:53:58.496 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:53:58.704 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T20:53:58.740 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T20:53:58.740 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:53:58.740 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T20:53:58.740 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:54:00.391 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T20:54:00.450 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T20:54:00.450 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:54:00.450 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T20:54:00.450 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T20:54:00.450 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T20:54:00.451 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:54:00.700 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T20:54:00.751 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T20:54:00.751 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:54:00.752 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T20:54:00.752 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T20:54:00.752 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T20:54:00.752 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:54:01.251 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T20:54:01.302 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T20:54:01.302 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:54:01.303 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T20:54:01.303 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T20:54:01.303 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T20:54:01.303 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:54:01.426 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-10T20:54:01.487 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-10T20:54:01.558 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-10T20:54:01.793 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-10T20:54:01.847 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-10T20:54:01.932 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-10T20:54:02.050 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-10T20:54:02.214 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-10T20:54:02.264 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-10T20:54:02.311 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-10T20:54:02.353 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-10T20:54:02.911 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T20:54:02.961 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T20:54:03.003 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-10T20:54:03.084 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-10T20:54:03.147 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T20:54:04.026 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T20:54:04.026 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /sys 2024-09-10T20:54:04.026 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /proc 2024-09-10T20:54:04.026 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /mnt 2024-09-10T20:54:04.026 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /var/tmp 2024-09-10T20:54:04.026 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /home 2024-09-10T20:54:04.026 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /root 2024-09-10T20:54:04.026 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /tmp 2024-09-10T20:54:04.026 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:54:04.233 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T20:54:04.268 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T20:54:04.269 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:54:04.269 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T20:54:04.269 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:54:05.962 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T20:54:06.020 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T20:54:06.021 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:54:06.021 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T20:54:06.021 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T20:54:06.021 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T20:54:06.021 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:54:06.279 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T20:54:06.331 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T20:54:06.332 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:54:06.332 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T20:54:06.332 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T20:54:06.332 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T20:54:06.332 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:54:06.787 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T20:54:06.846 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T20:54:06.848 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T20:54:06.898 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T20:54:06.898 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:54:06.898 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T20:54:06.898 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T20:54:06.898 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T20:54:06.898 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:54:07.031 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-10T20:54:07.093 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-10T20:54:07.165 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-10T20:54:07.411 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-10T20:54:07.486 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-10T20:54:07.584 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-10T20:54:07.710 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-10T20:54:07.886 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-10T20:54:07.942 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T20:54:07.942 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-10T20:54:07.973 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T20:54:07.982 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-10T20:54:08.015 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-10T20:54:08.126 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T20:54:08.306 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-10T20:54:08.367 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T20:54:08.419 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T20:54:08.419 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:54:08.420 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T20:54:08.420 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T20:54:08.420 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T20:54:08.420 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:54:08.476 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T20:54:08.502 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T20:54:08.609 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-10T20:54:08.670 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-10T20:54:08.843 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T20:54:08.874 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T20:54:08.917 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-10T20:54:09.001 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-10T20:54:09.029 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T20:54:09.709 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-10T20:54:09.753 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T20:54:09.805 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T20:54:09.805 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:54:09.805 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T20:54:09.805 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T20:54:09.805 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T20:54:09.805 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:54:09.862 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T20:54:09.912 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T20:54:09.912 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:54:09.912 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T20:54:09.912 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:54:09.971 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T20:54:10.023 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T20:54:10.023 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:54:10.023 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T20:54:10.024 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T20:54:10.024 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T20:54:10.024 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:54:10.372 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T20:54:10.423 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T20:54:10.423 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:54:10.423 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T20:54:10.423 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T20:54:10.423 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T20:54:10.424 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:54:12.885 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T20:54:12.952 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T20:54:14.106 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T20:54:14.135 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T20:54:14.296 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T20:54:14.475 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-10T20:54:14.504 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T20:54:14.556 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T20:54:14.556 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:54:14.556 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T20:54:14.556 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T20:54:14.556 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T20:54:14.556 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:54:14.613 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T20:54:14.640 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T20:54:14.751 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-10T20:54:14.973 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-10T20:54:15.553 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-10T20:54:15.594 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-10T20:54:15.638 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-10T20:54:15.666 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-10T20:54:15.702 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-10T20:54:15.946 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-10T20:54:15.999 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-10T20:54:16.037 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-10T20:54:16.060 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-10T20:54:16.077 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-10T20:54:16.118 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T20:54:16.129 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-10T20:54:16.169 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T20:54:16.170 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:54:16.170 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T20:54:16.170 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T20:54:16.170 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T20:54:16.170 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:54:16.233 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T20:54:16.284 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T20:54:16.284 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:54:16.284 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T20:54:16.284 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:54:16.341 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T20:54:16.393 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T20:54:16.393 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:54:16.393 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T20:54:16.393 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T20:54:16.393 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T20:54:16.394 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:54:16.751 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T20:54:16.802 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T20:54:16.803 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:54:16.803 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T20:54:16.803 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T20:54:16.803 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T20:54:16.803 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:54:16.905 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T20:54:16.952 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T20:54:16.994 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T20:54:18.266 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-10T20:54:18.382 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-10T20:54:18.455 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-10T20:54:18.570 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-10T20:54:18.610 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-10T20:54:18.635 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-10T20:54:18.696 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-10T20:54:18.697 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T20:54:18.812 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T20:54:18.813 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T20:54:18.921 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T20:54:18.945 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-10T20:54:18.961 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T20:54:18.961 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T20:54:19.215 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T20:54:19.215 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T20:54:19.324 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T20:54:19.407 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T20:54:19.609 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T20:54:19.610 INFO:teuthology.orchestra.run.smithi150.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-10T20:54:19.610 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:54:22.207 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-10T20:54:22.257 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-10T20:54:22.301 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-10T20:54:22.337 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-10T20:54:22.373 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-10T20:54:22.622 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-10T20:54:22.686 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-10T20:54:22.716 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-10T20:54:22.748 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-10T20:54:22.832 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-10T20:54:23.811 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T20:54:23.855 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T20:54:23.898 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T20:54:25.271 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-10T20:54:25.386 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-10T20:54:25.440 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-10T20:54:25.549 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-10T20:54:25.588 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-10T20:54:25.613 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-10T20:54:25.650 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-10T20:54:25.650 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T20:54:25.782 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T20:54:25.783 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T20:54:25.891 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T20:54:25.908 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-10T20:54:25.908 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-10T20:54:25.908 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-10T20:54:25.908 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-10T20:54:25.908 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-10T20:54:25.908 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-10T20:54:25.908 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-10T20:54:25.908 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T20:54:25.908 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T20:54:25.908 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T20:54:25.909 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-10T20:54:25.909 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-10T20:54:25.909 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-10T20:54:25.909 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T20:54:25.909 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-10T20:54:25.909 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-10T20:54:25.909 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-10T20:54:25.909 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-10T20:54:25.911 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-10T20:54:25.911 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-10T20:54:25.912 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-10T20:54:25.912 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-10T20:54:25.912 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-10T20:54:25.912 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-10T20:54:25.912 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-10T20:54:25.912 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-10T20:54:25.912 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-10T20:54:25.912 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-10T20:54:25.912 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-10T20:54:25.920 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-10T20:54:25.925 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-10T20:54:25.925 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-10T20:54:25.925 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-10T20:54:25.925 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-10T20:54:25.925 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-10T20:54:25.925 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-10T20:54:25.926 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-10T20:54:25.926 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-10T20:54:25.926 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-10T20:54:25.926 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-10T20:54:25.926 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-10T20:54:25.926 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-10T20:54:25.926 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-10T20:54:25.926 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-10T20:54:25.926 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-10T20:54:25.926 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-10T20:54:25.926 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-10T20:54:25.926 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-10T20:54:25.926 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-10T20:54:25.927 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-10T20:54:25.927 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-10T20:54:25.927 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-10T20:54:25.927 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-10T20:54:25.927 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-10T20:54:25.927 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-10T20:54:25.927 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-10T20:54:25.927 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-10T20:54:25.927 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-10T20:54:25.927 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-10T20:54:25.927 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-10T20:54:25.927 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-10T20:54:25.928 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-10T20:54:25.928 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-10T20:54:25.928 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-10T20:54:25.928 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-10T20:54:25.928 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-10T20:54:25.928 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-10T20:54:25.928 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-10T20:54:25.928 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-10T20:54:25.928 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-10T20:54:25.928 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-10T20:54:25.928 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-10T20:54:25.928 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-10T20:54:25.929 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-10T20:54:25.929 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-10T20:54:25.929 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-10T20:54:25.929 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-10T20:54:25.929 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-10T20:54:25.929 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-10T20:54:25.929 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-10T20:54:25.929 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-10T20:54:25.929 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-10T20:54:25.929 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-10T20:54:25.929 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-10T20:54:25.929 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-10T20:54:25.929 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-10T20:54:25.929 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-10T20:54:25.930 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-10T20:54:25.930 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-10T20:54:25.930 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-10T20:54:25.930 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-10T20:54:25.930 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-10T20:54:25.930 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-10T20:54:25.930 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-10T20:54:25.930 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-10T20:54:25.930 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-10T20:54:25.930 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-10T20:54:25.930 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-10T20:54:25.930 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-10T20:54:25.930 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-10T20:54:25.930 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-10T20:54:25.931 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-10T20:54:25.931 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-10T20:54:25.931 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-10T20:54:25.931 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-10T20:54:25.931 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-10T20:54:25.931 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-10T20:54:25.931 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-10T20:54:25.931 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-10T20:54:25.931 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-10T20:54:25.931 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-10T20:54:25.931 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-10T20:54:25.931 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-10T20:54:25.931 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-10T20:54:25.931 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-10T20:54:25.931 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-10T20:54:25.932 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-10T20:54:25.932 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-10T20:54:25.932 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-10T20:54:25.932 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-10T20:54:25.932 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-10T20:54:25.932 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-10T20:54:25.932 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-10T20:54:25.932 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-10T20:54:25.932 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-10T20:54:25.932 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-10T20:54:25.932 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-10T20:54:25.932 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-10T20:54:25.933 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-10T20:54:25.933 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-10T20:54:25.933 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-10T20:54:25.933 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-10T20:54:25.933 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-10T20:54:25.933 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-10T20:54:25.933 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-10T20:54:25.933 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-10T20:54:25.933 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-10T20:54:25.933 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-10T20:54:25.933 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-10T20:54:25.933 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-10T20:54:25.934 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-10T20:54:25.934 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-10T20:54:25.934 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-10T20:54:25.934 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-10T20:54:25.934 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-10T20:54:25.934 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-10T20:54:25.934 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-10T20:54:25.934 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-10T20:54:25.934 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-10T20:54:25.934 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-10T20:54:25.934 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-10T20:54:25.934 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-10T20:54:25.934 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-10T20:54:25.934 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-10T20:54:25.935 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-10T20:54:25.935 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-10T20:54:25.935 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-10T20:54:25.935 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-10T20:54:25.935 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-10T20:54:25.935 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-10T20:54:25.935 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-10T20:54:25.935 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-10T20:54:25.935 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-10T20:54:25.935 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-10T20:54:25.935 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-10T20:54:25.936 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T20:54:25.936 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T20:54:26.177 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T20:54:26.177 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T20:54:26.295 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T20:54:26.371 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T20:54:26.632 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T20:54:26.632 INFO:teuthology.orchestra.run.smithi006.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-10T20:54:26.632 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:54:28.214 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T20:54:28.214 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:54:28.214 INFO:teuthology.orchestra.run.smithi150.stdout:Upgraded: 2024-09-10T20:54:28.214 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T20:54:28.214 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T20:54:28.214 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T20:54:28.214 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T20:54:28.214 INFO:teuthology.orchestra.run.smithi150.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:28.214 INFO:teuthology.orchestra.run.smithi150.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:28.214 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T20:54:28.214 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T20:54:28.214 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2024-09-10T20:54:28.215 INFO:teuthology.orchestra.run.smithi150.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T20:54:28.215 INFO:teuthology.orchestra.run.smithi150.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T20:54:28.215 INFO:teuthology.orchestra.run.smithi150.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T20:54:28.215 INFO:teuthology.orchestra.run.smithi150.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T20:54:28.215 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:28.215 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:28.215 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:28.215 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:28.215 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:54:28.215 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:28.215 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:28.215 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:28.215 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:54:28.215 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:54:28.216 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:54:28.216 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:54:28.216 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:54:28.216 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:28.216 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:28.216 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:54:28.216 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:28.216 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:28.216 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:28.216 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:54:28.216 INFO:teuthology.orchestra.run.smithi150.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:54:28.216 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:28.217 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:28.217 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:54:28.217 INFO:teuthology.orchestra.run.smithi150.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T20:54:28.217 INFO:teuthology.orchestra.run.smithi150.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T20:54:28.217 INFO:teuthology.orchestra.run.smithi150.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T20:54:28.217 INFO:teuthology.orchestra.run.smithi150.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T20:54:28.217 INFO:teuthology.orchestra.run.smithi150.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T20:54:28.217 INFO:teuthology.orchestra.run.smithi150.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T20:54:28.217 INFO:teuthology.orchestra.run.smithi150.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T20:54:28.217 INFO:teuthology.orchestra.run.smithi150.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T20:54:28.217 INFO:teuthology.orchestra.run.smithi150.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T20:54:28.217 INFO:teuthology.orchestra.run.smithi150.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T20:54:28.217 INFO:teuthology.orchestra.run.smithi150.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T20:54:28.217 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:28.218 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:28.218 INFO:teuthology.orchestra.run.smithi150.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:28.218 INFO:teuthology.orchestra.run.smithi150.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T20:54:28.218 INFO:teuthology.orchestra.run.smithi150.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-10T20:54:28.218 INFO:teuthology.orchestra.run.smithi150.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T20:54:28.218 INFO:teuthology.orchestra.run.smithi150.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T20:54:28.218 INFO:teuthology.orchestra.run.smithi150.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T20:54:28.218 INFO:teuthology.orchestra.run.smithi150.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T20:54:28.218 INFO:teuthology.orchestra.run.smithi150.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:28.218 INFO:teuthology.orchestra.run.smithi150.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:28.218 INFO:teuthology.orchestra.run.smithi150.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T20:54:28.218 INFO:teuthology.orchestra.run.smithi150.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:28.219 INFO:teuthology.orchestra.run.smithi150.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T20:54:28.219 INFO:teuthology.orchestra.run.smithi150.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T20:54:28.219 INFO:teuthology.orchestra.run.smithi150.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T20:54:28.219 INFO:teuthology.orchestra.run.smithi150.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T20:54:28.219 INFO:teuthology.orchestra.run.smithi150.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T20:54:28.219 INFO:teuthology.orchestra.run.smithi150.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T20:54:28.219 INFO:teuthology.orchestra.run.smithi150.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T20:54:28.219 INFO:teuthology.orchestra.run.smithi150.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T20:54:28.219 INFO:teuthology.orchestra.run.smithi150.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T20:54:28.219 INFO:teuthology.orchestra.run.smithi150.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T20:54:28.219 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T20:54:28.219 INFO:teuthology.orchestra.run.smithi150.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T20:54:28.219 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T20:54:28.219 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T20:54:28.220 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T20:54:28.220 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T20:54:28.220 INFO:teuthology.orchestra.run.smithi150.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T20:54:28.220 INFO:teuthology.orchestra.run.smithi150.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T20:54:28.220 INFO:teuthology.orchestra.run.smithi150.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T20:54:28.220 INFO:teuthology.orchestra.run.smithi150.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T20:54:28.220 INFO:teuthology.orchestra.run.smithi150.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T20:54:28.220 INFO:teuthology.orchestra.run.smithi150.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T20:54:28.220 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T20:54:28.220 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:28.220 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:28.220 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:28.220 INFO:teuthology.orchestra.run.smithi150.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T20:54:28.221 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T20:54:28.221 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T20:54:28.221 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T20:54:28.221 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T20:54:28.221 INFO:teuthology.orchestra.run.smithi150.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T20:54:28.221 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T20:54:28.221 INFO:teuthology.orchestra.run.smithi150.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T20:54:28.221 INFO:teuthology.orchestra.run.smithi150.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T20:54:28.221 INFO:teuthology.orchestra.run.smithi150.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T20:54:28.221 INFO:teuthology.orchestra.run.smithi150.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T20:54:28.221 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T20:54:28.221 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T20:54:28.221 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T20:54:28.221 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T20:54:28.222 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T20:54:28.222 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T20:54:28.222 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T20:54:28.222 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T20:54:28.222 INFO:teuthology.orchestra.run.smithi150.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T20:54:28.222 INFO:teuthology.orchestra.run.smithi150.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T20:54:28.222 INFO:teuthology.orchestra.run.smithi150.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T20:54:28.222 INFO:teuthology.orchestra.run.smithi150.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T20:54:28.222 INFO:teuthology.orchestra.run.smithi150.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T20:54:28.222 INFO:teuthology.orchestra.run.smithi150.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T20:54:28.222 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T20:54:28.222 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T20:54:28.222 INFO:teuthology.orchestra.run.smithi150.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T20:54:28.222 INFO:teuthology.orchestra.run.smithi150.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T20:54:28.223 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T20:54:28.223 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T20:54:28.223 INFO:teuthology.orchestra.run.smithi150.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T20:54:28.223 INFO:teuthology.orchestra.run.smithi150.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T20:54:28.223 INFO:teuthology.orchestra.run.smithi150.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T20:54:28.223 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T20:54:28.223 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T20:54:28.223 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T20:54:28.223 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T20:54:28.223 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T20:54:28.223 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T20:54:28.223 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:28.223 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:28.223 INFO:teuthology.orchestra.run.smithi150.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T20:54:28.224 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T20:54:28.224 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T20:54:28.224 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:28.224 INFO:teuthology.orchestra.run.smithi150.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T20:54:28.224 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T20:54:28.224 INFO:teuthology.orchestra.run.smithi150.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T20:54:28.224 INFO:teuthology.orchestra.run.smithi150.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T20:54:28.224 INFO:teuthology.orchestra.run.smithi150.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T20:54:28.224 INFO:teuthology.orchestra.run.smithi150.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T20:54:28.224 INFO:teuthology.orchestra.run.smithi150.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T20:54:28.224 INFO:teuthology.orchestra.run.smithi150.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T20:54:28.224 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T20:54:28.224 INFO:teuthology.orchestra.run.smithi150.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T20:54:28.225 INFO:teuthology.orchestra.run.smithi150.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T20:54:28.225 INFO:teuthology.orchestra.run.smithi150.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T20:54:28.225 INFO:teuthology.orchestra.run.smithi150.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T20:54:28.225 INFO:teuthology.orchestra.run.smithi150.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T20:54:28.225 INFO:teuthology.orchestra.run.smithi150.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T20:54:28.225 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:28.225 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:28.225 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:28.225 INFO:teuthology.orchestra.run.smithi150.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T20:54:28.225 INFO:teuthology.orchestra.run.smithi150.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T20:54:28.225 INFO:teuthology.orchestra.run.smithi150.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T20:54:28.225 INFO:teuthology.orchestra.run.smithi150.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T20:54:28.225 INFO:teuthology.orchestra.run.smithi150.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T20:54:28.226 INFO:teuthology.orchestra.run.smithi150.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T20:54:28.226 INFO:teuthology.orchestra.run.smithi150.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T20:54:28.226 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:54:28.226 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2024-09-10T20:54:28.904 DEBUG:teuthology.parallel:result is None 2024-09-10T20:54:32.947 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-10T20:54:32.947 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-10T20:54:32.947 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-10T20:54:32.948 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-10T20:54:32.948 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-10T20:54:32.948 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-10T20:54:32.948 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-10T20:54:32.948 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T20:54:32.948 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T20:54:32.948 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T20:54:32.948 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-10T20:54:32.948 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-10T20:54:32.948 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-10T20:54:32.948 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T20:54:32.948 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-10T20:54:32.949 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-10T20:54:32.949 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-10T20:54:32.949 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-10T20:54:32.949 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-10T20:54:32.949 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-10T20:54:32.949 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-10T20:54:32.949 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-10T20:54:32.949 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-10T20:54:32.949 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-10T20:54:32.949 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-10T20:54:32.949 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-10T20:54:32.949 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-10T20:54:32.961 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-10T20:54:32.961 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-10T20:54:32.962 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-10T20:54:32.962 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-10T20:54:32.962 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-10T20:54:32.962 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-10T20:54:32.962 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-10T20:54:32.962 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-10T20:54:32.962 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-10T20:54:32.962 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-10T20:54:32.962 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-10T20:54:32.962 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-10T20:54:32.962 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-10T20:54:32.962 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-10T20:54:32.962 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-10T20:54:32.963 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-10T20:54:32.963 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-10T20:54:32.963 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-10T20:54:32.963 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-10T20:54:32.963 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-10T20:54:32.963 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-10T20:54:32.963 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-10T20:54:32.963 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-10T20:54:32.963 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-10T20:54:32.963 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-10T20:54:32.964 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-10T20:54:32.964 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-10T20:54:32.964 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-10T20:54:32.964 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-10T20:54:32.964 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-10T20:54:32.964 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-10T20:54:32.964 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-10T20:54:32.964 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-10T20:54:32.964 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-10T20:54:32.964 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-10T20:54:32.964 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-10T20:54:32.964 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-10T20:54:32.965 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-10T20:54:32.965 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-10T20:54:32.965 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-10T20:54:32.965 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-10T20:54:32.965 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-10T20:54:32.965 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-10T20:54:32.965 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-10T20:54:32.965 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-10T20:54:32.965 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-10T20:54:32.965 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-10T20:54:32.965 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-10T20:54:32.965 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-10T20:54:32.965 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-10T20:54:32.966 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-10T20:54:32.966 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-10T20:54:32.966 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-10T20:54:32.966 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-10T20:54:32.966 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-10T20:54:32.966 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-10T20:54:32.966 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-10T20:54:32.966 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-10T20:54:32.966 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-10T20:54:32.966 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-10T20:54:32.966 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-10T20:54:32.966 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-10T20:54:32.966 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-10T20:54:32.967 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-10T20:54:32.967 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-10T20:54:32.967 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-10T20:54:32.967 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-10T20:54:32.967 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-10T20:54:32.967 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-10T20:54:32.967 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-10T20:54:32.967 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-10T20:54:32.967 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-10T20:54:32.967 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-10T20:54:32.967 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-10T20:54:32.967 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-10T20:54:32.967 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-10T20:54:32.967 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-10T20:54:32.968 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-10T20:54:32.968 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-10T20:54:32.968 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-10T20:54:32.968 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-10T20:54:32.968 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-10T20:54:32.968 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-10T20:54:32.968 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-10T20:54:32.968 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-10T20:54:32.968 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-10T20:54:32.968 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-10T20:54:32.968 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-10T20:54:32.968 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-10T20:54:32.968 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-10T20:54:32.968 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-10T20:54:32.968 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-10T20:54:32.969 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-10T20:54:32.969 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-10T20:54:32.969 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-10T20:54:32.969 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-10T20:54:32.969 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-10T20:54:32.969 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-10T20:54:32.969 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-10T20:54:32.969 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-10T20:54:32.969 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-10T20:54:32.969 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-10T20:54:32.969 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-10T20:54:32.969 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-10T20:54:32.969 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-10T20:54:32.970 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-10T20:54:32.970 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-10T20:54:32.970 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-10T20:54:32.970 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-10T20:54:32.970 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-10T20:54:32.970 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-10T20:54:32.970 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-10T20:54:32.970 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-10T20:54:32.970 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-10T20:54:32.970 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-10T20:54:32.970 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-10T20:54:32.970 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-10T20:54:32.970 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-10T20:54:32.971 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-10T20:54:32.971 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-10T20:54:32.971 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-10T20:54:32.971 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-10T20:54:32.971 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-10T20:54:32.971 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-10T20:54:32.971 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-10T20:54:32.971 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-10T20:54:32.971 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-10T20:54:32.971 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-10T20:54:32.971 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-10T20:54:32.971 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-10T20:54:32.971 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-10T20:54:32.971 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-10T20:54:32.971 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-10T20:54:32.972 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-10T20:54:32.972 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-10T20:54:32.972 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-10T20:54:32.972 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-10T20:54:35.128 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T20:54:35.128 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:54:35.128 INFO:teuthology.orchestra.run.smithi006.stdout:Upgraded: 2024-09-10T20:54:35.128 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T20:54:35.129 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T20:54:35.129 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T20:54:35.129 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T20:54:35.129 INFO:teuthology.orchestra.run.smithi006.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:35.129 INFO:teuthology.orchestra.run.smithi006.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:35.129 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T20:54:35.129 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T20:54:35.129 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2024-09-10T20:54:35.129 INFO:teuthology.orchestra.run.smithi006.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T20:54:35.129 INFO:teuthology.orchestra.run.smithi006.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T20:54:35.129 INFO:teuthology.orchestra.run.smithi006.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T20:54:35.129 INFO:teuthology.orchestra.run.smithi006.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T20:54:35.130 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:35.130 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:35.130 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:35.130 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:35.130 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:54:35.130 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:35.130 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:35.130 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:35.130 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:54:35.130 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:54:35.130 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:54:35.130 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:54:35.131 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:54:35.131 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:35.131 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:35.131 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:54:35.131 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:35.131 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:35.131 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:35.131 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:54:35.131 INFO:teuthology.orchestra.run.smithi006.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:54:35.131 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:35.131 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:35.131 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:54:35.132 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T20:54:35.132 INFO:teuthology.orchestra.run.smithi006.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T20:54:35.132 INFO:teuthology.orchestra.run.smithi006.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T20:54:35.132 INFO:teuthology.orchestra.run.smithi006.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T20:54:35.132 INFO:teuthology.orchestra.run.smithi006.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T20:54:35.132 INFO:teuthology.orchestra.run.smithi006.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T20:54:35.132 INFO:teuthology.orchestra.run.smithi006.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T20:54:35.132 INFO:teuthology.orchestra.run.smithi006.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T20:54:35.132 INFO:teuthology.orchestra.run.smithi006.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T20:54:35.133 INFO:teuthology.orchestra.run.smithi006.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T20:54:35.133 INFO:teuthology.orchestra.run.smithi006.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T20:54:35.133 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:35.133 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:35.133 INFO:teuthology.orchestra.run.smithi006.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:35.133 INFO:teuthology.orchestra.run.smithi006.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T20:54:35.133 INFO:teuthology.orchestra.run.smithi006.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-10T20:54:35.133 INFO:teuthology.orchestra.run.smithi006.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T20:54:35.133 INFO:teuthology.orchestra.run.smithi006.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T20:54:35.133 INFO:teuthology.orchestra.run.smithi006.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T20:54:35.133 INFO:teuthology.orchestra.run.smithi006.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T20:54:35.133 INFO:teuthology.orchestra.run.smithi006.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:35.133 INFO:teuthology.orchestra.run.smithi006.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:35.134 INFO:teuthology.orchestra.run.smithi006.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T20:54:35.134 INFO:teuthology.orchestra.run.smithi006.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:35.134 INFO:teuthology.orchestra.run.smithi006.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T20:54:35.134 INFO:teuthology.orchestra.run.smithi006.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T20:54:35.134 INFO:teuthology.orchestra.run.smithi006.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T20:54:35.134 INFO:teuthology.orchestra.run.smithi006.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T20:54:35.134 INFO:teuthology.orchestra.run.smithi006.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T20:54:35.134 INFO:teuthology.orchestra.run.smithi006.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T20:54:35.134 INFO:teuthology.orchestra.run.smithi006.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T20:54:35.134 INFO:teuthology.orchestra.run.smithi006.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T20:54:35.134 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T20:54:35.134 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T20:54:35.134 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T20:54:35.134 INFO:teuthology.orchestra.run.smithi006.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T20:54:35.135 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T20:54:35.135 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T20:54:35.135 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T20:54:35.135 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T20:54:35.135 INFO:teuthology.orchestra.run.smithi006.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T20:54:35.135 INFO:teuthology.orchestra.run.smithi006.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T20:54:35.135 INFO:teuthology.orchestra.run.smithi006.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T20:54:35.135 INFO:teuthology.orchestra.run.smithi006.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T20:54:35.135 INFO:teuthology.orchestra.run.smithi006.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T20:54:35.136 INFO:teuthology.orchestra.run.smithi006.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T20:54:35.136 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T20:54:35.136 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:35.136 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:35.136 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:35.136 INFO:teuthology.orchestra.run.smithi006.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T20:54:35.136 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T20:54:35.136 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T20:54:35.136 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T20:54:35.136 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T20:54:35.136 INFO:teuthology.orchestra.run.smithi006.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T20:54:35.136 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T20:54:35.136 INFO:teuthology.orchestra.run.smithi006.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T20:54:35.137 INFO:teuthology.orchestra.run.smithi006.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T20:54:35.137 INFO:teuthology.orchestra.run.smithi006.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T20:54:35.137 INFO:teuthology.orchestra.run.smithi006.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T20:54:35.137 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T20:54:35.137 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T20:54:35.137 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T20:54:35.137 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T20:54:35.137 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T20:54:35.137 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T20:54:35.137 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T20:54:35.137 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T20:54:35.137 INFO:teuthology.orchestra.run.smithi006.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T20:54:35.137 INFO:teuthology.orchestra.run.smithi006.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T20:54:35.137 INFO:teuthology.orchestra.run.smithi006.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T20:54:35.138 INFO:teuthology.orchestra.run.smithi006.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T20:54:35.138 INFO:teuthology.orchestra.run.smithi006.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T20:54:35.138 INFO:teuthology.orchestra.run.smithi006.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T20:54:35.138 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T20:54:35.138 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T20:54:35.138 INFO:teuthology.orchestra.run.smithi006.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T20:54:35.138 INFO:teuthology.orchestra.run.smithi006.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T20:54:35.138 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T20:54:35.138 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T20:54:35.138 INFO:teuthology.orchestra.run.smithi006.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T20:54:35.138 INFO:teuthology.orchestra.run.smithi006.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T20:54:35.138 INFO:teuthology.orchestra.run.smithi006.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T20:54:35.139 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T20:54:35.139 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T20:54:35.139 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T20:54:35.139 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T20:54:35.139 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T20:54:35.139 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T20:54:35.139 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:35.139 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:35.139 INFO:teuthology.orchestra.run.smithi006.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T20:54:35.139 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T20:54:35.139 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T20:54:35.139 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:35.139 INFO:teuthology.orchestra.run.smithi006.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T20:54:35.139 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T20:54:35.140 INFO:teuthology.orchestra.run.smithi006.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T20:54:35.140 INFO:teuthology.orchestra.run.smithi006.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T20:54:35.140 INFO:teuthology.orchestra.run.smithi006.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T20:54:35.140 INFO:teuthology.orchestra.run.smithi006.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T20:54:35.140 INFO:teuthology.orchestra.run.smithi006.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T20:54:35.140 INFO:teuthology.orchestra.run.smithi006.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T20:54:35.140 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T20:54:35.140 INFO:teuthology.orchestra.run.smithi006.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T20:54:35.140 INFO:teuthology.orchestra.run.smithi006.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T20:54:35.140 INFO:teuthology.orchestra.run.smithi006.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T20:54:35.140 INFO:teuthology.orchestra.run.smithi006.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T20:54:35.140 INFO:teuthology.orchestra.run.smithi006.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T20:54:35.140 INFO:teuthology.orchestra.run.smithi006.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T20:54:35.140 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:35.141 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:35.141 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:54:35.141 INFO:teuthology.orchestra.run.smithi006.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T20:54:35.141 INFO:teuthology.orchestra.run.smithi006.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T20:54:35.141 INFO:teuthology.orchestra.run.smithi006.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T20:54:35.141 INFO:teuthology.orchestra.run.smithi006.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T20:54:35.141 INFO:teuthology.orchestra.run.smithi006.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T20:54:35.141 INFO:teuthology.orchestra.run.smithi006.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T20:54:35.142 INFO:teuthology.orchestra.run.smithi006.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T20:54:35.142 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:54:35.142 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2024-09-10T20:54:35.957 DEBUG:teuthology.parallel:result is None 2024-09-10T20:54:35.958 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T20:54:36.113 DEBUG:teuthology.orchestra.run.smithi006:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T20:54:36.158 INFO:teuthology.orchestra.run.smithi006.stdout:19.3.0-4854.g8f219c47.el9 2024-09-10T20:54:36.159 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-10T20:54:36.159 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-10T20:54:36.161 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T20:54:36.317 DEBUG:teuthology.orchestra.run.smithi150:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T20:54:36.368 INFO:teuthology.orchestra.run.smithi150.stdout:19.3.0-4854.g8f219c47.el9 2024-09-10T20:54:36.368 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-10T20:54:36.368 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-10T20:54:36.370 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-10T20:54:36.370 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-10T20:54:36.371 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T20:54:36.433 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-10T20:54:36.433 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T20:54:36.496 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-10T20:54:36.496 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-10T20:54:36.496 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T20:54:36.555 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T20:54:36.658 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-10T20:54:36.658 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T20:54:36.716 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T20:54:36.813 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-10T20:54:36.813 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-10T20:54:36.813 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T20:54:36.869 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T20:54:36.967 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-10T20:54:36.967 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T20:54:37.023 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T20:54:37.120 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-10T20:54:37.120 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-10T20:54:37.120 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T20:54:37.178 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T20:54:37.274 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-10T20:54:37.275 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T20:54:37.330 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T20:54:37.425 INFO:teuthology.run_tasks:Running task ceph... 2024-09-10T20:54:37.507 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-10T20:54:37.507 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 777 /var/log/ceph 2024-09-10T20:54:37.512 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 777 /var/log/ceph 2024-09-10T20:54:37.569 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-10T20:54:37.569 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-10T20:54:37.573 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-10T20:54:37.628 INFO:tasks.ceph:Creating extra log directories... 2024-09-10T20:54:37.628 DEBUG:teuthology.orchestra.run.smithi006:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-10T20:54:37.632 DEBUG:teuthology.orchestra.run.smithi150:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-10T20:54:37.694 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-10T20:54:37.694 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-10T20:54:37.694 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-10T20:54:37.694 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-10T20:54:37.694 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-10T20:54:37.729 DEBUG:teuthology.orchestra.run.smithi006:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-10T20:54:37.908 DEBUG:teuthology.orchestra.run.smithi006:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-10T20:54:37.965 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-10T20:54:37.965 DEBUG:teuthology.orchestra.run.smithi150:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-10T20:54:38.000 DEBUG:teuthology.orchestra.run.smithi150:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-10T20:54:38.178 DEBUG:teuthology.orchestra.run.smithi150:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-10T20:54:38.239 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-10T20:54:38.239 INFO:tasks.ceph:config {'conf': {'client': {'pid file': ''}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-10T20:54:38.239 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899648', 'branch': 'wip-hemanth-testing-2024-09-10-0723', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/backtrace}', 'email': 'hyelloji@redhat.com', 'first_in_suite': False, 'job_id': '7899648', 'kernel': {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-hemanth-testing-2024-09-10-0723'}, 'ceph': {'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-hemanth-testing-2024-09-10-0723', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}}, 'owner': 'scheduled_hyelloji@teuthology', 'priority': 100, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6190, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'sleep_before_teardown': 0, 'subset': '479/1024', 'suite': 'fs', 'suite_branch': 'wip-hemanth-testing-2024-09-10-0723', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi006.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG3bYkgsBG0cXAsebJ6bU+tUJNrcXslOGNi57achBpRaTZWUz5IMprt+T23QDPT3b0Rf4Zd1n4Ytw3v/Qf0Z6Ns=', 'smithi150.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJOEd8NaSONnCGG/6kMJK/rNhFBCmycmknMhmFxKVseKkI3AMkQZO4BLrgmvo9MM/FEpOixtc+0UIEUTdPLe+Es='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}}, {'ceph': {'create_rbd_pool': False, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_backtrace']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-10_16:59:47', 'tube': 'smithi', 'user': 'hyelloji', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-10T20:54:38.240 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-10T20:54:38.245 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-10T20:54:38.279 DEBUG:teuthology.orchestra.run.smithi006:> sudo install -d -m0777 -- /var/run/ceph 2024-09-10T20:54:38.320 DEBUG:teuthology.orchestra.run.smithi150:> sudo install -d -m0777 -- /var/run/ceph 2024-09-10T20:54:38.376 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-10T20:54:38.376 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T20:54:38.412 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T20:54:38.412 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_1 2024-09-10T20:54:38.486 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T20:54:38.486 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T20:54:38.487 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 6h/6d Inode: 638 Links: 1 2024-09-10T20:54:38.487 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T20:54:38.487 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T20:54:38.487 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2024-09-10 20:54:26.987595697 +0000 2024-09-10T20:54:38.487 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2024-09-10 20:51:56.691971915 +0000 2024-09-10T20:54:38.487 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2024-09-10 20:51:56.691971915 +0000 2024-09-10T20:54:38.487 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: 2024-09-10 20:51:56.691971915 +0000 2024-09-10T20:54:38.487 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T20:54:38.580 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2024-09-10T20:54:38.580 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2024-09-10T20:54:38.580 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000312181 s, 1.6 MB/s 2024-09-10T20:54:38.583 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T20:54:38.619 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_2 2024-09-10T20:54:38.694 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T20:54:38.695 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T20:54:38.695 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 6h/6d Inode: 656 Links: 1 2024-09-10T20:54:38.695 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T20:54:38.695 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T20:54:38.695 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2024-09-10 20:54:26.988595686 +0000 2024-09-10T20:54:38.695 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2024-09-10 20:51:57.155966755 +0000 2024-09-10T20:54:38.695 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2024-09-10 20:51:57.155966755 +0000 2024-09-10T20:54:38.695 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: 2024-09-10 20:51:57.155966755 +0000 2024-09-10T20:54:38.695 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T20:54:38.787 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2024-09-10T20:54:38.787 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2024-09-10T20:54:38.787 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000281288 s, 1.8 MB/s 2024-09-10T20:54:38.789 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T20:54:38.826 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_3 2024-09-10T20:54:38.902 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T20:54:38.902 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T20:54:38.902 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 6h/6d Inode: 676 Links: 1 2024-09-10T20:54:38.902 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T20:54:38.902 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T20:54:38.903 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2024-09-10 20:54:26.989595675 +0000 2024-09-10T20:54:38.903 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2024-09-10 20:51:57.658961162 +0000 2024-09-10T20:54:38.903 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2024-09-10 20:51:57.658961162 +0000 2024-09-10T20:54:38.903 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: 2024-09-10 20:51:57.658961162 +0000 2024-09-10T20:54:38.903 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T20:54:38.996 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2024-09-10T20:54:38.997 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2024-09-10T20:54:38.997 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000244111 s, 2.1 MB/s 2024-09-10T20:54:38.999 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T20:54:39.035 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_4 2024-09-10T20:54:39.111 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T20:54:39.111 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T20:54:39.111 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 6h/6d Inode: 695 Links: 1 2024-09-10T20:54:39.111 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T20:54:39.111 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T20:54:39.111 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2024-09-10 20:54:26.990595664 +0000 2024-09-10T20:54:39.111 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2024-09-10 20:51:58.160955578 +0000 2024-09-10T20:54:39.111 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2024-09-10 20:51:58.160955578 +0000 2024-09-10T20:54:39.111 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: 2024-09-10 20:51:58.160955578 +0000 2024-09-10T20:54:39.112 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T20:54:39.203 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2024-09-10T20:54:39.203 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2024-09-10T20:54:39.203 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.0002843 s, 1.8 MB/s 2024-09-10T20:54:39.205 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T20:54:39.242 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T20:54:39.242 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-10T20:54:39.242 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T20:54:39.280 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T20:54:39.281 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_1 2024-09-10T20:54:39.358 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T20:54:39.358 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T20:54:39.358 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 6h/6d Inode: 632 Links: 1 2024-09-10T20:54:39.358 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T20:54:39.358 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T20:54:39.358 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-09-10 20:54:19.967283307 +0000 2024-09-10T20:54:39.358 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-09-10 20:51:53.712562544 +0000 2024-09-10T20:54:39.359 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-09-10 20:51:53.712562544 +0000 2024-09-10T20:54:39.359 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: 2024-09-10 20:51:53.712562544 +0000 2024-09-10T20:54:39.359 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T20:54:39.452 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-09-10T20:54:39.452 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-09-10T20:54:39.452 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000292542 s, 1.8 MB/s 2024-09-10T20:54:39.454 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T20:54:39.492 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_2 2024-09-10T20:54:39.567 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T20:54:39.567 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T20:54:39.567 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 6h/6d Inode: 651 Links: 1 2024-09-10T20:54:39.567 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T20:54:39.567 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T20:54:39.568 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-09-10 20:54:19.968283287 +0000 2024-09-10T20:54:39.568 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-09-10 20:51:54.182553690 +0000 2024-09-10T20:54:39.568 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-09-10 20:51:54.182553690 +0000 2024-09-10T20:54:39.568 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: 2024-09-10 20:51:54.182553690 +0000 2024-09-10T20:54:39.568 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T20:54:39.661 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-09-10T20:54:39.661 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-09-10T20:54:39.661 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000305687 s, 1.7 MB/s 2024-09-10T20:54:39.663 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T20:54:39.701 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_3 2024-09-10T20:54:39.776 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T20:54:39.776 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T20:54:39.776 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 6h/6d Inode: 670 Links: 1 2024-09-10T20:54:39.776 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T20:54:39.776 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T20:54:39.776 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-09-10 20:54:19.968283287 +0000 2024-09-10T20:54:39.776 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-09-10 20:51:54.680544308 +0000 2024-09-10T20:54:39.776 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-09-10 20:51:54.680544308 +0000 2024-09-10T20:54:39.777 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: 2024-09-10 20:51:54.680544308 +0000 2024-09-10T20:54:39.777 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T20:54:39.868 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-09-10T20:54:39.868 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-09-10T20:54:39.868 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000270112 s, 1.9 MB/s 2024-09-10T20:54:39.870 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T20:54:39.907 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_4 2024-09-10T20:54:39.982 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T20:54:39.982 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T20:54:39.982 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 6h/6d Inode: 689 Links: 1 2024-09-10T20:54:39.983 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T20:54:39.983 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T20:54:39.983 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-09-10 20:54:19.970283249 +0000 2024-09-10T20:54:39.983 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-09-10 20:51:55.156535340 +0000 2024-09-10T20:54:39.983 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-09-10 20:51:55.156535340 +0000 2024-09-10T20:54:39.983 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: 2024-09-10 20:51:55.156535340 +0000 2024-09-10T20:54:39.984 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T20:54:40.074 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-09-10T20:54:40.074 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-09-10T20:54:40.074 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000251714 s, 2.0 MB/s 2024-09-10T20:54:40.076 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T20:54:40.113 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T20:54:40.113 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi006.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi150.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-10T20:54:40.113 INFO:tasks.ceph:Generating config... 2024-09-10T20:54:40.114 INFO:tasks.ceph:[client] pid file = 2024-09-10T20:54:40.114 INFO:tasks.ceph:[mgr] client mount timeout = 30 2024-09-10T20:54:40.115 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-10T20:54:40.115 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-10T20:54:40.115 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-10T20:54:40.115 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-10T20:54:40.115 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-10T20:54:40.115 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-10T20:54:40.115 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-10T20:54:40.115 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-10T20:54:40.115 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-10T20:54:40.115 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-10T20:54:40.115 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-10T20:54:40.115 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-10T20:54:40.116 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-10T20:54:40.116 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-10T20:54:40.116 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-10T20:54:40.116 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-10T20:54:40.116 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-10T20:54:40.116 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-10T20:54:40.116 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-10T20:54:40.116 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-10T20:54:40.116 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-10T20:54:40.116 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-10T20:54:40.116 INFO:tasks.ceph:Setting up mon.a... 2024-09-10T20:54:40.117 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-10T20:54:40.216 INFO:teuthology.orchestra.run.smithi006.stdout:creating /etc/ceph/ceph.keyring 2024-09-10T20:54:40.223 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-10T20:54:40.311 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T20:54:40.366 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.6'), ('mon.b', '172.21.15.150'), ('mon.c', '[v2:172.21.15.150:3301,v1:172.21.15.150:6790]')] 2024-09-10T20:54:40.367 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.6,172.21.15.150,[v2:172.21.15.150:3301,v1:172.21.15.150:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'client mount timeout': 30, 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'pid file': ''}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}} 2024-09-10T20:54:40.367 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-10T20:54:40.367 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-10T20:54:40.402 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.6 --add b 172.21.15.150 --addv c '[v2:172.21.15.150:3301,v1:172.21.15.150:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-10T20:54:40.520 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-10T20:54:40.521 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool: generated fsid 9e04309e-61c3-4c78-82db-9576e465d98a 2024-09-10T20:54:40.521 INFO:teuthology.orchestra.run.smithi006.stdout:setting min_mon_release = quincy 2024-09-10T20:54:40.521 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 0 2024-09-10T20:54:40.521 INFO:teuthology.orchestra.run.smithi006.stdout:fsid 9e04309e-61c3-4c78-82db-9576e465d98a 2024-09-10T20:54:40.521 INFO:teuthology.orchestra.run.smithi006.stdout:last_changed 2024-09-10T20:54:40.517838+0000 2024-09-10T20:54:40.521 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-09-10T20:54:40.517838+0000 2024-09-10T20:54:40.521 INFO:teuthology.orchestra.run.smithi006.stdout:min_mon_release 17 (quincy) 2024-09-10T20:54:40.521 INFO:teuthology.orchestra.run.smithi006.stdout:election_strategy: 1 2024-09-10T20:54:40.521 INFO:teuthology.orchestra.run.smithi006.stdout:0: [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon.a 2024-09-10T20:54:40.521 INFO:teuthology.orchestra.run.smithi006.stdout:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-10T20:54:40.521 INFO:teuthology.orchestra.run.smithi006.stdout:2: [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] mon.c 2024-09-10T20:54:40.521 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-10T20:54:40.523 DEBUG:teuthology.orchestra.run.smithi006:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-10T20:54:40.557 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 9e04309e-61c3-4c78-82db-9576e465d98a... 2024-09-10T20:54:40.558 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T20:54:40.601 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T20:54:40.694 INFO:teuthology.orchestra.run.smithi006.stdout:[global] 2024-09-10T20:54:40.695 INFO:teuthology.orchestra.run.smithi006.stdout: chdir = "" 2024-09-10T20:54:40.695 INFO:teuthology.orchestra.run.smithi006.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T20:54:40.695 INFO:teuthology.orchestra.run.smithi006.stdout: auth supported = cephx 2024-09-10T20:54:40.695 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:54:40.695 INFO:teuthology.orchestra.run.smithi006.stdout: filestore xattr use omap = true 2024-09-10T20:54:40.695 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:54:40.695 INFO:teuthology.orchestra.run.smithi006.stdout: mon clock drift allowed = 1.000 2024-09-10T20:54:40.695 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:54:40.695 INFO:teuthology.orchestra.run.smithi006.stdout: osd crush chooseleaf type = 0 2024-09-10T20:54:40.695 INFO:teuthology.orchestra.run.smithi006.stdout: auth debug = true 2024-09-10T20:54:40.695 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:54:40.696 INFO:teuthology.orchestra.run.smithi006.stdout: ms die on old message = true 2024-09-10T20:54:40.696 INFO:teuthology.orchestra.run.smithi006.stdout: ms die on bug = true 2024-09-10T20:54:40.696 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:54:40.696 INFO:teuthology.orchestra.run.smithi006.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T20:54:40.696 INFO:teuthology.orchestra.run.smithi006.stdout: mon pg warn max object skew = 0 2024-09-10T20:54:40.696 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:54:40.696 INFO:teuthology.orchestra.run.smithi006.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T20:54:40.696 INFO:teuthology.orchestra.run.smithi006.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T20:54:40.696 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:54:40.696 INFO:teuthology.orchestra.run.smithi006.stdout: osd pool default size = 2 2024-09-10T20:54:40.696 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:54:40.696 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd allow primary affinity = true 2024-09-10T20:54:40.696 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd allow pg remap = true 2024-09-10T20:54:40.696 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on legacy crush tunables = false 2024-09-10T20:54:40.697 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on crush straw calc version zero = false 2024-09-10T20:54:40.697 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on no sortbitwise = false 2024-09-10T20:54:40.697 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on osd down out interval zero = false 2024-09-10T20:54:40.697 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on too few osds = false 2024-09-10T20:54:40.697 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T20:54:40.697 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T20:54:40.697 INFO:teuthology.orchestra.run.smithi006.stdout: mon_allow_pool_size_one = true 2024-09-10T20:54:40.697 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:54:40.697 INFO:teuthology.orchestra.run.smithi006.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T20:54:40.697 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:54:40.697 INFO:teuthology.orchestra.run.smithi006.stdout: osd default data pool replay window = 5 2024-09-10T20:54:40.697 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:54:40.697 INFO:teuthology.orchestra.run.smithi006.stdout: mon allow pool delete = true 2024-09-10T20:54:40.698 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:54:40.698 INFO:teuthology.orchestra.run.smithi006.stdout: mon cluster log file level = debug 2024-09-10T20:54:40.698 INFO:teuthology.orchestra.run.smithi006.stdout: debug asserts on shutdown = true 2024-09-10T20:54:40.698 INFO:teuthology.orchestra.run.smithi006.stdout: mon health detail to clog = false 2024-09-10T20:54:40.698 INFO:teuthology.orchestra.run.smithi006.stdout: mon host = "172.21.15.6,172.21.15.150,[v2:172.21.15.150:3301,v1:172.21.15.150:6790]" 2024-09-10T20:54:40.698 INFO:teuthology.orchestra.run.smithi006.stdout: fsid = 9e04309e-61c3-4c78-82db-9576e465d98a 2024-09-10T20:54:40.698 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:54:40.698 INFO:teuthology.orchestra.run.smithi006.stdout:[osd] 2024-09-10T20:54:40.698 INFO:teuthology.orchestra.run.smithi006.stdout: osd journal size = 100 2024-09-10T20:54:40.698 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:54:40.698 INFO:teuthology.orchestra.run.smithi006.stdout: osd scrub load threshold = 5.0 2024-09-10T20:54:40.698 INFO:teuthology.orchestra.run.smithi006.stdout: osd scrub max interval = 600 2024-09-10T20:54:40.698 INFO:teuthology.orchestra.run.smithi006.stdout: osd mclock profile = high_recovery_ops 2024-09-10T20:54:40.698 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:54:40.699 INFO:teuthology.orchestra.run.smithi006.stdout: osd recover clone overlap = true 2024-09-10T20:54:40.699 INFO:teuthology.orchestra.run.smithi006.stdout: osd recovery max chunk = 1048576 2024-09-10T20:54:40.699 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:54:40.699 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug shutdown = true 2024-09-10T20:54:40.699 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug op order = true 2024-09-10T20:54:40.699 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug verify stray on activate = true 2024-09-10T20:54:40.699 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug trim objects = true 2024-09-10T20:54:40.699 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:54:40.699 INFO:teuthology.orchestra.run.smithi006.stdout: osd open classes on start = true 2024-09-10T20:54:40.699 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug pg log writeout = true 2024-09-10T20:54:40.699 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:54:40.699 INFO:teuthology.orchestra.run.smithi006.stdout: osd deep scrub update digest min age = 30 2024-09-10T20:54:40.699 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:54:40.699 INFO:teuthology.orchestra.run.smithi006.stdout: osd map max advance = 10 2024-09-10T20:54:40.700 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:54:40.700 INFO:teuthology.orchestra.run.smithi006.stdout: journal zero on create = true 2024-09-10T20:54:40.700 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:54:40.700 INFO:teuthology.orchestra.run.smithi006.stdout: filestore ondisk finisher threads = 3 2024-09-10T20:54:40.700 INFO:teuthology.orchestra.run.smithi006.stdout: filestore apply finisher threads = 3 2024-09-10T20:54:40.700 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:54:40.700 INFO:teuthology.orchestra.run.smithi006.stdout: bdev debug aio = true 2024-09-10T20:54:40.700 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug misdirected ops = true 2024-09-10T20:54:40.700 INFO:teuthology.orchestra.run.smithi006.stdout: bdev async discard = True 2024-09-10T20:54:40.700 INFO:teuthology.orchestra.run.smithi006.stdout: bdev enable discard = True 2024-09-10T20:54:40.700 INFO:teuthology.orchestra.run.smithi006.stdout: bluestore allocator = bitmap 2024-09-10T20:54:40.700 INFO:teuthology.orchestra.run.smithi006.stdout: bluestore block size = 96636764160 2024-09-10T20:54:40.700 INFO:teuthology.orchestra.run.smithi006.stdout: bluestore fsck on mount = True 2024-09-10T20:54:40.701 INFO:teuthology.orchestra.run.smithi006.stdout: debug bluefs = 1/20 2024-09-10T20:54:40.701 INFO:teuthology.orchestra.run.smithi006.stdout: debug bluestore = 1/20 2024-09-10T20:54:40.701 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2024-09-10T20:54:40.701 INFO:teuthology.orchestra.run.smithi006.stdout: debug osd = 20 2024-09-10T20:54:40.701 INFO:teuthology.orchestra.run.smithi006.stdout: debug rocksdb = 4/10 2024-09-10T20:54:40.701 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T20:54:40.701 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd full ratio = 0.9 2024-09-10T20:54:40.701 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd nearfull ratio = 0.8 2024-09-10T20:54:40.701 INFO:teuthology.orchestra.run.smithi006.stdout: osd failsafe full ratio = 0.95 2024-09-10T20:54:40.701 INFO:teuthology.orchestra.run.smithi006.stdout: osd objectstore = bluestore 2024-09-10T20:54:40.701 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:54:40.701 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr] 2024-09-10T20:54:40.701 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2024-09-10T20:54:40.702 INFO:teuthology.orchestra.run.smithi006.stdout: debug mgr = 20 2024-09-10T20:54:40.702 INFO:teuthology.orchestra.run.smithi006.stdout: debug mon = 20 2024-09-10T20:54:40.702 INFO:teuthology.orchestra.run.smithi006.stdout: debug auth = 20 2024-09-10T20:54:40.702 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min pgs per osd = 4 2024-09-10T20:54:40.702 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min bytes per osd = 10 2024-09-10T20:54:40.702 INFO:teuthology.orchestra.run.smithi006.stdout: mgr/telemetry/nag = false 2024-09-10T20:54:40.702 INFO:teuthology.orchestra.run.smithi006.stdout: client mount timeout = 30 2024-09-10T20:54:40.702 INFO:teuthology.orchestra.run.smithi006.stdout: debug client = 20 2024-09-10T20:54:40.702 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:54:40.702 INFO:teuthology.orchestra.run.smithi006.stdout:[mon] 2024-09-10T20:54:40.702 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2024-09-10T20:54:40.702 INFO:teuthology.orchestra.run.smithi006.stdout: debug mon = 20 2024-09-10T20:54:40.702 INFO:teuthology.orchestra.run.smithi006.stdout: debug paxos = 20 2024-09-10T20:54:40.702 INFO:teuthology.orchestra.run.smithi006.stdout: debug auth = 20 2024-09-10T20:54:40.703 INFO:teuthology.orchestra.run.smithi006.stdout: mon data avail warn = 5 2024-09-10T20:54:40.703 INFO:teuthology.orchestra.run.smithi006.stdout: mon mgr mkfs grace = 240 2024-09-10T20:54:40.703 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min pgs per osd = 4 2024-09-10T20:54:40.703 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd reporter subtree level = osd 2024-09-10T20:54:40.703 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd prime pg temp = true 2024-09-10T20:54:40.703 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min bytes per osd = 10 2024-09-10T20:54:40.703 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:54:40.703 INFO:teuthology.orchestra.run.smithi006.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T20:54:40.703 INFO:teuthology.orchestra.run.smithi006.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T20:54:40.703 INFO:teuthology.orchestra.run.smithi006.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T20:54:40.703 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:54:40.703 INFO:teuthology.orchestra.run.smithi006.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T20:54:40.703 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T20:54:40.704 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T20:54:40.704 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:54:40.704 INFO:teuthology.orchestra.run.smithi006.stdout: # 1m isn't quite enough 2024-09-10T20:54:40.704 INFO:teuthology.orchestra.run.smithi006.stdout: mon_down_mkfs_grace = 2m 2024-09-10T20:54:40.704 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:54:40.704 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_filestore_osds = false 2024-09-10T20:54:40.704 INFO:teuthology.orchestra.run.smithi006.stdout: mon down mkfs grace = 300 2024-09-10T20:54:40.704 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:54:40.704 INFO:teuthology.orchestra.run.smithi006.stdout:[client] 2024-09-10T20:54:40.704 INFO:teuthology.orchestra.run.smithi006.stdout: rgw cache enabled = true 2024-09-10T20:54:40.704 INFO:teuthology.orchestra.run.smithi006.stdout: rgw enable ops log = true 2024-09-10T20:54:40.704 INFO:teuthology.orchestra.run.smithi006.stdout: rgw enable usage log = true 2024-09-10T20:54:40.704 INFO:teuthology.orchestra.run.smithi006.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T20:54:40.704 INFO:teuthology.orchestra.run.smithi006.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T20:54:40.704 INFO:teuthology.orchestra.run.smithi006.stdout: pid file = "" 2024-09-10T20:54:40.705 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.a] 2024-09-10T20:54:40.705 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.b] 2024-09-10T20:54:40.705 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.c] 2024-09-10T20:54:40.705 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.a] 2024-09-10T20:54:40.705 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.c] 2024-09-10T20:54:40.705 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.b] 2024-09-10T20:54:40.705 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.d] 2024-09-10T20:54:40.705 INFO:teuthology.orchestra.run.smithi150.stdout:[global] 2024-09-10T20:54:40.706 INFO:teuthology.orchestra.run.smithi150.stdout: chdir = "" 2024-09-10T20:54:40.706 INFO:teuthology.orchestra.run.smithi150.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T20:54:40.706 INFO:teuthology.orchestra.run.smithi150.stdout: auth supported = cephx 2024-09-10T20:54:40.706 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:54:40.706 INFO:teuthology.orchestra.run.smithi150.stdout: filestore xattr use omap = true 2024-09-10T20:54:40.706 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:54:40.706 INFO:teuthology.orchestra.run.smithi150.stdout: mon clock drift allowed = 1.000 2024-09-10T20:54:40.706 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:54:40.706 INFO:teuthology.orchestra.run.smithi150.stdout: osd crush chooseleaf type = 0 2024-09-10T20:54:40.706 INFO:teuthology.orchestra.run.smithi150.stdout: auth debug = true 2024-09-10T20:54:40.706 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:54:40.706 INFO:teuthology.orchestra.run.smithi150.stdout: ms die on old message = true 2024-09-10T20:54:40.706 INFO:teuthology.orchestra.run.smithi150.stdout: ms die on bug = true 2024-09-10T20:54:40.706 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:54:40.706 INFO:teuthology.orchestra.run.smithi150.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T20:54:40.707 INFO:teuthology.orchestra.run.smithi150.stdout: mon pg warn max object skew = 0 2024-09-10T20:54:40.707 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:54:40.707 INFO:teuthology.orchestra.run.smithi150.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T20:54:40.707 INFO:teuthology.orchestra.run.smithi150.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T20:54:40.707 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:54:40.707 INFO:teuthology.orchestra.run.smithi150.stdout: osd pool default size = 2 2024-09-10T20:54:40.707 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:54:40.707 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd allow primary affinity = true 2024-09-10T20:54:40.707 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd allow pg remap = true 2024-09-10T20:54:40.707 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on legacy crush tunables = false 2024-09-10T20:54:40.707 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on crush straw calc version zero = false 2024-09-10T20:54:40.707 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on no sortbitwise = false 2024-09-10T20:54:40.707 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on osd down out interval zero = false 2024-09-10T20:54:40.707 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on too few osds = false 2024-09-10T20:54:40.708 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T20:54:40.708 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T20:54:40.708 INFO:teuthology.orchestra.run.smithi150.stdout: mon_allow_pool_size_one = true 2024-09-10T20:54:40.708 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:54:40.708 INFO:teuthology.orchestra.run.smithi150.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T20:54:40.708 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:54:40.708 INFO:teuthology.orchestra.run.smithi150.stdout: osd default data pool replay window = 5 2024-09-10T20:54:40.708 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:54:40.708 INFO:teuthology.orchestra.run.smithi150.stdout: mon allow pool delete = true 2024-09-10T20:54:40.708 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:54:40.708 INFO:teuthology.orchestra.run.smithi150.stdout: mon cluster log file level = debug 2024-09-10T20:54:40.708 INFO:teuthology.orchestra.run.smithi150.stdout: debug asserts on shutdown = true 2024-09-10T20:54:40.708 INFO:teuthology.orchestra.run.smithi150.stdout: mon health detail to clog = false 2024-09-10T20:54:40.708 INFO:teuthology.orchestra.run.smithi150.stdout: mon host = "172.21.15.6,172.21.15.150,[v2:172.21.15.150:3301,v1:172.21.15.150:6790]" 2024-09-10T20:54:40.709 INFO:teuthology.orchestra.run.smithi150.stdout: fsid = 9e04309e-61c3-4c78-82db-9576e465d98a 2024-09-10T20:54:40.709 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:54:40.709 INFO:teuthology.orchestra.run.smithi150.stdout:[osd] 2024-09-10T20:54:40.709 INFO:teuthology.orchestra.run.smithi150.stdout: osd journal size = 100 2024-09-10T20:54:40.709 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:54:40.709 INFO:teuthology.orchestra.run.smithi150.stdout: osd scrub load threshold = 5.0 2024-09-10T20:54:40.709 INFO:teuthology.orchestra.run.smithi150.stdout: osd scrub max interval = 600 2024-09-10T20:54:40.709 INFO:teuthology.orchestra.run.smithi150.stdout: osd mclock profile = high_recovery_ops 2024-09-10T20:54:40.709 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:54:40.709 INFO:teuthology.orchestra.run.smithi150.stdout: osd recover clone overlap = true 2024-09-10T20:54:40.709 INFO:teuthology.orchestra.run.smithi150.stdout: osd recovery max chunk = 1048576 2024-09-10T20:54:40.709 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:54:40.709 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug shutdown = true 2024-09-10T20:54:40.709 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug op order = true 2024-09-10T20:54:40.710 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug verify stray on activate = true 2024-09-10T20:54:40.710 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug trim objects = true 2024-09-10T20:54:40.710 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:54:40.710 INFO:teuthology.orchestra.run.smithi150.stdout: osd open classes on start = true 2024-09-10T20:54:40.710 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug pg log writeout = true 2024-09-10T20:54:40.710 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:54:40.710 INFO:teuthology.orchestra.run.smithi150.stdout: osd deep scrub update digest min age = 30 2024-09-10T20:54:40.710 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:54:40.710 INFO:teuthology.orchestra.run.smithi150.stdout: osd map max advance = 10 2024-09-10T20:54:40.710 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:54:40.710 INFO:teuthology.orchestra.run.smithi150.stdout: journal zero on create = true 2024-09-10T20:54:40.710 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:54:40.710 INFO:teuthology.orchestra.run.smithi150.stdout: filestore ondisk finisher threads = 3 2024-09-10T20:54:40.710 INFO:teuthology.orchestra.run.smithi150.stdout: filestore apply finisher threads = 3 2024-09-10T20:54:40.711 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:54:40.711 INFO:teuthology.orchestra.run.smithi150.stdout: bdev debug aio = true 2024-09-10T20:54:40.711 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug misdirected ops = true 2024-09-10T20:54:40.711 INFO:teuthology.orchestra.run.smithi150.stdout: bdev async discard = True 2024-09-10T20:54:40.711 INFO:teuthology.orchestra.run.smithi150.stdout: bdev enable discard = True 2024-09-10T20:54:40.711 INFO:teuthology.orchestra.run.smithi150.stdout: bluestore allocator = bitmap 2024-09-10T20:54:40.711 INFO:teuthology.orchestra.run.smithi150.stdout: bluestore block size = 96636764160 2024-09-10T20:54:40.711 INFO:teuthology.orchestra.run.smithi150.stdout: bluestore fsck on mount = True 2024-09-10T20:54:40.711 INFO:teuthology.orchestra.run.smithi150.stdout: debug bluefs = 1/20 2024-09-10T20:54:40.711 INFO:teuthology.orchestra.run.smithi150.stdout: debug bluestore = 1/20 2024-09-10T20:54:40.711 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2024-09-10T20:54:40.711 INFO:teuthology.orchestra.run.smithi150.stdout: debug osd = 20 2024-09-10T20:54:40.711 INFO:teuthology.orchestra.run.smithi150.stdout: debug rocksdb = 4/10 2024-09-10T20:54:40.711 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T20:54:40.711 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd full ratio = 0.9 2024-09-10T20:54:40.712 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd nearfull ratio = 0.8 2024-09-10T20:54:40.712 INFO:teuthology.orchestra.run.smithi150.stdout: osd failsafe full ratio = 0.95 2024-09-10T20:54:40.712 INFO:teuthology.orchestra.run.smithi150.stdout: osd objectstore = bluestore 2024-09-10T20:54:40.712 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:54:40.712 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr] 2024-09-10T20:54:40.712 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2024-09-10T20:54:40.712 INFO:teuthology.orchestra.run.smithi150.stdout: debug mgr = 20 2024-09-10T20:54:40.712 INFO:teuthology.orchestra.run.smithi150.stdout: debug mon = 20 2024-09-10T20:54:40.712 INFO:teuthology.orchestra.run.smithi150.stdout: debug auth = 20 2024-09-10T20:54:40.712 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min pgs per osd = 4 2024-09-10T20:54:40.712 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min bytes per osd = 10 2024-09-10T20:54:40.712 INFO:teuthology.orchestra.run.smithi150.stdout: mgr/telemetry/nag = false 2024-09-10T20:54:40.712 INFO:teuthology.orchestra.run.smithi150.stdout: client mount timeout = 30 2024-09-10T20:54:40.713 INFO:teuthology.orchestra.run.smithi150.stdout: debug client = 20 2024-09-10T20:54:40.713 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:54:40.713 INFO:teuthology.orchestra.run.smithi150.stdout:[mon] 2024-09-10T20:54:40.713 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2024-09-10T20:54:40.713 INFO:teuthology.orchestra.run.smithi150.stdout: debug mon = 20 2024-09-10T20:54:40.713 INFO:teuthology.orchestra.run.smithi150.stdout: debug paxos = 20 2024-09-10T20:54:40.713 INFO:teuthology.orchestra.run.smithi150.stdout: debug auth = 20 2024-09-10T20:54:40.713 INFO:teuthology.orchestra.run.smithi150.stdout: mon data avail warn = 5 2024-09-10T20:54:40.713 INFO:teuthology.orchestra.run.smithi150.stdout: mon mgr mkfs grace = 240 2024-09-10T20:54:40.713 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min pgs per osd = 4 2024-09-10T20:54:40.713 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd reporter subtree level = osd 2024-09-10T20:54:40.713 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd prime pg temp = true 2024-09-10T20:54:40.713 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min bytes per osd = 10 2024-09-10T20:54:40.714 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:54:40.714 INFO:teuthology.orchestra.run.smithi150.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T20:54:40.714 INFO:teuthology.orchestra.run.smithi150.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T20:54:40.714 INFO:teuthology.orchestra.run.smithi150.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T20:54:40.714 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:54:40.714 INFO:teuthology.orchestra.run.smithi150.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T20:54:40.714 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T20:54:40.714 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T20:54:40.714 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:54:40.714 INFO:teuthology.orchestra.run.smithi150.stdout: # 1m isn't quite enough 2024-09-10T20:54:40.714 INFO:teuthology.orchestra.run.smithi150.stdout: mon_down_mkfs_grace = 2m 2024-09-10T20:54:40.714 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:54:40.714 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_filestore_osds = false 2024-09-10T20:54:40.714 INFO:teuthology.orchestra.run.smithi150.stdout: mon down mkfs grace = 300 2024-09-10T20:54:40.714 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-10T20:54:40.715 INFO:teuthology.orchestra.run.smithi150.stdout:[client] 2024-09-10T20:54:40.715 INFO:teuthology.orchestra.run.smithi150.stdout: rgw cache enabled = true 2024-09-10T20:54:40.715 INFO:teuthology.orchestra.run.smithi150.stdout: rgw enable ops log = true 2024-09-10T20:54:40.715 INFO:teuthology.orchestra.run.smithi150.stdout: rgw enable usage log = true 2024-09-10T20:54:40.715 INFO:teuthology.orchestra.run.smithi150.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T20:54:40.715 INFO:teuthology.orchestra.run.smithi150.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T20:54:40.715 INFO:teuthology.orchestra.run.smithi150.stdout: pid file = "" 2024-09-10T20:54:40.715 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.a] 2024-09-10T20:54:40.715 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.b] 2024-09-10T20:54:40.715 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.c] 2024-09-10T20:54:40.715 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.a] 2024-09-10T20:54:40.715 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.c] 2024-09-10T20:54:40.715 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.b] 2024-09-10T20:54:40.715 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.d] 2024-09-10T20:54:40.726 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-10T20:54:40.727 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-10T20:54:40.824 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-10T20:54:40.824 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-10T20:54:40.825 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-10T20:54:40.859 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-10T20:54:40.859 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-10T20:54:40.934 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi006.front.sepia.ceph.com 2024-09-10T20:54:40.934 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-10T20:54:40.934 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-10T20:54:40.934 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T20:54:41.052 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-10T20:54:41.052 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-10T20:54:41.126 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi150.front.sepia.ceph.com 2024-09-10T20:54:41.126 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-10T20:54:41.126 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-10T20:54:41.126 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T20:54:41.205 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-10T20:54:41.205 DEBUG:teuthology.orchestra.run.smithi150:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-10T20:54:41.281 INFO:tasks.ceph:Setting up mon nodes... 2024-09-10T20:54:41.282 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-10T20:54:41.282 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-10T20:54:41.386 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-10T20:54:41.392 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-10T20:54:41.525 INFO:teuthology.orchestra.run.smithi150.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-10T20:54:41.532 INFO:tasks.ceph:Setting up mds nodes... 2024-09-10T20:54:41.532 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-10T20:54:41.636 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-10T20:54:41.641 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-10T20:54:41.697 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-10T20:54:41.800 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-10T20:54:41.805 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-10T20:54:41.861 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-10T20:54:41.965 INFO:teuthology.orchestra.run.smithi150.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-10T20:54:41.971 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-10T20:54:42.027 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-10T20:54:42.131 INFO:teuthology.orchestra.run.smithi150.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-10T20:54:42.136 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-10T20:54:42.191 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-10T20:54:42.192 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-10T20:54:42.273 INFO:teuthology.orchestra.run.smithi006.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-10T20:54:42.301 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-10T20:54:42.381 INFO:teuthology.orchestra.run.smithi006.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-10T20:54:42.409 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-10T20:54:42.490 INFO:teuthology.orchestra.run.smithi150.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-10T20:54:42.517 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-10T20:54:42.598 INFO:teuthology.orchestra.run.smithi150.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-10T20:54:42.626 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-10T20:54:42.626 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi006.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi150.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-10T20:54:42.626 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-10T20:54:42.682 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T20:54:42.682 INFO:tasks.ceph:role: osd.0 2024-09-10T20:54:42.683 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi006.front.sepia.ceph.com 2024-09-10T20:54:42.683 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-10T20:54:42.745 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T20:54:42.745 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T20:54:42.745 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T20:54:42.745 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T20:54:42.745 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T20:54:42.745 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2024-09-10T20:54:42.745 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T20:54:42.745 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T20:54:42.745 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T20:54:42.745 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T20:54:43.156 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2024-09-10T20:54:43.160 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2024-09-10T20:54:43.160 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-10T20:54:43.270 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-10T20:54:43.336 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-10T20:54:43.392 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T20:54:43.392 INFO:tasks.ceph:role: osd.1 2024-09-10T20:54:43.392 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi006.front.sepia.ceph.com 2024-09-10T20:54:43.392 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-10T20:54:43.455 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T20:54:43.455 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T20:54:43.455 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T20:54:43.455 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T20:54:43.455 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T20:54:43.455 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2024-09-10T20:54:43.455 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T20:54:43.455 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T20:54:43.456 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T20:54:43.456 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T20:54:43.814 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2024-09-10T20:54:43.818 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2024-09-10T20:54:43.818 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-10T20:54:43.903 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-10T20:54:43.964 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-10T20:54:44.020 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T20:54:44.020 INFO:tasks.ceph:role: osd.2 2024-09-10T20:54:44.020 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi006.front.sepia.ceph.com 2024-09-10T20:54:44.020 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-10T20:54:44.082 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T20:54:44.082 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T20:54:44.082 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T20:54:44.082 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T20:54:44.082 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T20:54:44.083 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2024-09-10T20:54:44.083 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T20:54:44.083 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T20:54:44.083 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T20:54:44.083 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T20:54:44.475 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2024-09-10T20:54:44.479 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2024-09-10T20:54:44.479 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-10T20:54:44.584 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-10T20:54:44.647 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-10T20:54:44.702 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T20:54:44.702 INFO:tasks.ceph:role: osd.3 2024-09-10T20:54:44.702 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi006.front.sepia.ceph.com 2024-09-10T20:54:44.702 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-10T20:54:44.766 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T20:54:44.766 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T20:54:44.766 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T20:54:44.766 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T20:54:44.766 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T20:54:44.766 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2024-09-10T20:54:44.766 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T20:54:44.766 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T20:54:44.766 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T20:54:44.767 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T20:54:45.153 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2024-09-10T20:54:45.157 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2024-09-10T20:54:45.157 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-10T20:54:45.298 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-10T20:54:45.361 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T20:54:45.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:54:45.487+0000 7f684dab6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-10T20:54:45.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:54:45.489+0000 7f684dab6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-10T20:54:45.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:54:45.489+0000 7f684dab6640 -1 bdev(0x55d50e065800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-10T20:54:45.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:54:45.489+0000 7f684dab6640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-10T20:54:48.528 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-10T20:54:48.589 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T20:54:48.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:54:48.678+0000 7f2477831640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-10T20:54:48.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:54:48.679+0000 7f2477831640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-10T20:54:48.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:54:48.679+0000 7f2477831640 -1 bdev(0x5649afc05800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-10T20:54:48.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:54:48.679+0000 7f2477831640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-10T20:54:51.711 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-10T20:54:51.772 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T20:54:51.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:54:51.861+0000 7ff1c0ba4640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-10T20:54:51.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:54:51.862+0000 7ff1c0ba4640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-10T20:54:51.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:54:51.862+0000 7ff1c0ba4640 -1 bdev(0x55d8a25f5800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-10T20:54:51.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:54:51.862+0000 7ff1c0ba4640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-10T20:54:54.895 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-10T20:54:54.956 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T20:54:55.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:54:55.046+0000 7fa29a1cc640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-10T20:54:55.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:54:55.047+0000 7fa29a1cc640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-10T20:54:55.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:54:55.047+0000 7fa29a1cc640 -1 bdev(0x55f484295800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-10T20:54:55.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:54:55.047+0000 7fa29a1cc640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-10T20:54:58.061 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-10T20:54:58.120 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-10T20:54:58.182 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T20:54:58.182 INFO:tasks.ceph:role: osd.4 2024-09-10T20:54:58.182 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-10T20:54:58.182 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-10T20:54:58.247 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T20:54:58.247 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T20:54:58.247 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T20:54:58.247 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T20:54:58.247 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T20:54:58.247 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2024-09-10T20:54:58.247 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T20:54:58.247 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T20:54:58.247 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T20:54:58.247 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T20:54:58.655 INFO:teuthology.orchestra.run.smithi150.stdout:Discarding blocks...Done. 2024-09-10T20:54:58.659 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2024-09-10T20:54:58.660 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-10T20:54:58.792 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-10T20:54:58.858 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-10T20:54:58.913 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T20:54:58.914 INFO:tasks.ceph:role: osd.5 2024-09-10T20:54:58.914 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-10T20:54:58.914 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-10T20:54:58.977 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T20:54:58.978 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T20:54:58.978 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T20:54:58.978 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T20:54:58.978 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T20:54:58.978 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2024-09-10T20:54:58.978 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T20:54:58.978 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T20:54:58.978 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T20:54:58.978 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T20:54:59.332 INFO:teuthology.orchestra.run.smithi150.stdout:Discarding blocks...Done. 2024-09-10T20:54:59.336 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2024-09-10T20:54:59.336 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-10T20:54:59.424 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-10T20:54:59.488 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-10T20:54:59.548 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T20:54:59.548 INFO:tasks.ceph:role: osd.6 2024-09-10T20:54:59.548 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-10T20:54:59.548 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-10T20:54:59.611 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T20:54:59.611 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T20:54:59.611 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T20:54:59.611 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T20:54:59.611 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T20:54:59.611 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2024-09-10T20:54:59.611 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T20:54:59.611 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T20:54:59.611 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T20:54:59.612 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T20:54:59.998 INFO:teuthology.orchestra.run.smithi150.stdout:Discarding blocks...Done. 2024-09-10T20:55:00.002 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2024-09-10T20:55:00.003 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-10T20:55:00.104 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-10T20:55:00.166 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-10T20:55:00.221 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T20:55:00.222 INFO:tasks.ceph:role: osd.7 2024-09-10T20:55:00.222 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-10T20:55:00.222 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-10T20:55:00.285 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T20:55:00.285 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T20:55:00.285 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T20:55:00.285 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T20:55:00.285 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T20:55:00.286 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2024-09-10T20:55:00.286 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T20:55:00.286 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T20:55:00.286 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T20:55:00.286 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T20:55:00.708 INFO:teuthology.orchestra.run.smithi150.stdout:Discarding blocks...Done. 2024-09-10T20:55:00.712 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2024-09-10T20:55:00.712 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-10T20:55:00.840 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-10T20:55:00.906 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T20:55:01.015 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:01.011+0000 7fd47822f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-10T20:55:01.021 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:01.017+0000 7fd47822f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-10T20:55:01.021 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:01.017+0000 7fd47822f640 -1 bdev(0x564902af5800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-10T20:55:01.021 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:01.017+0000 7fd47822f640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-10T20:55:04.038 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-10T20:55:04.096 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T20:55:04.186 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:04.182+0000 7f727f815640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-10T20:55:04.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:04.183+0000 7f727f815640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-10T20:55:04.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:04.183+0000 7f727f815640 -1 bdev(0x563e2e029800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-10T20:55:04.187 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:04.183+0000 7f727f815640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-10T20:55:07.230 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-10T20:55:07.286 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T20:55:07.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:07.373+0000 7fdde9db0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-10T20:55:07.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:07.373+0000 7fdde9db0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-10T20:55:07.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:07.374+0000 7fdde9db0640 -1 bdev(0x55db1d59b800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-10T20:55:07.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:07.374+0000 7fdde9db0640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-10T20:55:08.242 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T20:55:08.250 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T20:55:10.401 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-10T20:55:10.463 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T20:55:10.554 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:10.550+0000 7f08bed89640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-10T20:55:10.555 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:10.551+0000 7f08bed89640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-10T20:55:10.555 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:10.551+0000 7f08bed89640 -1 bdev(0x5574433b3800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-10T20:55:10.555 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:10.551+0000 7f08bed89640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-10T20:55:13.581 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-10T20:55:13.637 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-10T20:55:13.638 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-10T20:55:13.638 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-10T20:55:13.700 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-10T20:55:13.700 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-10T20:55:13.799 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-10T20:55:13.799 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-10T20:55:13.898 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-10T20:55:13.898 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-10T20:55:13.995 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-10T20:55:13.995 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-10T20:55:14.092 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-10T20:55:14.092 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-10T20:55:14.188 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-10T20:55:14.188 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-10T20:55:14.283 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-10T20:55:14.283 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-10T20:55:14.339 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-10T20:55:14.339 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-10T20:55:14.435 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-10T20:55:14.435 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-10T20:55:14.530 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-10T20:55:14.530 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-10T20:55:14.626 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-10T20:55:14.626 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-10T20:55:14.722 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-10T20:55:14.722 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-10T20:55:14.817 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-10T20:55:14.817 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-10T20:55:14.912 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-10T20:55:14.913 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-10T20:55:14.951 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-10T20:55:14.951 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-10T20:55:15.029 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-10T20:55:15.029 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-10T20:55:15.063 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-10T20:55:15.064 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-10T20:55:15.138 INFO:tasks.ceph:Adding keys to all mons... 2024-09-10T20:55:15.138 DEBUG:teuthology.orchestra.run.smithi006:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-10T20:55:15.143 DEBUG:teuthology.orchestra.run.smithi150:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-10T20:55:15.195 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr.y] 2024-09-10T20:55:15.195 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQARsuBm64LlFhAAAVIB4dikwMdIwmY8qA9bTg== 2024-09-10T20:55:15.195 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.a] 2024-09-10T20:55:15.196 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQARsuBmk4/LJRAAXSZjQOCY1WqwkCk+HIu8cg== 2024-09-10T20:55:15.196 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.c] 2024-09-10T20:55:15.196 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQARsuBmlJqHLxAAJU7v97KLRyCoVfQRBPPvog== 2024-09-10T20:55:15.196 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.0] 2024-09-10T20:55:15.196 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAVsuBmXwgXHRAA89mA1xkQvChOC+LklFyOBw== 2024-09-10T20:55:15.196 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.1] 2024-09-10T20:55:15.196 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAYsuBmuoWEKBAA+0FiqnZB10NjUy55/z39bg== 2024-09-10T20:55:15.196 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.2] 2024-09-10T20:55:15.196 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAbsuBmsFJpMxAAIiax40up1IZ7++e1xUwxOw== 2024-09-10T20:55:15.196 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.3] 2024-09-10T20:55:15.196 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAfsuBmcI3XAhAAmhBuOa922xY0GGPo9ysLLw== 2024-09-10T20:55:15.196 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr.x] 2024-09-10T20:55:15.197 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQARsuBmLy8rHxAAZ44xGXvE2mJvDhjRVsyzQw== 2024-09-10T20:55:15.197 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.b] 2024-09-10T20:55:15.197 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQARsuBmXbdeORAAVuyYaPlnRkyNSt0FXamAoQ== 2024-09-10T20:55:15.197 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.d] 2024-09-10T20:55:15.197 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQASsuBmGiWrBxAAcKZGtVlOMsx0jIyl6kWrcQ== 2024-09-10T20:55:15.197 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.4] 2024-09-10T20:55:15.197 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAlsuBmSvq7ABAAeJ/S0KQwg9kF67WggwRuiw== 2024-09-10T20:55:15.197 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.5] 2024-09-10T20:55:15.197 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAosuBmCbH4ChAAZvLHlJLuKMy4VCIreeaMnw== 2024-09-10T20:55:15.197 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.6] 2024-09-10T20:55:15.197 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQArsuBm/DFVFhAAaHlXz0HnV6DBdYho0IxqOw== 2024-09-10T20:55:15.197 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.7] 2024-09-10T20:55:15.197 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAusuBmKU/kIBAAR2TxXPR6Yv7E61B/JYaVYA== 2024-09-10T20:55:15.198 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2024-09-10T20:55:15.198 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQASsuBmdMMgEBAAKC0NFMDWd/XK9Za4e+RV8g== 2024-09-10T20:55:15.198 INFO:teuthology.orchestra.run.smithi006.stdout:[client.2] 2024-09-10T20:55:15.198 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQASsuBm3qObFhAA8pSZ6G5UlviURweMrtjNSg== 2024-09-10T20:55:15.198 INFO:teuthology.orchestra.run.smithi006.stdout:[client.1] 2024-09-10T20:55:15.198 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQASsuBmN5cRHRAAQWhcPRNq3YkaLqA54IoyXQ== 2024-09-10T20:55:15.198 INFO:teuthology.orchestra.run.smithi006.stdout:[client.3] 2024-09-10T20:55:15.198 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQASsuBmt1mIIxAAA97KhPLnIBk1HBekuTdP8Q== 2024-09-10T20:55:15.230 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr.y] 2024-09-10T20:55:15.230 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQARsuBm64LlFhAAAVIB4dikwMdIwmY8qA9bTg== 2024-09-10T20:55:15.230 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.a] 2024-09-10T20:55:15.230 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQARsuBmk4/LJRAAXSZjQOCY1WqwkCk+HIu8cg== 2024-09-10T20:55:15.231 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.c] 2024-09-10T20:55:15.231 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQARsuBmlJqHLxAAJU7v97KLRyCoVfQRBPPvog== 2024-09-10T20:55:15.231 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.0] 2024-09-10T20:55:15.231 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAVsuBmXwgXHRAA89mA1xkQvChOC+LklFyOBw== 2024-09-10T20:55:15.231 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.1] 2024-09-10T20:55:15.231 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAYsuBmuoWEKBAA+0FiqnZB10NjUy55/z39bg== 2024-09-10T20:55:15.231 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.2] 2024-09-10T20:55:15.231 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAbsuBmsFJpMxAAIiax40up1IZ7++e1xUwxOw== 2024-09-10T20:55:15.231 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.3] 2024-09-10T20:55:15.231 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAfsuBmcI3XAhAAmhBuOa922xY0GGPo9ysLLw== 2024-09-10T20:55:15.231 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr.x] 2024-09-10T20:55:15.231 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQARsuBmLy8rHxAAZ44xGXvE2mJvDhjRVsyzQw== 2024-09-10T20:55:15.232 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.b] 2024-09-10T20:55:15.232 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQARsuBmXbdeORAAVuyYaPlnRkyNSt0FXamAoQ== 2024-09-10T20:55:15.232 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.d] 2024-09-10T20:55:15.232 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQASsuBmGiWrBxAAcKZGtVlOMsx0jIyl6kWrcQ== 2024-09-10T20:55:15.232 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.4] 2024-09-10T20:55:15.232 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAlsuBmSvq7ABAAeJ/S0KQwg9kF67WggwRuiw== 2024-09-10T20:55:15.232 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.5] 2024-09-10T20:55:15.232 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAosuBmCbH4ChAAZvLHlJLuKMy4VCIreeaMnw== 2024-09-10T20:55:15.232 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.6] 2024-09-10T20:55:15.232 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQArsuBm/DFVFhAAaHlXz0HnV6DBdYho0IxqOw== 2024-09-10T20:55:15.232 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.7] 2024-09-10T20:55:15.232 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAusuBmKU/kIBAAR2TxXPR6Yv7E61B/JYaVYA== 2024-09-10T20:55:15.233 INFO:teuthology.orchestra.run.smithi150.stdout:[client.0] 2024-09-10T20:55:15.233 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQASsuBmdMMgEBAAKC0NFMDWd/XK9Za4e+RV8g== 2024-09-10T20:55:15.233 INFO:teuthology.orchestra.run.smithi150.stdout:[client.2] 2024-09-10T20:55:15.233 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQASsuBm3qObFhAA8pSZ6G5UlviURweMrtjNSg== 2024-09-10T20:55:15.233 INFO:teuthology.orchestra.run.smithi150.stdout:[client.1] 2024-09-10T20:55:15.233 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQASsuBmN5cRHRAAQWhcPRNq3YkaLqA54IoyXQ== 2024-09-10T20:55:15.233 INFO:teuthology.orchestra.run.smithi150.stdout:[client.3] 2024-09-10T20:55:15.233 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQASsuBmt1mIIxAAA97KhPLnIBk1HBekuTdP8Q== 2024-09-10T20:55:15.234 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T20:55:15.243 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T20:55:15.368 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T20:55:15.372 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T20:55:15.468 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T20:55:15.472 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T20:55:15.569 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T20:55:15.573 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T20:55:15.668 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T20:55:15.673 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T20:55:15.766 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T20:55:15.770 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T20:55:15.864 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T20:55:15.868 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T20:55:15.962 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T20:55:15.965 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T20:55:16.059 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T20:55:16.063 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T20:55:16.161 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T20:55:16.165 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T20:55:16.261 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T20:55:16.266 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T20:55:16.361 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T20:55:16.365 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T20:55:16.460 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T20:55:16.465 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T20:55:16.560 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T20:55:16.565 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T20:55:16.659 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T20:55:16.664 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T20:55:16.760 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T20:55:16.764 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T20:55:16.862 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T20:55:16.866 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T20:55:16.964 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T20:55:16.967 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T20:55:17.064 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-10T20:55:17.064 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-10T20:55:17.120 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T20:55:17.229 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-10T20:55:17.284 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-10T20:55:17.340 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T20:55:17.448 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-10T20:55:17.504 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-10T20:55:17.559 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T20:55:17.668 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-10T20:55:17.723 DEBUG:teuthology.orchestra.run.smithi006:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-10T20:55:17.727 DEBUG:teuthology.orchestra.run.smithi150:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-10T20:55:17.761 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-10T20:55:17.761 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-10T20:55:17.762 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-10T20:55:17.802 INFO:tasks.ceph.mon.a:Started 2024-09-10T20:55:17.802 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-10T20:55:17.802 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-10T20:55:17.807 INFO:tasks.ceph.mon.b:Started 2024-09-10T20:55:17.807 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-10T20:55:17.807 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-10T20:55:17.810 INFO:tasks.ceph.mon.c:Started 2024-09-10T20:55:17.810 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-10T20:55:17.811 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-10T20:55:17.811 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-10T20:55:17.814 INFO:tasks.ceph.mgr.y:Started 2024-09-10T20:55:17.815 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-10T20:55:17.815 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-10T20:55:17.819 INFO:tasks.ceph.mgr.x:Started 2024-09-10T20:55:17.819 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2024-09-10T20:55:17.820 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2024-09-10T20:55:17.824 INFO:tasks.ceph:setting config [client] debug_client = 20 2024-09-10T20:55:17.824 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph config set client debug_client 20 2024-09-10T20:55:17.869 INFO:tasks.ceph:setting config [client] debug_ms = 1 2024-09-10T20:55:17.869 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph config set client debug_ms 1 2024-09-10T20:55:17.915 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2024-09-10T20:55:17.915 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2024-09-10T20:55:17.961 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2024-09-10T20:55:17.962 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2024-09-10T20:55:18.008 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2024-09-10T20:55:18.009 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph config set mds debug_mds 20 2024-09-10T20:55:18.056 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2024-09-10T20:55:18.057 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2024-09-10T20:55:18.106 INFO:tasks.ceph:setting config [mds] debug_ms = 2 2024-09-10T20:55:18.107 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph config set mds debug_ms 2 2024-09-10T20:55:18.158 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2024-09-10T20:55:18.158 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2024-09-10T20:55:18.186 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2024-09-10T20:55:18.186 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2024-09-10T20:55:18.233 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2024-09-10T20:55:18.233 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2024-09-10T20:55:18.285 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2024-09-10T20:55:18.285 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2024-09-10T20:55:18.307 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2024-09-10T20:55:18.307 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2024-09-10T20:55:18.358 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2024-09-10T20:55:18.359 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2024-09-10T20:55:18.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.362+0000 7fc6b2c00640 1 -- 172.21.15.6:0/754003378 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6ac06e330 msgr2=0x7fc6ac1f96d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:18.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.362+0000 7fc6b2c00640 1 --2- 172.21.15.6:0/754003378 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6ac06e330 0x7fc6ac1f96d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc6a00011a0 tx=0x7fc6a0001660 comp rx=0 tx=0).stop 2024-09-10T20:55:18.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.362+0000 7fc6b2c00640 1 -- 172.21.15.6:0/754003378 shutdown_connections 2024-09-10T20:55:18.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.362+0000 7fc6b2c00640 1 --2- 172.21.15.6:0/754003378 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6ac0b2db0 0x7fc6ac164d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.362+0000 7fc6b2c00640 1 --2- 172.21.15.6:0/754003378 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6ac074a10 0x7fc6ac0ca560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.362+0000 7fc6b2c00640 1 --2- 172.21.15.6:0/754003378 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6ac06e330 0x7fc6ac1f96d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.362+0000 7fc6b2c00640 1 -- 172.21.15.6:0/754003378 >> 172.21.15.6:0/754003378 conn(0x7fc6ac0d3d80 msgr2=0x7fc6ac06dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:18.375 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2024-09-10T20:55:18.375 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2024-09-10T20:55:18.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.371+0000 7fc6b2c00640 1 -- 172.21.15.6:0/754003378 shutdown_connections 2024-09-10T20:55:18.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.375+0000 7fc6b2c00640 1 -- 172.21.15.6:0/754003378 wait complete. 2024-09-10T20:55:18.390 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2024-09-10T20:55:18.390 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2024-09-10T20:55:18.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.377+0000 7f782b400640 1 -- 172.21.15.6:0/2974143092 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f7820047400 con 0x7f78341535e0 2024-09-10T20:55:18.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.377+0000 7f782b400640 1 -- 172.21.15.6:0/2974143092 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f782003d440 con 0x7f78341535e0 2024-09-10T20:55:18.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.381+0000 7f783a200640 1 -- 172.21.15.6:0/2974143092 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78341593d0 con 0x7f78341535e0 2024-09-10T20:55:18.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.391+0000 7f782b400640 1 -- 172.21.15.6:0/2974143092 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f782004c020 con 0x7f78341535e0 2024-09-10T20:55:18.404 INFO:tasks.ceph:setting config [mon] mon_warn_on_pool_no_app = False 2024-09-10T20:55:18.404 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph config set mon mon_warn_on_pool_no_app False 2024-09-10T20:55:18.430 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2024-09-10T20:55:18.431 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2024-09-10T20:55:18.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.432+0000 7f5543e00640 1 -- 172.21.15.6:0/4288294839 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5530039070 con 0x7f552c00b550 2024-09-10T20:55:18.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.432+0000 7f554ac00640 1 -- 172.21.15.6:0/4288294839 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f552c00b550 msgr2=0x7f552c00d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:18.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.432+0000 7f554ac00640 1 --2- 172.21.15.6:0/4288294839 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f552c00b550 0x7f552c00d940 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f55300095f0 tx=0x7f552c003810 comp rx=0 tx=0).stop 2024-09-10T20:55:18.444 DEBUG:tasks.ceph:set 18 configs 2024-09-10T20:55:18.444 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi006') 2024-09-10T20:55:18.445 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi006') 2024-09-10T20:55:18.445 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi006') 2024-09-10T20:55:18.445 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi006') 2024-09-10T20:55:18.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.432+0000 7f554ac00640 1 -- 172.21.15.6:0/4288294839 shutdown_connections 2024-09-10T20:55:18.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.432+0000 7f554ac00640 1 --2- 172.21.15.6:0/4288294839 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f552c00b550 0x7f552c00d940 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.436+0000 7f554ac00640 1 -- 172.21.15.6:0/4288294839 >> 172.21.15.6:0/4288294839 conn(0x7f553c01d940 msgr2=0x7f553c054730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:18.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.483+0000 7f554ac00640 1 -- 172.21.15.6:0/4288294839 shutdown_connections 2024-09-10T20:55:18.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.485+0000 7f554ac00640 1 -- 172.21.15.6:0/4288294839 wait complete. 2024-09-10T20:55:18.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.488+0000 7fad9fe00640 1 -- 172.21.15.6:0/2099499523 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fad74005100 con 0x7fada01508d0 2024-09-10T20:55:18.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.502+0000 7f782b400640 1 -- 172.21.15.6:0/2974143092 <== mon.1 v2:172.21.15.150:3300/0 7 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f782003d640 con 0x7f78341535e0 2024-09-10T20:55:18.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.506+0000 7fad96a00640 1 -- 172.21.15.6:0/2099499523 <== mon.1 v2:172.21.15.150:3300/0 9 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7fad90009880 con 0x7fada01508d0 2024-09-10T20:55:18.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.506+0000 7fad96a00640 1 -- 172.21.15.6:0/2099499523 <== mon.1 v2:172.21.15.150:3300/0 10 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v5)=0 v5) ==== 123+0+0 (secure 0 0 0) 0x7fada006a430 con 0x7fada01508d0 2024-09-10T20:55:18.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.502+0000 7f7332a00640 1 -- 172.21.15.6:0/2651007459 <== mon.2 v2:172.21.15.150:3301/0 8 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f732c017410 con 0x7f73200051c0 2024-09-10T20:55:18.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.507+0000 7f554ac00640 1 Processor -- start 2024-09-10T20:55:18.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.509+0000 7fad9fe00640 1 -- 172.21.15.6:0/2099499523 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fada01508d0 msgr2=0x7fada00b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:18.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.509+0000 7fad9fe00640 1 --2- 172.21.15.6:0/2099499523 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fada01508d0 0x7fada00b4740 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fad90032000 tx=0x7fad90004730 comp rx=0 tx=0).stop 2024-09-10T20:55:18.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.514+0000 7fad9fe00640 1 -- 172.21.15.6:0/2099499523 shutdown_connections 2024-09-10T20:55:18.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.514+0000 7fad9fe00640 1 --2- 172.21.15.6:0/2099499523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fada00b5bb0 0x7fada0150390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.514+0000 7fad9fe00640 1 --2- 172.21.15.6:0/2099499523 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fada01508d0 0x7fada00b4740 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.514+0000 7fad9fe00640 1 --2- 172.21.15.6:0/2099499523 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad840051c0 0x7fada0153e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.514+0000 7fad9fe00640 1 -- 172.21.15.6:0/2099499523 >> 172.21.15.6:0/2099499523 conn(0x7fada009d030 msgr2=0x7fada0161ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:18.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.514+0000 7fad9fe00640 1 -- 172.21.15.6:0/2099499523 shutdown_connections 2024-09-10T20:55:18.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.514+0000 7fad9fe00640 1 -- 172.21.15.6:0/2099499523 wait complete. 2024-09-10T20:55:18.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.507+0000 7f554ac00640 1 -- start start 2024-09-10T20:55:18.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.509+0000 7f554ac00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f552c00b550 0x7f553c174ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:18.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.509+0000 7f554ac00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f553c0dc880 0x7f553c04b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:18.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.509+0000 7f554ac00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f553c04d2e0 0x7f553c005c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:18.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.509+0000 7f554ac00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f553c04f6d0 con 0x7f553c0dc880 2024-09-10T20:55:18.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.509+0000 7f554ac00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f553c0536a0 con 0x7f553c04d2e0 2024-09-10T20:55:18.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.509+0000 7f554ac00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f553c054e40 con 0x7f552c00b550 2024-09-10T20:55:18.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.517+0000 7f5548e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f553c0dc880 0x7f553c04b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:18.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.517+0000 7f554c200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f553c04d2e0 0x7f553c005c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:18.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.517+0000 7f554c200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f553c04d2e0 0x7f553c005c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.6:57500/0 (socket says 172.21.15.6:57500) 2024-09-10T20:55:18.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.517+0000 7f554c200640 1 -- 172.21.15.6:0/1003888170 learned_addr learned my addr 172.21.15.6:0/1003888170 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:18.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.517+0000 7f5549800640 1 --2- 172.21.15.6:0/1003888170 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f552c00b550 0x7f553c174ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:18.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.518+0000 7f5549800640 1 -- 172.21.15.6:0/1003888170 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f553c04d2e0 msgr2=0x7f553c005c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:18.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.518+0000 7f5549800640 1 --2- 172.21.15.6:0/1003888170 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f553c04d2e0 0x7f553c005c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.518+0000 7f5549800640 1 -- 172.21.15.6:0/1003888170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f553c0dc880 msgr2=0x7f553c04b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:18.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.521+0000 7f5549800640 1 --2- 172.21.15.6:0/1003888170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f553c0dc880 0x7f553c04b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.521+0000 7f5549800640 1 -- 172.21.15.6:0/1003888170 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f553c04c050 con 0x7f552c00b550 2024-09-10T20:55:18.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.521+0000 7f5548e00640 1 --2- 172.21.15.6:0/1003888170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f553c0dc880 0x7f553c04b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:55:18.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.530+0000 7f5549800640 1 --2- 172.21.15.6:0/1003888170 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f552c00b550 0x7f553c174ea0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5544052150 tx=0x7f554406a370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:18.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.530+0000 7f5541600640 1 -- 172.21.15.6:0/1003888170 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5544072830 con 0x7f552c00b550 2024-09-10T20:55:18.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.530+0000 7f5541600640 1 -- 172.21.15.6:0/1003888170 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f55440729d0 con 0x7f552c00b550 2024-09-10T20:55:18.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.530+0000 7f5541600640 1 -- 172.21.15.6:0/1003888170 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5544072830 con 0x7f552c00b550 2024-09-10T20:55:18.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.532+0000 7f554ac00640 1 -- 172.21.15.6:0/1003888170 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f553c04c330 con 0x7f552c00b550 2024-09-10T20:55:18.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.532+0000 7f554ac00640 1 -- 172.21.15.6:0/1003888170 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f553c04bd40 con 0x7f552c00b550 2024-09-10T20:55:18.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.536+0000 7f5541600640 1 -- 172.21.15.6:0/1003888170 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f5544094430 con 0x7f552c00b550 2024-09-10T20:55:18.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.536+0000 7f5541600640 1 -- 172.21.15.6:0/1003888170 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5544094a90 con 0x7f552c00b550 2024-09-10T20:55:18.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.539+0000 7f554ac00640 1 -- 172.21.15.6:0/1003888170 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f553c04ed80 con 0x7f552c00b550 2024-09-10T20:55:18.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.532+0000 7fc5bbe00640 1 -- 172.21.15.6:0/1565344959 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc59c004800 msgr2=0x7fc59c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:18.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.532+0000 7fc5bbe00640 1 --2- 172.21.15.6:0/1565344959 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc59c004800 0x7fc59c004c80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc5a0006f20 tx=0x7fc59c005830 comp rx=0 tx=0).stop 2024-09-10T20:55:18.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.532+0000 7fc5b9e00640 1 -- 172.21.15.6:0/1565344959 reap_dead start 2024-09-10T20:55:18.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.537+0000 7fc5bbe00640 1 -- 172.21.15.6:0/1565344959 shutdown_connections 2024-09-10T20:55:18.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.537+0000 7fc5bbe00640 1 -- 172.21.15.6:0/1565344959 >> 172.21.15.6:0/1565344959 conn(0x7fc5b40cfa20 msgr2=0x7fc5b40cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:18.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.537+0000 7fc5bbe00640 1 -- 172.21.15.6:0/1565344959 shutdown_connections 2024-09-10T20:55:18.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.537+0000 7fc5bbe00640 1 -- 172.21.15.6:0/1565344959 wait complete. 2024-09-10T20:55:18.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.540+0000 7fc5bbe00640 1 Processor -- start 2024-09-10T20:55:18.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.542+0000 7f5541600640 1 -- 172.21.15.6:0/1003888170 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f5544094c90 con 0x7f552c00b550 2024-09-10T20:55:18.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.544+0000 7fc5bbe00640 1 -- start start 2024-09-10T20:55:18.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.545+0000 7fc5bbe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc59c004800 0x7fc5b4202300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:18.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.545+0000 7fc5bbe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5b40c3550 0x7fc5b41fed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:18.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.545+0000 7fc5bbe00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5b40c4480 0x7fc5b40c4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:18.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.545+0000 7fc5bbe00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b40cef50 con 0x7fc5b40c3550 2024-09-10T20:55:18.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.545+0000 7fc5bbe00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b4070860 con 0x7fc59c004800 2024-09-10T20:55:18.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.545+0000 7fc5bbe00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fc5b40cf0d0 con 0x7fc5b40c4480 2024-09-10T20:55:18.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.547+0000 7fc5b9e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5b40c4480 0x7fc5b40c4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:18.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.547+0000 7fc5b9400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc59c004800 0x7fc5b4202300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:18.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.548+0000 7fc5b9400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc59c004800 0x7fc5b4202300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.6:57516/0 (socket says 172.21.15.6:57516) 2024-09-10T20:55:18.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.548+0000 7fc5b9400640 1 -- 172.21.15.6:0/2591780565 learned_addr learned my addr 172.21.15.6:0/2591780565 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:18.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.548+0000 7fc5b8a00640 1 --2- 172.21.15.6:0/2591780565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5b40c3550 0x7fc5b41fed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:18.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.549+0000 7fc5b9400640 1 -- 172.21.15.6:0/2591780565 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5b40c4480 msgr2=0x7fc5b40c4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:18.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.549+0000 7fc5b9400640 1 --2- 172.21.15.6:0/2591780565 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5b40c4480 0x7fc5b40c4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.549+0000 7fc5b9400640 1 -- 172.21.15.6:0/2591780565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5b40c3550 msgr2=0x7fc5b41fed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:18.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.549+0000 7fc5b9400640 1 --2- 172.21.15.6:0/2591780565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5b40c3550 0x7fc5b41fed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.549+0000 7fc5b9400640 1 -- 172.21.15.6:0/2591780565 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5b4202b60 con 0x7fc59c004800 2024-09-10T20:55:18.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.550+0000 7fc5b8a00640 1 --2- 172.21.15.6:0/2591780565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5b40c3550 0x7fc5b41fed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:55:18.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.550+0000 7fc5b9e00640 1 --2- 172.21.15.6:0/2591780565 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5b40c4480 0x7fc5b40c4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:55:18.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.552+0000 7fc5b9400640 1 --2- 172.21.15.6:0/2591780565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc59c004800 0x7fc5b4202300 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc5a800b3f0 tx=0x7fc5a800b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:18.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.554+0000 7fc5b1600640 1 -- 172.21.15.6:0/2591780565 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a8015020 con 0x7fc59c004800 2024-09-10T20:55:18.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.554+0000 7fc5b1600640 1 -- 172.21.15.6:0/2591780565 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7fc5a8011900 con 0x7fc59c004800 2024-09-10T20:55:18.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.554+0000 7fc5b1600640 1 -- 172.21.15.6:0/2591780565 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a8011d30 con 0x7fc59c004800 2024-09-10T20:55:18.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.559+0000 7fc5bbe00640 1 -- 172.21.15.6:0/2591780565 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5b4202e40 con 0x7fc59c004800 2024-09-10T20:55:18.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.559+0000 7fc5bbe00640 1 -- 172.21.15.6:0/2591780565 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5b4203400 con 0x7fc59c004800 2024-09-10T20:55:18.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.563+0000 7fc5b1600640 1 -- 172.21.15.6:0/2591780565 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fc5a801a790 con 0x7fc59c004800 2024-09-10T20:55:18.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.563+0000 7fc5b1600640 1 -- 172.21.15.6:0/2591780565 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc5a8019bc0 con 0x7fc59c004800 2024-09-10T20:55:18.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.563+0000 7fc5bbe00640 1 -- 172.21.15.6:0/2591780565 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5b40d05d0 con 0x7fc59c004800 2024-09-10T20:55:18.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.567+0000 7fc5b1600640 1 -- 172.21.15.6:0/2591780565 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fc5a801f020 con 0x7fc59c004800 2024-09-10T20:55:18.585 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi006') 2024-09-10T20:55:18.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.619+0000 7f1a8a600640 1 -- 172.21.15.6:0/733902987 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a68003a00 msgr2=0x7f1a68003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:18.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.619+0000 7f1a8a600640 1 --2- 172.21.15.6:0/733902987 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a68003a00 0x7f1a68003e20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c00c720 tx=0x7f1a68005830 comp rx=0 tx=0).stop 2024-09-10T20:55:18.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.624+0000 7f1a8a600640 1 -- 172.21.15.6:0/733902987 shutdown_connections 2024-09-10T20:55:18.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.624+0000 7f1a8a600640 1 --2- 172.21.15.6:0/733902987 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a68003a00 0x7f1a68003e20 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.624+0000 7f1a8a600640 1 -- 172.21.15.6:0/733902987 >> 172.21.15.6:0/733902987 conn(0x7f1a8409d030 msgr2=0x7f1a840d3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:18.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.626+0000 7f1a8a600640 1 -- 172.21.15.6:0/733902987 shutdown_connections 2024-09-10T20:55:18.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.627+0000 7f1a8a600640 1 -- 172.21.15.6:0/733902987 wait complete. 2024-09-10T20:55:18.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.650+0000 7f1a8a600640 1 Processor -- start 2024-09-10T20:55:18.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.650+0000 7f1a8a600640 1 -- start start 2024-09-10T20:55:18.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.652+0000 7f1a8a600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a68003a00 0x7f1a841f4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:18.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.656+0000 7f1a8a600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a8415c310 0x7f1a840b7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:18.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.656+0000 7f1a83400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a68003a00 0x7f1a841f4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:18.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.656+0000 7f1a83400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a68003a00 0x7f1a841f4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.6:57538/0 (socket says 172.21.15.6:57538) 2024-09-10T20:55:18.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.656+0000 7f1a83400640 1 -- 172.21.15.6:0/850358563 learned_addr learned my addr 172.21.15.6:0/850358563 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:18.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.656+0000 7f1a8a600640 1 --2- 172.21.15.6:0/850358563 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a840cd680 0x7f1a840b8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:18.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.660+0000 7f7341400640 1 -- 172.21.15.6:0/2651007459 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f7310005310 con 0x7f73200051c0 2024-09-10T20:55:18.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.661+0000 7f1a83e00640 1 --2- 172.21.15.6:0/850358563 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a840cd680 0x7f1a840b8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:18.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.661+0000 7f1a8a600640 1 -- 172.21.15.6:0/850358563 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1a840d0f90 con 0x7f1a8415c310 2024-09-10T20:55:18.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.661+0000 7f1a8a600640 1 -- 172.21.15.6:0/850358563 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f1a840d0e10 con 0x7f1a68003a00 2024-09-10T20:55:18.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.661+0000 7f1a8a600640 1 -- 172.21.15.6:0/850358563 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f1a840d2490 con 0x7f1a840cd680 2024-09-10T20:55:18.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.663+0000 7f1a82a00640 1 --2- 172.21.15.6:0/850358563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a8415c310 0x7f1a840b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:18.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.665+0000 7f1a82a00640 1 -- 172.21.15.6:0/850358563 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a840cd680 msgr2=0x7f1a840b8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:18.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.665+0000 7f1a82a00640 1 --2- 172.21.15.6:0/850358563 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a840cd680 0x7f1a840b8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.665+0000 7f1a82a00640 1 -- 172.21.15.6:0/850358563 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a68003a00 msgr2=0x7f1a841f4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:18.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.665+0000 7f1a82a00640 1 --2- 172.21.15.6:0/850358563 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a68003a00 0x7f1a841f4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.665+0000 7f1a82a00640 1 -- 172.21.15.6:0/850358563 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a841f53e0 con 0x7f1a8415c310 2024-09-10T20:55:18.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.665+0000 7f1a83400640 1 --2- 172.21.15.6:0/850358563 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a68003a00 0x7f1a841f4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:55:18.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.665+0000 7f1a83e00640 1 --2- 172.21.15.6:0/850358563 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a840cd680 0x7f1a840b8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:55:18.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.665+0000 7f1a82a00640 1 --2- 172.21.15.6:0/850358563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a8415c310 0x7f1a840b7080 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1a7000b410 tx=0x7f1a7000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:18.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.669+0000 7f5541600640 1 -- 172.21.15.6:0/1003888170 <== mon.2 v2:172.21.15.150:3301/0 7 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f55440933e0 con 0x7f552c00b550 2024-09-10T20:55:18.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.668+0000 7f782b400640 1 -- 172.21.15.6:0/2974143092 <== mon.1 v2:172.21.15.150:3300/0 8 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f782003d870 con 0x7f78341535e0 2024-09-10T20:55:18.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.668+0000 7fc5b1600640 1 -- 172.21.15.6:0/2591780565 <== mon.1 v2:172.21.15.150:3300/0 7 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc5a8019e10 con 0x7fc59c004800 2024-09-10T20:55:18.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.668+0000 7f1a7b400640 1 -- 172.21.15.6:0/850358563 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a70015020 con 0x7f1a8415c310 2024-09-10T20:55:18.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.668+0000 7f1a7b400640 1 -- 172.21.15.6:0/850358563 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f1a70011900 con 0x7f1a8415c310 2024-09-10T20:55:18.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.668+0000 7f1a7b400640 1 -- 172.21.15.6:0/850358563 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a70011d10 con 0x7f1a8415c310 2024-09-10T20:55:18.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.668+0000 7f1a8a600640 1 -- 172.21.15.6:0/850358563 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a840cdc40 con 0x7f1a8415c310 2024-09-10T20:55:18.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.669+0000 7f1a8a600640 1 -- 172.21.15.6:0/850358563 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a840cb130 con 0x7f1a8415c310 2024-09-10T20:55:18.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.669+0000 7f1a7b400640 1 -- 172.21.15.6:0/850358563 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1a7001a400 con 0x7f1a8415c310 2024-09-10T20:55:18.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.680+0000 7f1a7b400640 1 -- 172.21.15.6:0/850358563 <== mon.0 v2:172.21.15.6:3300/0 5 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f1a7001a940 con 0x7f1a8415c310 2024-09-10T20:55:18.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.680+0000 7f1a7b400640 1 -- 172.21.15.6:0/850358563 <== mon.0 v2:172.21.15.6:3300/0 6 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1a70010380 con 0x7f1a8415c310 2024-09-10T20:55:18.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.680+0000 7f7332a00640 1 -- 172.21.15.6:0/2651007459 <== mon.2 v2:172.21.15.150:3301/0 9 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f732c017a70 con 0x7f73200051c0 2024-09-10T20:55:18.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.680+0000 7f7332a00640 1 -- 172.21.15.6:0/2651007459 <== mon.2 v2:172.21.15.150:3301/0 10 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7f733c08b8f0 con 0x7f73200051c0 2024-09-10T20:55:18.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.681+0000 7f783a200640 1 -- 172.21.15.6:0/2974143092 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f78080052f0 con 0x7f78341535e0 2024-09-10T20:55:18.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.683+0000 7f1a8a600640 1 -- 172.21.15.6:0/850358563 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a840d46e0 con 0x7f1a8415c310 2024-09-10T20:55:18.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.693+0000 7f1a7b400640 1 -- 172.21.15.6:0/850358563 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f1a7001f020 con 0x7f1a8415c310 2024-09-10T20:55:18.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.697+0000 7f7327e00640 1 -- 172.21.15.6:0/2651007459 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73200051c0 msgr2=0x7f733c209750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:18.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.697+0000 7f7327e00640 1 --2- 172.21.15.6:0/2651007459 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73200051c0 0x7f733c209750 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f732c00ea20 tx=0x7f732c00eee0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.697+0000 7f7327e00640 1 -- 172.21.15.6:0/2651007459 shutdown_connections 2024-09-10T20:55:18.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.697+0000 7f7327e00640 1 --2- 172.21.15.6:0/2651007459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f733c0854e0 0x7f733c16a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.697+0000 7f7327e00640 1 --2- 172.21.15.6:0/2651007459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f733c085be0 0x7f733c20d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.697+0000 7f7327e00640 1 --2- 172.21.15.6:0/2651007459 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73200051c0 0x7f733c209750 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.697+0000 7f7327e00640 1 -- 172.21.15.6:0/2651007459 >> 172.21.15.6:0/2651007459 conn(0x7f733c0cfa20 msgr2=0x7f733c06ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:18.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.698+0000 7f7327e00640 1 -- 172.21.15.6:0/2651007459 shutdown_connections 2024-09-10T20:55:18.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.698+0000 7f7327e00640 1 -- 172.21.15.6:0/2651007459 wait complete. 2024-09-10T20:55:18.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.702+0000 7f782b400640 1 -- 172.21.15.6:0/2974143092 <== mon.1 v2:172.21.15.150:3300/0 9 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v7)=0 v7) ==== 108+0+0 (secure 0 0 0) 0x7f782003db20 con 0x7f78341535e0 2024-09-10T20:55:18.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.714+0000 7f783a200640 1 -- 172.21.15.6:0/2974143092 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78341535e0 msgr2=0x7f78341f9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:18.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.714+0000 7f783a200640 1 --2- 172.21.15.6:0/2974143092 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78341535e0 0x7f78341f9b20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7820009ac0 tx=0x7f78200047d0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.715+0000 7f783a200640 1 -- 172.21.15.6:0/2974143092 shutdown_connections 2024-09-10T20:55:18.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.715+0000 7f783a200640 1 --2- 172.21.15.6:0/2974143092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f783406fc50 0x7f78340b4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.715+0000 7f783a200640 1 --2- 172.21.15.6:0/2974143092 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f783415e680 0x7f78340b5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.715+0000 7f783a200640 1 --2- 172.21.15.6:0/2974143092 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78341535e0 0x7f78341f9b20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.715+0000 7f783a200640 1 -- 172.21.15.6:0/2974143092 >> 172.21.15.6:0/2974143092 conn(0x7f78340cfa20 msgr2=0x7f78340cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:18.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.715+0000 7f783a200640 1 -- 172.21.15.6:0/2974143092 shutdown_connections 2024-09-10T20:55:18.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.715+0000 7f783a200640 1 -- 172.21.15.6:0/2974143092 wait complete. 2024-09-10T20:55:18.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.742+0000 7f744fa00640 1 -- 172.21.15.6:0/437056938 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f743000c260 msgr2=0x7f743000c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:18.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.742+0000 7f744fa00640 1 --2- 172.21.15.6:0/437056938 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f743000c260 0x7f743000c680 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7434006fa0 tx=0x7f743000e040 comp rx=0 tx=0).stop 2024-09-10T20:55:18.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.742+0000 7f744da00640 1 -- 172.21.15.6:0/437056938 reap_dead start 2024-09-10T20:55:18.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.744+0000 7f744fa00640 1 -- 172.21.15.6:0/437056938 shutdown_connections 2024-09-10T20:55:18.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.744+0000 7f744fa00640 1 -- 172.21.15.6:0/437056938 >> 172.21.15.6:0/437056938 conn(0x7f74480cfa20 msgr2=0x7f74480cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:18.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.753+0000 7f744fa00640 1 -- 172.21.15.6:0/437056938 shutdown_connections 2024-09-10T20:55:18.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.755+0000 7f744fa00640 1 -- 172.21.15.6:0/437056938 wait complete. 2024-09-10T20:55:18.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.757+0000 7f744fa00640 1 Processor -- start 2024-09-10T20:55:18.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.755+0000 7fcbbe600640 1 -- 172.21.15.6:0/1996615338 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcbb80d0540 msgr2=0x7fcbb806ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:18.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.755+0000 7fcbbe600640 1 --2- 172.21.15.6:0/1996615338 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcbb80d0540 0x7fcbb806ef30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcba8009860 tx=0x7fcba802a510 comp rx=0 tx=0).stop 2024-09-10T20:55:18.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.759+0000 7fcbbe600640 1 -- 172.21.15.6:0/1996615338 shutdown_connections 2024-09-10T20:55:18.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.759+0000 7fcbbe600640 1 --2- 172.21.15.6:0/1996615338 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcbb80d0540 0x7fcbb806ef30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.759+0000 7fcbbe600640 1 -- 172.21.15.6:0/1996615338 >> 172.21.15.6:0/1996615338 conn(0x7fcbb80cfa20 msgr2=0x7fcbb80cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:18.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.758+0000 7f744fa00640 1 -- start start 2024-09-10T20:55:18.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.759+0000 7f744fa00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74480c5f60 0x7f744806f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:18.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.759+0000 7f744fa00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74480c6340 0x7f744806ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:18.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.759+0000 7f744fa00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7448204d90 0x7f74482051f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:18.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.759+0000 7f744fa00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f744816c8a0 con 0x7f7448204d90 2024-09-10T20:55:18.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.759+0000 7f744fa00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f744816c720 con 0x7f74480c6340 2024-09-10T20:55:18.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.759+0000 7f744fa00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f74480cb5c0 con 0x7f74480c5f60 2024-09-10T20:55:18.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.760+0000 7f7447e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74480c6340 0x7f744806ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:18.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.760+0000 7f744da00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7448204d90 0x7f74482051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:18.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.760+0000 7f744da00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7448204d90 0x7f74482051f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51184/0 (socket says 172.21.15.6:51184) 2024-09-10T20:55:18.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.760+0000 7f7447e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74480c6340 0x7f744806ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.6:57562/0 (socket says 172.21.15.6:57562) 2024-09-10T20:55:18.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.760+0000 7f7447e00640 1 -- 172.21.15.6:0/3976667302 learned_addr learned my addr 172.21.15.6:0/3976667302 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:18.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.760+0000 7f744d000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74480c5f60 0x7f744806f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:18.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.762+0000 7f744da00640 1 -- 172.21.15.6:0/3976667302 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74480c5f60 msgr2=0x7f744806f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:18.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.762+0000 7f744da00640 1 --2- 172.21.15.6:0/3976667302 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74480c5f60 0x7f744806f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.762+0000 7f744da00640 1 -- 172.21.15.6:0/3976667302 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74480c6340 msgr2=0x7f744806ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:18.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.762+0000 7f744da00640 1 --2- 172.21.15.6:0/3976667302 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74480c6340 0x7f744806ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.762+0000 7f744da00640 1 -- 172.21.15.6:0/3976667302 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7448205ac0 con 0x7f7448204d90 2024-09-10T20:55:18.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.763+0000 7f744da00640 1 --2- 172.21.15.6:0/3976667302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7448204d90 0x7f74482051f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f74480761f0 tx=0x7f744000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:18.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.761+0000 7fcbbe600640 1 -- 172.21.15.6:0/1996615338 shutdown_connections 2024-09-10T20:55:18.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.761+0000 7fcbbe600640 1 -- 172.21.15.6:0/1996615338 wait complete. 2024-09-10T20:55:18.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.763+0000 7f7444c00640 1 -- 172.21.15.6:0/3976667302 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7440017070 con 0x7f7448204d90 2024-09-10T20:55:18.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.763+0000 7f7444c00640 1 -- 172.21.15.6:0/3976667302 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f744000a900 con 0x7f7448204d90 2024-09-10T20:55:18.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.763+0000 7f7444c00640 1 -- 172.21.15.6:0/3976667302 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f744000ad70 con 0x7f7448204d90 2024-09-10T20:55:18.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.765+0000 7f744fa00640 1 -- 172.21.15.6:0/3976667302 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74482019d0 con 0x7f7448204d90 2024-09-10T20:55:18.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.766+0000 7f7444c00640 1 -- 172.21.15.6:0/3976667302 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f7440012400 con 0x7f7448204d90 2024-09-10T20:55:18.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.766+0000 7f744fa00640 1 -- 172.21.15.6:0/3976667302 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7448201f90 con 0x7f7448204d90 2024-09-10T20:55:18.771 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi006') 2024-09-10T20:55:18.771 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi006') 2024-09-10T20:55:18.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.767+0000 7f7444c00640 1 -- 172.21.15.6:0/3976667302 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f744001bab0 con 0x7f7448204d90 2024-09-10T20:55:18.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.775+0000 7f744fa00640 1 -- 172.21.15.6:0/3976667302 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74480a0bf0 con 0x7f7448204d90 2024-09-10T20:55:18.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.774+0000 7fc5bbe00640 1 -- 172.21.15.6:0/2591780565 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fc5b4069d20 con 0x7fc59c004800 2024-09-10T20:55:18.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.765+0000 7fcbbe600640 1 Processor -- start 2024-09-10T20:55:18.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.779+0000 7fcbbe600640 1 -- start start 2024-09-10T20:55:18.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.784+0000 7f7444c00640 1 -- 172.21.15.6:0/3976667302 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f74480a0bf0 con 0x7f7448204d90 2024-09-10T20:55:18.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.787+0000 7fc5b1600640 1 -- 172.21.15.6:0/2591780565 <== mon.1 v2:172.21.15.150:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v8)=0 v8) ==== 106+0+0 (secure 0 0 0) 0x7fc5a801f020 con 0x7fc59c004800 2024-09-10T20:55:18.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.788+0000 7f3c38400640 1 -- 172.21.15.6:0/187733068 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c300b6c40 msgr2=0x7f3c300b70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:18.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.788+0000 7f3c38400640 1 --2- 172.21.15.6:0/187733068 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c300b6c40 0x7f3c300b70f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c005fd0 tx=0x7f3c1c02a530 comp rx=0 tx=0).stop 2024-09-10T20:55:18.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.791+0000 7fc5bbe00640 1 -- 172.21.15.6:0/2591780565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc59c004800 msgr2=0x7fc5b4202300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:18.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.791+0000 7fc5bbe00640 1 --2- 172.21.15.6:0/2591780565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc59c004800 0x7fc5b4202300 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc5a800b3f0 tx=0x7fc5a800b8b0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.792+0000 7fc5bbe00640 1 -- 172.21.15.6:0/2591780565 shutdown_connections 2024-09-10T20:55:18.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.791+0000 7f3c38400640 1 -- 172.21.15.6:0/187733068 shutdown_connections 2024-09-10T20:55:18.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.791+0000 7f3c38400640 1 --2- 172.21.15.6:0/187733068 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c300b6c40 0x7f3c300b70f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.791+0000 7f3c38400640 1 --2- 172.21.15.6:0/187733068 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c30162400 0x7f3c300d4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.791+0000 7f3c38400640 1 -- 172.21.15.6:0/187733068 >> 172.21.15.6:0/187733068 conn(0x7f3c3009d0c0 msgr2=0x7f3c300d3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:18.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.792+0000 7fc5bbe00640 1 --2- 172.21.15.6:0/2591780565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5b40c3550 0x7fc5b41fed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.796+0000 7fc5bbe00640 1 --2- 172.21.15.6:0/2591780565 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5b40c4480 0x7fc5b40c4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.796+0000 7fc5bbe00640 1 --2- 172.21.15.6:0/2591780565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc59c004800 0x7fc5b4202300 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.796+0000 7fc5bbe00640 1 -- 172.21.15.6:0/2591780565 >> 172.21.15.6:0/2591780565 conn(0x7fc5b40cfa20 msgr2=0x7fc5b415bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:18.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.796+0000 7fc5bbe00640 1 -- 172.21.15.6:0/2591780565 shutdown_connections 2024-09-10T20:55:18.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.796+0000 7fc5bbe00640 1 -- 172.21.15.6:0/2591780565 wait complete. 2024-09-10T20:55:18.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.800+0000 7fcbbe600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbb80cd920 0x7fcbb80b3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:18.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.800+0000 7fcbbe600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbb815bcb0 0x7fcbb81f6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:18.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.800+0000 7fcbbe600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcbb8158150 0x7fcbb8158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:18.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.805+0000 7f3c38400640 1 -- 172.21.15.6:0/187733068 shutdown_connections 2024-09-10T20:55:18.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.805+0000 7f3c38400640 1 -- 172.21.15.6:0/187733068 wait complete. 2024-09-10T20:55:18.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.805+0000 7fcbb7400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbb80cd920 0x7fcbb80b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:18.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.812+0000 7f3c38400640 1 Processor -- start 2024-09-10T20:55:18.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.812+0000 7fcbbe600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb8166fc0 con 0x7fcbb80cd920 2024-09-10T20:55:18.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.812+0000 7fcbbe600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb8166e40 con 0x7fcbb815bcb0 2024-09-10T20:55:18.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.812+0000 7fcbbe600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fcbb8167140 con 0x7fcbb8158150 2024-09-10T20:55:18.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.812+0000 7fcbb7400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbb80cd920 0x7fcbb80b3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51186/0 (socket says 172.21.15.6:51186) 2024-09-10T20:55:18.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.812+0000 7fcbb7400640 1 -- 172.21.15.6:0/2604858897 learned_addr learned my addr 172.21.15.6:0/2604858897 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:18.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.812+0000 7f3c38400640 1 -- start start 2024-09-10T20:55:18.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.813+0000 7fcbb7400640 1 -- 172.21.15.6:0/2604858897 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcbb8158150 msgr2=0x7fcbb8158600 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T20:55:18.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.813+0000 7fcbb7400640 1 --2- 172.21.15.6:0/2604858897 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcbb8158150 0x7fcbb8158600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.813+0000 7fcbb7400640 1 -- 172.21.15.6:0/2604858897 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbb815bcb0 msgr2=0x7fcbb81f6300 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T20:55:18.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.813+0000 7fcbb7400640 1 --2- 172.21.15.6:0/2604858897 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbb815bcb0 0x7fcbb81f6300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.814+0000 7fcbb7400640 1 -- 172.21.15.6:0/2604858897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbb80b2a70 con 0x7fcbb80cd920 2024-09-10T20:55:18.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.814+0000 7f3c38400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c300b6c40 0x7f3c301f7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:18.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.815+0000 7f3c38400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c300d0330 0x7f3c300cc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:18.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.815+0000 7f3c38400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c30162400 0x7f3c300caec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:18.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.816+0000 7fcbb7400640 1 --2- 172.21.15.6:0/2604858897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbb80cd920 0x7fcbb80b3530 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcbb000ba80 tx=0x7fcbb000bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:18.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.817+0000 7fcbaf400640 1 -- 172.21.15.6:0/2604858897 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb0019070 con 0x7fcbb80cd920 2024-09-10T20:55:18.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.817+0000 7fcbaf400640 1 -- 172.21.15.6:0/2604858897 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcbb000cd80 con 0x7fcbb80cd920 2024-09-10T20:55:18.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.817+0000 7fcbaf400640 1 -- 172.21.15.6:0/2604858897 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb00146a0 con 0x7fcbb80cd920 2024-09-10T20:55:18.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.817+0000 7f3c36400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c30162400 0x7f3c300caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:18.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.818+0000 7f3c36400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c30162400 0x7f3c300caec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.6:57588/0 (socket says 172.21.15.6:57588) 2024-09-10T20:55:18.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.818+0000 7f3c36400640 1 -- 172.21.15.6:0/3815539125 learned_addr learned my addr 172.21.15.6:0/3815539125 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:18.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.818+0000 7f3c38400640 1 -- 172.21.15.6:0/3815539125 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3c300d1000 con 0x7f3c300d0330 2024-09-10T20:55:18.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.818+0000 7f3c38400640 1 -- 172.21.15.6:0/3815539125 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3c300d0e80 con 0x7f3c30162400 2024-09-10T20:55:18.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.818+0000 7f3c38400640 1 -- 172.21.15.6:0/3815539125 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3c300b7630 con 0x7f3c300b6c40 2024-09-10T20:55:18.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.818+0000 7fcbbe600640 1 -- 172.21.15.6:0/2604858897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbb80ae350 con 0x7fcbb80cd920 2024-09-10T20:55:18.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.818+0000 7fcbbe600640 1 -- 172.21.15.6:0/2604858897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbb80b3010 con 0x7fcbb80cd920 2024-09-10T20:55:18.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.820+0000 7f3c36400640 1 -- 172.21.15.6:0/3815539125 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c300b6c40 msgr2=0x7f3c301f7fd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T20:55:18.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.820+0000 7f3c36400640 1 --2- 172.21.15.6:0/3815539125 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c300b6c40 0x7f3c301f7fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.820+0000 7f3c36400640 1 -- 172.21.15.6:0/3815539125 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c300d0330 msgr2=0x7f3c300cc5a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T20:55:18.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.821+0000 7f3c35000640 1 --2- 172.21.15.6:0/3815539125 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c300d0330 0x7f3c300cc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:18.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.822+0000 7f3c36400640 1 --2- 172.21.15.6:0/3815539125 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c300d0330 0x7f3c300cc5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.822+0000 7f3c36400640 1 -- 172.21.15.6:0/3815539125 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c300cb880 con 0x7f3c30162400 2024-09-10T20:55:18.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.822+0000 7f3c36400640 1 --2- 172.21.15.6:0/3815539125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c30162400 0x7f3c300caec0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c006010 tx=0x7f3c1c003820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:18.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.823+0000 7f3c2d600640 1 -- 172.21.15.6:0/3815539125 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c03f070 con 0x7f3c30162400 2024-09-10T20:55:18.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.823+0000 7fcbaf400640 1 -- 172.21.15.6:0/2604858897 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fcbb0014840 con 0x7fcbb80cd920 2024-09-10T20:55:18.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.823+0000 7fcbaf400640 1 -- 172.21.15.6:0/2604858897 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fcbb001edf0 con 0x7fcbb80cd920 2024-09-10T20:55:18.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.823+0000 7f3c2d600640 1 -- 172.21.15.6:0/3815539125 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3c1c0047a0 con 0x7f3c30162400 2024-09-10T20:55:18.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.823+0000 7f3c2d600640 1 -- 172.21.15.6:0/3815539125 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c035030 con 0x7f3c30162400 2024-09-10T20:55:18.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.825+0000 7f3c38400640 1 -- 172.21.15.6:0/3815539125 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c300cbb60 con 0x7f3c30162400 2024-09-10T20:55:18.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.826+0000 7f3c2d600640 1 -- 172.21.15.6:0/3815539125 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f3c1c004bd0 con 0x7f3c30162400 2024-09-10T20:55:18.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.826+0000 7f3c38400640 1 -- 172.21.15.6:0/3815539125 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c3015bf90 con 0x7f3c30162400 2024-09-10T20:55:18.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.828+0000 7f3c2d600640 1 -- 172.21.15.6:0/3815539125 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3c1c03b7a0 con 0x7f3c30162400 2024-09-10T20:55:18.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.828+0000 7f3c38400640 1 -- 172.21.15.6:0/3815539125 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c30069960 con 0x7f3c30162400 2024-09-10T20:55:18.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.828+0000 7fcbbe600640 1 -- 172.21.15.6:0/2604858897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbb80b3210 con 0x7fcbb80cd920 2024-09-10T20:55:18.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.832+0000 7f3c2d600640 1 -- 172.21.15.6:0/3815539125 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f3c30069960 con 0x7f3c30162400 2024-09-10T20:55:18.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.833+0000 7fcbaf400640 1 -- 172.21.15.6:0/2604858897 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fcbb80b3210 con 0x7fcbb80cd920 2024-09-10T20:55:18.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.849+0000 7f554ac00640 1 -- 172.21.15.6:0/1003888170 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f553c00e6f0 con 0x7f552c00b550 2024-09-10T20:55:18.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.856+0000 7f0613e00640 1 -- 172.21.15.6:0/1186793290 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f061415abd0 msgr2=0x7f06140cbab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:18.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.856+0000 7f0613e00640 1 --2- 172.21.15.6:0/1186793290 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f061415abd0 0x7f06140cbab0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0600009830 tx=0x7f060002a480 comp rx=0 tx=0).stop 2024-09-10T20:55:18.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.857+0000 7f0613e00640 1 -- 172.21.15.6:0/1186793290 shutdown_connections 2024-09-10T20:55:18.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.857+0000 7f0613e00640 1 --2- 172.21.15.6:0/1186793290 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06140aedd0 0x7f06140c9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.858+0000 7f0613e00640 1 --2- 172.21.15.6:0/1186793290 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f061415abd0 0x7f06140cbab0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.858+0000 7f0613e00640 1 -- 172.21.15.6:0/1186793290 >> 172.21.15.6:0/1186793290 conn(0x7f061406d660 msgr2=0x7f06140b1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:18.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.859+0000 7f5541600640 1 -- 172.21.15.6:0/1003888170 <== mon.2 v2:172.21.15.150:3301/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v9)=0 v9) ==== 117+0+0 (secure 0 0 0) 0x7f5544094c90 con 0x7f552c00b550 2024-09-10T20:55:18.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.861+0000 7f554ac00640 1 -- 172.21.15.6:0/1003888170 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f552c00b550 msgr2=0x7f553c174ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:18.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.862+0000 7f554ac00640 1 --2- 172.21.15.6:0/1003888170 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f552c00b550 0x7f553c174ea0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5544052150 tx=0x7f554406a370 comp rx=0 tx=0).stop 2024-09-10T20:55:18.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.866+0000 7f554ac00640 1 -- 172.21.15.6:0/1003888170 shutdown_connections 2024-09-10T20:55:18.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.866+0000 7f554ac00640 1 --2- 172.21.15.6:0/1003888170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f553c0dc880 0x7f553c04b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.866+0000 7f554ac00640 1 --2- 172.21.15.6:0/1003888170 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f553c04d2e0 0x7f553c005c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.866+0000 7f554ac00640 1 --2- 172.21.15.6:0/1003888170 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f552c00b550 0x7f553c174ea0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.866+0000 7f554ac00640 1 -- 172.21.15.6:0/1003888170 >> 172.21.15.6:0/1003888170 conn(0x7f553c01d940 msgr2=0x7f553c0d5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:18.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.866+0000 7f0613e00640 1 -- 172.21.15.6:0/1186793290 shutdown_connections 2024-09-10T20:55:18.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.867+0000 7f554ac00640 1 -- 172.21.15.6:0/1003888170 shutdown_connections 2024-09-10T20:55:18.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.867+0000 7f0613e00640 1 -- 172.21.15.6:0/1186793290 wait complete. 2024-09-10T20:55:18.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.867+0000 7f554ac00640 1 -- 172.21.15.6:0/1003888170 wait complete. 2024-09-10T20:55:18.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.871+0000 7f3394a00640 1 -- 172.21.15.6:0/1764221890 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3374003a50 msgr2=0x7f3374003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:18.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.871+0000 7f3394a00640 1 --2- 172.21.15.6:0/1764221890 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3374003a50 0x7f3374003e90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3380006ef0 tx=0x7f3374005830 comp rx=0 tx=0).stop 2024-09-10T20:55:18.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.871+0000 7f338fe00640 1 -- 172.21.15.6:0/1764221890 reap_dead start 2024-09-10T20:55:18.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.874+0000 7f64b1a00640 1 -- 172.21.15.6:0/3972317608 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64ac0cffc0 msgr2=0x7f64ac0d0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:18.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.874+0000 7f64b1a00640 1 --2- 172.21.15.6:0/3972317608 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64ac0cffc0 0x7f64ac0d0b60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6498009860 tx=0x7f649802a530 comp rx=0 tx=0).stop 2024-09-10T20:55:18.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.877+0000 7f64b1a00640 1 -- 172.21.15.6:0/3972317608 shutdown_connections 2024-09-10T20:55:18.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.877+0000 7f64b1a00640 1 --2- 172.21.15.6:0/3972317608 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64ac0cffc0 0x7f64ac0d0b60 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.877+0000 7f64b1a00640 1 -- 172.21.15.6:0/3972317608 >> 172.21.15.6:0/3972317608 conn(0x7f64ac0d3ea0 msgr2=0x7f64ac0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:18.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.875+0000 7f3394a00640 1 -- 172.21.15.6:0/1764221890 shutdown_connections 2024-09-10T20:55:18.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.875+0000 7f3394a00640 1 -- 172.21.15.6:0/1764221890 >> 172.21.15.6:0/1764221890 conn(0x7f339009d030 msgr2=0x7f33900d3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:18.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.875+0000 7f3394a00640 1 -- 172.21.15.6:0/1764221890 shutdown_connections 2024-09-10T20:55:18.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.875+0000 7f3394a00640 1 -- 172.21.15.6:0/1764221890 wait complete. 2024-09-10T20:55:18.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.878+0000 7f64b1a00640 1 -- 172.21.15.6:0/3972317608 shutdown_connections 2024-09-10T20:55:18.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.878+0000 7f64b1a00640 1 -- 172.21.15.6:0/3972317608 wait complete. 2024-09-10T20:55:18.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.874+0000 7f0613e00640 1 Processor -- start 2024-09-10T20:55:18.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.879+0000 7f0613e00640 1 -- start start 2024-09-10T20:55:18.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.886+0000 7f0613e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06140aedd0 0x7f0614151b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:18.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.885+0000 7f64b1a00640 1 Processor -- start 2024-09-10T20:55:18.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.886+0000 7f0613e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0614159b00 0x7f06141555c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:18.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.886+0000 7f0612a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06140aedd0 0x7f0614151b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:18.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.887+0000 7f3394a00640 1 Processor -- start 2024-09-10T20:55:18.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.887+0000 7f0612a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06140aedd0 0x7f0614151b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.6:33110/0 (socket says 172.21.15.6:33110) 2024-09-10T20:55:18.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.887+0000 7f0612a00640 1 -- 172.21.15.6:0/3250749472 learned_addr learned my addr 172.21.15.6:0/3250749472 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:18.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.887+0000 7f64b1a00640 1 -- start start 2024-09-10T20:55:18.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.887+0000 7f3394a00640 1 -- start start 2024-09-10T20:55:18.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.889+0000 7f64b1a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64ac0cffc0 0x7f64ac0cd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:18.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.889+0000 7f64b1a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f64ac0d0780 0x7f64ac09dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:18.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.889+0000 7f64b1a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64ac0d10a0 0x7f64ac15ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:18.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.892+0000 7f64aa000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f64ac0d0780 0x7f64ac09dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:18.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.892+0000 7f64b1a00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f64ac0b3370 con 0x7f64ac0cffc0 2024-09-10T20:55:18.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.892+0000 7f64b1a00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f64ac0b31f0 con 0x7f64ac0d0780 2024-09-10T20:55:18.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.892+0000 7f64b1a00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f64ac0cede0 con 0x7f64ac0d10a0 2024-09-10T20:55:18.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.892+0000 7f64abe00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64ac0d10a0 0x7f64ac15ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:18.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.892+0000 7f64abe00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64ac0d10a0 0x7f64ac15ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.6:33112/0 (socket says 172.21.15.6:33112) 2024-09-10T20:55:18.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.892+0000 7f64abe00640 1 -- 172.21.15.6:0/2070514711 learned_addr learned my addr 172.21.15.6:0/2070514711 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:18.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.888+0000 7f0613e00640 1 --2- 172.21.15.6:0/3250749472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f061415abd0 0x7f06141f8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:18.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.889+0000 7f0612000640 1 --2- 172.21.15.6:0/3250749472 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0614159b00 0x7f06141555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:18.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.890+0000 7f0613e00640 1 -- 172.21.15.6:0/3250749472 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f06140cbff0 con 0x7f061415abd0 2024-09-10T20:55:18.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.890+0000 7f0613e00640 1 -- 172.21.15.6:0/3250749472 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0614070700 con 0x7f0614159b00 2024-09-10T20:55:18.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.890+0000 7f0613e00640 1 -- 172.21.15.6:0/3250749472 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f06140cc170 con 0x7f06140aedd0 2024-09-10T20:55:18.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.890+0000 7f0613400640 1 --2- 172.21.15.6:0/3250749472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f061415abd0 0x7f06141f8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:18.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.891+0000 7f0612a00640 1 -- 172.21.15.6:0/3250749472 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0614159b00 msgr2=0x7f06141555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:18.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.891+0000 7f0612a00640 1 --2- 172.21.15.6:0/3250749472 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0614159b00 0x7f06141555c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.891+0000 7f0612a00640 1 -- 172.21.15.6:0/3250749472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f061415abd0 msgr2=0x7f06141f8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:18.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.891+0000 7f0612a00640 1 --2- 172.21.15.6:0/3250749472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f061415abd0 0x7f06141f8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.891+0000 7f0612a00640 1 -- 172.21.15.6:0/3250749472 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06140b0bc0 con 0x7f06140aedd0 2024-09-10T20:55:18.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.891+0000 7f0613400640 1 --2- 172.21.15.6:0/3250749472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f061415abd0 0x7f06141f8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:55:18.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.892+0000 7f0612000640 1 --2- 172.21.15.6:0/3250749472 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0614159b00 0x7f06141555c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:55:18.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.892+0000 7f64aaa00640 1 --2- 172.21.15.6:0/2070514711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64ac0cffc0 0x7f64ac0cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:18.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.893+0000 7f64abe00640 1 -- 172.21.15.6:0/2070514711 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f64ac0d0780 msgr2=0x7f64ac09dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:18.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.893+0000 7f64abe00640 1 --2- 172.21.15.6:0/2070514711 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f64ac0d0780 0x7f64ac09dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.893+0000 7f64abe00640 1 -- 172.21.15.6:0/2070514711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64ac0cffc0 msgr2=0x7f64ac0cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:18.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.893+0000 7f64abe00640 1 --2- 172.21.15.6:0/2070514711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64ac0cffc0 0x7f64ac0cd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.893+0000 7f3394a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3374003a50 0x7f3390157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:18.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.893+0000 7f64abe00640 1 -- 172.21.15.6:0/2070514711 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64ac09e190 con 0x7f64ac0d10a0 2024-09-10T20:55:18.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.893+0000 7f64aaa00640 1 --2- 172.21.15.6:0/2070514711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64ac0cffc0 0x7f64ac0cd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:55:18.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.893+0000 7f64abe00640 1 --2- 172.21.15.6:0/2070514711 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64ac0d10a0 0x7f64ac15ded0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f64a400caa0 tx=0x7f64a400cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:18.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.894+0000 7f64a2a00640 1 -- 172.21.15.6:0/2070514711 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a400a9a0 con 0x7f64ac0d10a0 2024-09-10T20:55:18.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.894+0000 7f3394a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33901f4eb0 0x7f33900b7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:18.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.894+0000 7f0612a00640 1 --2- 172.21.15.6:0/3250749472 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06140aedd0 0x7f0614151b10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f060400c430 tx=0x7f060400c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:18.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.894+0000 7f3394a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f339006e710 0x7f33900b7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:18.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.894+0000 7f64a2a00640 1 -- 172.21.15.6:0/2070514711 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f64a4017070 con 0x7f64ac0d10a0 2024-09-10T20:55:18.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.894+0000 7f64a2a00640 1 -- 172.21.15.6:0/2070514711 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a400a9a0 con 0x7f64ac0d10a0 2024-09-10T20:55:18.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.894+0000 7f64b1a00640 1 -- 172.21.15.6:0/2070514711 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64ac1507d0 con 0x7f64ac0d10a0 2024-09-10T20:55:18.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.894+0000 7f3394a00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f33900cef30 con 0x7f3374003a50 2024-09-10T20:55:18.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.894+0000 7f3394a00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f33900b3100 con 0x7f33901f4eb0 2024-09-10T20:55:18.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.894+0000 7f3394a00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f33900cf0b0 con 0x7f339006e710 2024-09-10T20:55:18.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.895+0000 7f338f400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3374003a50 0x7f3390157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:18.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.895+0000 7f060aa00640 1 -- 172.21.15.6:0/3250749472 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0604006890 con 0x7f06140aedd0 2024-09-10T20:55:18.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.895+0000 7f64a2a00640 1 -- 172.21.15.6:0/2070514711 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f64a400ac50 con 0x7f64ac0d10a0 2024-09-10T20:55:18.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.895+0000 7f64b1a00640 1 -- 172.21.15.6:0/2070514711 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f64ac09f950 con 0x7f64ac0d10a0 2024-09-10T20:55:18.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.896+0000 7f060aa00640 1 -- 172.21.15.6:0/3250749472 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0604006b20 con 0x7f06140aedd0 2024-09-10T20:55:18.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.896+0000 7f0613e00640 1 -- 172.21.15.6:0/3250749472 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0614157120 con 0x7f06140aedd0 2024-09-10T20:55:18.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.896+0000 7f0613e00640 1 -- 172.21.15.6:0/3250749472 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f06141576e0 con 0x7f06140aedd0 2024-09-10T20:55:18.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.897+0000 7f64a2a00640 1 -- 172.21.15.6:0/2070514711 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f64a40126c0 con 0x7f64ac0d10a0 2024-09-10T20:55:18.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.897+0000 7f060aa00640 1 -- 172.21.15.6:0/3250749472 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0604007020 con 0x7f06140aedd0 2024-09-10T20:55:18.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.895+0000 7f338fe00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f339006e710 0x7f33900b7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:18.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.895+0000 7f338fe00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f339006e710 0x7f33900b7c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.6:33126/0 (socket says 172.21.15.6:33126) 2024-09-10T20:55:18.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.895+0000 7f338fe00640 1 -- 172.21.15.6:0/2230174572 learned_addr learned my addr 172.21.15.6:0/2230174572 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:18.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.895+0000 7f338ea00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33901f4eb0 0x7f33900b7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:18.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.897+0000 7f64b1a00640 1 -- 172.21.15.6:0/2070514711 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64ac0d0b60 con 0x7f64ac0d10a0 2024-09-10T20:55:18.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.898+0000 7f728a400640 1 -- 172.21.15.6:0/242257636 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7268004360 msgr2=0x7f726800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:18.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.898+0000 7f728a400640 1 --2- 172.21.15.6:0/242257636 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7268004360 0x7f726800b9c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7274006f10 tx=0x7f7268005830 comp rx=0 tx=0).stop 2024-09-10T20:55:18.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.898+0000 7f060aa00640 1 -- 172.21.15.6:0/3250749472 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f0604011590 con 0x7f06140aedd0 2024-09-10T20:55:18.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.899+0000 7f060aa00640 1 -- 172.21.15.6:0/3250749472 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f06040127e0 con 0x7f06140aedd0 2024-09-10T20:55:18.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.899+0000 7f0613e00640 1 -- 172.21.15.6:0/3250749472 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05ec005290 con 0x7f06140aedd0 2024-09-10T20:55:18.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.898+0000 7f338ea00640 1 -- 172.21.15.6:0/2230174572 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f339006e710 msgr2=0x7f33900b7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:18.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.898+0000 7f338ea00640 1 --2- 172.21.15.6:0/2230174572 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f339006e710 0x7f33900b7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.898+0000 7f338ea00640 1 -- 172.21.15.6:0/2230174572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3374003a50 msgr2=0x7f3390157570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:18.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.902+0000 7f338ea00640 1 --2- 172.21.15.6:0/2230174572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3374003a50 0x7f3390157570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.902+0000 7f338ea00640 1 -- 172.21.15.6:0/2230174572 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33901f5750 con 0x7f33901f4eb0 2024-09-10T20:55:18.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.902+0000 7f338f400640 1 --2- 172.21.15.6:0/2230174572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3374003a50 0x7f3390157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:55:18.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.903+0000 7f728a400640 1 -- 172.21.15.6:0/242257636 shutdown_connections 2024-09-10T20:55:18.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.903+0000 7f728a400640 1 --2- 172.21.15.6:0/242257636 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7268004360 0x7f726800b9c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.903+0000 7f728a400640 1 -- 172.21.15.6:0/242257636 >> 172.21.15.6:0/242257636 conn(0x7f728409d030 msgr2=0x7f72840d3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:18.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.903+0000 7f338ea00640 1 --2- 172.21.15.6:0/2230174572 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33901f4eb0 0x7f33900b7740 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f337c00b440 tx=0x7f337c009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:18.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.903+0000 7f728a400640 1 -- 172.21.15.6:0/242257636 shutdown_connections 2024-09-10T20:55:18.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.903+0000 7f3387400640 1 -- 172.21.15.6:0/2230174572 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337c015020 con 0x7f33901f4eb0 2024-09-10T20:55:18.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.903+0000 7f3387400640 1 -- 172.21.15.6:0/2230174572 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f337c011920 con 0x7f33901f4eb0 2024-09-10T20:55:18.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.904+0000 7f64a2a00640 1 -- 172.21.15.6:0/2070514711 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f64a4012970 con 0x7f64ac0d10a0 2024-09-10T20:55:18.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.903+0000 7f060aa00640 1 -- 172.21.15.6:0/3250749472 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f0604007610 con 0x7f06140aedd0 2024-09-10T20:55:18.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.903+0000 7f3387400640 1 -- 172.21.15.6:0/2230174572 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337c011d70 con 0x7f33901f4eb0 2024-09-10T20:55:18.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.904+0000 7f3394a00640 1 -- 172.21.15.6:0/2230174572 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33901f5a30 con 0x7f33901f4eb0 2024-09-10T20:55:18.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.904+0000 7f3394a00640 1 -- 172.21.15.6:0/2230174572 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33901f5ff0 con 0x7f33901f4eb0 2024-09-10T20:55:18.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.906+0000 7f3394a00640 1 -- 172.21.15.6:0/2230174572 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3390157ab0 con 0x7f33901f4eb0 2024-09-10T20:55:18.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.904+0000 7f728a400640 1 -- 172.21.15.6:0/242257636 wait complete. 2024-09-10T20:55:18.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.906+0000 7f728a400640 1 Processor -- start 2024-09-10T20:55:18.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.910+0000 7f3387400640 1 -- 172.21.15.6:0/2230174572 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f337c01a790 con 0x7f33901f4eb0 2024-09-10T20:55:18.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.910+0000 7f3387400640 1 -- 172.21.15.6:0/2230174572 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f337c019db0 con 0x7f33901f4eb0 2024-09-10T20:55:18.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.910+0000 7f728a400640 1 -- start start 2024-09-10T20:55:18.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.913+0000 7f728a400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7268004360 0x7f7284149d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:18.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.913+0000 7f728a400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72840b21b0 0x7f7284152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:18.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.913+0000 7f7289000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7268004360 0x7f7284149d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:18.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.914+0000 7f7289000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7268004360 0x7f7284149d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.6:33140/0 (socket says 172.21.15.6:33140) 2024-09-10T20:55:18.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.914+0000 7f7289000640 1 -- 172.21.15.6:0/3324162663 learned_addr learned my addr 172.21.15.6:0/3324162663 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:18.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.914+0000 7f728a400640 1 --2- 172.21.15.6:0/3324162663 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f728414ff90 0x7f7284152d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:18.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.915+0000 7f728a400640 1 -- 172.21.15.6:0/3324162663 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f72840d2990 con 0x7f72840b21b0 2024-09-10T20:55:18.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.915+0000 7f7289a00640 1 --2- 172.21.15.6:0/3324162663 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f728414ff90 0x7f7284152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:18.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.915+0000 7f3387400640 1 -- 172.21.15.6:0/2230174572 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f337c01f020 con 0x7f33901f4eb0 2024-09-10T20:55:18.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.915+0000 7f728a400640 1 -- 172.21.15.6:0/3324162663 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f72840d2810 con 0x7f728414ff90 2024-09-10T20:55:18.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.915+0000 7f728a400640 1 -- 172.21.15.6:0/3324162663 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f72840d2b10 con 0x7f7268004360 2024-09-10T20:55:18.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.916+0000 7f7283e00640 1 --2- 172.21.15.6:0/3324162663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72840b21b0 0x7f7284152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:18.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.916+0000 7f1a8a600640 1 -- 172.21.15.6:0/850358563 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f1a840b6e60 con 0x7f1a8415c310 2024-09-10T20:55:18.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.916+0000 7f7289a00640 1 -- 172.21.15.6:0/3324162663 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7268004360 msgr2=0x7f7284149d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:18.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.916+0000 7f7289a00640 1 --2- 172.21.15.6:0/3324162663 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7268004360 0x7f7284149d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.916+0000 7f7289a00640 1 -- 172.21.15.6:0/3324162663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72840b21b0 msgr2=0x7f7284152820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:18.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.916+0000 7f7289a00640 1 --2- 172.21.15.6:0/3324162663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72840b21b0 0x7f7284152820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.916+0000 7f7289a00640 1 -- 172.21.15.6:0/3324162663 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72841f9780 con 0x7f728414ff90 2024-09-10T20:55:18.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.917+0000 7f7289a00640 1 --2- 172.21.15.6:0/3324162663 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f728414ff90 0x7f7284152d60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7284074270 tx=0x7f7274006450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:18.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.917+0000 7f7283e00640 1 --2- 172.21.15.6:0/3324162663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72840b21b0 0x7f7284152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:55:18.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.920+0000 7f7280c00640 1 -- 172.21.15.6:0/3324162663 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7274003800 con 0x7f728414ff90 2024-09-10T20:55:18.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.920+0000 7f7280c00640 1 -- 172.21.15.6:0/3324162663 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7274003a90 con 0x7f728414ff90 2024-09-10T20:55:18.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.920+0000 7f7280c00640 1 -- 172.21.15.6:0/3324162663 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7274003800 con 0x7f728414ff90 2024-09-10T20:55:18.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.920+0000 7f728a400640 1 -- 172.21.15.6:0/3324162663 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f728414ad80 con 0x7f728414ff90 2024-09-10T20:55:18.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.922+0000 7f728a400640 1 -- 172.21.15.6:0/3324162663 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72841f9a20 con 0x7f728414ff90 2024-09-10T20:55:18.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.923+0000 7f7280c00640 1 -- 172.21.15.6:0/3324162663 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f727402f480 con 0x7f728414ff90 2024-09-10T20:55:18.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.925+0000 7f1a7b400640 1 -- 172.21.15.6:0/850358563 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v10)=0 v10) ==== 115+0+0 (secure 0 0 0) 0x7f1a841f53e0 con 0x7f1a8415c310 2024-09-10T20:55:18.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.924+0000 7f7280c00640 1 -- 172.21.15.6:0/3324162663 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7274034070 con 0x7f728414ff90 2024-09-10T20:55:18.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.924+0000 7f727a000640 1 -- 172.21.15.6:0/3324162663 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7254005290 con 0x7f728414ff90 2024-09-10T20:55:18.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.928+0000 7f1a8a600640 1 -- 172.21.15.6:0/850358563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a8415c310 msgr2=0x7f1a840b7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:18.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.928+0000 7f1a8a600640 1 --2- 172.21.15.6:0/850358563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a8415c310 0x7f1a840b7080 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1a7000b410 tx=0x7f1a7000b8d0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.930+0000 7f7280c00640 1 -- 172.21.15.6:0/3324162663 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f727404a020 con 0x7f728414ff90 2024-09-10T20:55:18.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.932+0000 7f1a8a600640 1 -- 172.21.15.6:0/850358563 shutdown_connections 2024-09-10T20:55:18.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.932+0000 7f1a8a600640 1 --2- 172.21.15.6:0/850358563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a8415c310 0x7f1a840b7080 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.932+0000 7f1a8a600640 1 --2- 172.21.15.6:0/850358563 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a840cd680 0x7f1a840b8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.932+0000 7f1a8a600640 1 --2- 172.21.15.6:0/850358563 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a68003a00 0x7f1a841f4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.932+0000 7f1a8a600640 1 -- 172.21.15.6:0/850358563 >> 172.21.15.6:0/850358563 conn(0x7f1a8409d030 msgr2=0x7f1a840cf670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:18.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.932+0000 7f1a8a600640 1 -- 172.21.15.6:0/850358563 shutdown_connections 2024-09-10T20:55:18.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.932+0000 7f1a8a600640 1 -- 172.21.15.6:0/850358563 wait complete. 2024-09-10T20:55:18.937 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi006') 2024-09-10T20:55:18.937 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi006') 2024-09-10T20:55:18.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.934+0000 7f22eca00640 1 -- 172.21.15.6:0/4133481879 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e0031070 con 0x7f22d4004800 2024-09-10T20:55:18.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.934+0000 7f22f4e00640 1 -- 172.21.15.6:0/4133481879 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22d4004800 msgr2=0x7f22d4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:18.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.934+0000 7f22f4e00640 1 --2- 172.21.15.6:0/4133481879 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22d4004800 0x7f22d4004c80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f22e000c310 tx=0x7f22d4005830 comp rx=0 tx=0).stop 2024-09-10T20:55:18.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.936+0000 7f22f4e00640 1 -- 172.21.15.6:0/4133481879 shutdown_connections 2024-09-10T20:55:18.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.936+0000 7f22f4e00640 1 --2- 172.21.15.6:0/4133481879 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22d4004800 0x7f22d4004c80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.936+0000 7f22f4e00640 1 -- 172.21.15.6:0/4133481879 >> 172.21.15.6:0/4133481879 conn(0x7f22f009d0c0 msgr2=0x7f22f00d3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:18.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.936+0000 7f22f4e00640 1 -- 172.21.15.6:0/4133481879 shutdown_connections 2024-09-10T20:55:18.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.936+0000 7f22f4e00640 1 -- 172.21.15.6:0/4133481879 wait complete. 2024-09-10T20:55:18.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.939+0000 7f22f4e00640 1 Processor -- start 2024-09-10T20:55:18.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.940+0000 7f22f4e00640 1 -- start start 2024-09-10T20:55:18.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.941+0000 7f22f4e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22d4004800 0x7f22f02028b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:18.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.941+0000 7f22f4e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22f00cded0 0x7f22f0160800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:18.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.941+0000 7f22f4e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22f0162050 0x7f22f0160d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:18.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.942+0000 7f22f4e00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f22f00d4be0 con 0x7f22f00cded0 2024-09-10T20:55:18.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.942+0000 7f22f4e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f22f00d4a60 con 0x7f22f0162050 2024-09-10T20:55:18.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.942+0000 7f22f4e00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f22f015dc60 con 0x7f22d4004800 2024-09-10T20:55:18.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.943+0000 7f22ede00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22d4004800 0x7f22f02028b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:18.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.943+0000 7f22ede00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22d4004800 0x7f22f02028b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.6:33158/0 (socket says 172.21.15.6:33158) 2024-09-10T20:55:18.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.943+0000 7f22ede00640 1 -- 172.21.15.6:0/1888585592 learned_addr learned my addr 172.21.15.6:0/1888585592 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:18.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.943+0000 7f22ede00640 1 -- 172.21.15.6:0/1888585592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22f0162050 msgr2=0x7f22f0160d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:18.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.943+0000 7f22ede00640 1 --2- 172.21.15.6:0/1888585592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22f0162050 0x7f22f0160d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.943+0000 7f22ede00640 1 -- 172.21.15.6:0/1888585592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22f00cded0 msgr2=0x7f22f0160800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:18.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.943+0000 7f22ede00640 1 --2- 172.21.15.6:0/1888585592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22f00cded0 0x7f22f0160800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.943+0000 7f22ede00640 1 -- 172.21.15.6:0/1888585592 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22f00c8cd0 con 0x7f22d4004800 2024-09-10T20:55:18.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.944+0000 7f22ede00640 1 --2- 172.21.15.6:0/1888585592 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22d4004800 0x7f22f02028b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f22d8011ab0 tx=0x7f22d8011f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:18.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.944+0000 7f22e6000640 1 -- 172.21.15.6:0/1888585592 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d800fe70 con 0x7f22d4004800 2024-09-10T20:55:18.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.944+0000 7f22e6000640 1 -- 172.21.15.6:0/1888585592 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f22d8016070 con 0x7f22d4004800 2024-09-10T20:55:18.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.945+0000 7f22e6000640 1 -- 172.21.15.6:0/1888585592 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d800fe70 con 0x7f22d4004800 2024-09-10T20:55:18.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.946+0000 7f22f4e00640 1 -- 172.21.15.6:0/1888585592 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22f0205890 con 0x7f22d4004800 2024-09-10T20:55:18.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.946+0000 7f22f4e00640 1 -- 172.21.15.6:0/1888585592 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f22f0202df0 con 0x7f22d4004800 2024-09-10T20:55:18.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.948+0000 7f22f4e00640 1 -- 172.21.15.6:0/1888585592 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22f02056a0 con 0x7f22d4004800 2024-09-10T20:55:18.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.948+0000 7f22e6000640 1 -- 172.21.15.6:0/1888585592 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f22d802b080 con 0x7f22d4004800 2024-09-10T20:55:18.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.948+0000 7f22e6000640 1 -- 172.21.15.6:0/1888585592 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f22d801a6e0 con 0x7f22d4004800 2024-09-10T20:55:18.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.952+0000 7f22e6000640 1 -- 172.21.15.6:0/1888585592 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f22d801a8e0 con 0x7f22d4004800 2024-09-10T20:55:18.964 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi006') 2024-09-10T20:55:18.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.959+0000 7ff985200640 1 -- 172.21.15.6:0/3142183469 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff980158310 msgr2=0x7ff98015b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:18.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.959+0000 7ff985200640 1 --2- 172.21.15.6:0/3142183469 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff980158310 0x7ff98015b930 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff978005fd0 tx=0x7ff97802aac0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.963+0000 7ff985200640 1 -- 172.21.15.6:0/3142183469 shutdown_connections 2024-09-10T20:55:18.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.963+0000 7ff985200640 1 --2- 172.21.15.6:0/3142183469 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff980158310 0x7ff98015b930 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.963+0000 7ff985200640 1 -- 172.21.15.6:0/3142183469 >> 172.21.15.6:0/3142183469 conn(0x7ff9800cfdf0 msgr2=0x7ff9800d01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:18.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.967+0000 7ff985200640 1 -- 172.21.15.6:0/3142183469 shutdown_connections 2024-09-10T20:55:18.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.967+0000 7ff985200640 1 -- 172.21.15.6:0/3142183469 wait complete. 2024-09-10T20:55:18.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.970+0000 7ff985200640 1 Processor -- start 2024-09-10T20:55:18.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.970+0000 7ff985200640 1 -- start start 2024-09-10T20:55:18.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.974+0000 7ff985200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9800706f0 0x7ff98015c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:18.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.974+0000 7ff985200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9800734b0 0x7ff980149120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:18.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.974+0000 7ff985200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff980158310 0x7ff980149660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:18.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.974+0000 7ff97f400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9800706f0 0x7ff98015c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:18.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.974+0000 7ff97f400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9800706f0 0x7ff98015c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.6:57680/0 (socket says 172.21.15.6:57680) 2024-09-10T20:55:18.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.975+0000 7ff97ea00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9800734b0 0x7ff980149120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:18.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.975+0000 7ff97ea00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9800734b0 0x7ff980149120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.6:33166/0 (socket says 172.21.15.6:33166) 2024-09-10T20:55:18.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.977+0000 7ff97fe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff980158310 0x7ff980149660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:18.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.978+0000 7ff97fe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff980158310 0x7ff980149660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51292/0 (socket says 172.21.15.6:51292) 2024-09-10T20:55:18.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.978+0000 7ff97f400640 1 -- 172.21.15.6:0/1335506776 learned_addr learned my addr 172.21.15.6:0/1335506776 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:18.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.978+0000 7ff985200640 1 -- 172.21.15.6:0/1335506776 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff980158870 con 0x7ff980158310 2024-09-10T20:55:18.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.978+0000 7ff985200640 1 -- 172.21.15.6:0/1335506776 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff9801586f0 con 0x7ff9800706f0 2024-09-10T20:55:18.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.978+0000 7ff985200640 1 -- 172.21.15.6:0/1335506776 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ff980074010 con 0x7ff9800734b0 2024-09-10T20:55:18.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.979+0000 7ff97f400640 1 -- 172.21.15.6:0/1335506776 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9800734b0 msgr2=0x7ff980149120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:18.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.979+0000 7ff97f400640 1 --2- 172.21.15.6:0/1335506776 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9800734b0 0x7ff980149120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.979+0000 7ff97f400640 1 -- 172.21.15.6:0/1335506776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff980158310 msgr2=0x7ff980149660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:18.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.979+0000 7ff97f400640 1 --2- 172.21.15.6:0/1335506776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff980158310 0x7ff980149660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:18.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.979+0000 7ff97f400640 1 -- 172.21.15.6:0/1335506776 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff980149ba0 con 0x7ff9800706f0 2024-09-10T20:55:18.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.980+0000 7ff97ea00640 1 --2- 172.21.15.6:0/1335506776 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9800734b0 0x7ff980149120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:55:18.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.980+0000 7ff97f400640 1 --2- 172.21.15.6:0/1335506776 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9800706f0 0x7ff98015c250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff978009bf0 tx=0x7ff978003f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:18.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.980+0000 7ff97fe00640 1 --2- 172.21.15.6:0/1335506776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff980158310 0x7ff980149660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:55:18.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.980+0000 7ff977400640 1 -- 172.21.15.6:0/1335506776 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9780044d0 con 0x7ff9800706f0 2024-09-10T20:55:18.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.980+0000 7ff977400640 1 -- 172.21.15.6:0/1335506776 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff978004760 con 0x7ff9800706f0 2024-09-10T20:55:18.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.980+0000 7ff977400640 1 -- 172.21.15.6:0/1335506776 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97803b670 con 0x7ff9800706f0 2024-09-10T20:55:18.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.980+0000 7ff985200640 1 -- 172.21.15.6:0/1335506776 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff980149e10 con 0x7ff9800706f0 2024-09-10T20:55:18.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.981+0000 7ff985200640 1 -- 172.21.15.6:0/1335506776 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9801f1630 con 0x7ff9800706f0 2024-09-10T20:55:18.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.982+0000 7ff977400640 1 -- 172.21.15.6:0/1335506776 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7ff978043020 con 0x7ff9800706f0 2024-09-10T20:55:18.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.982+0000 7ff977400640 1 -- 172.21.15.6:0/1335506776 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff978045810 con 0x7ff9800706f0 2024-09-10T20:55:18.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.982+0000 7ff985200640 1 -- 172.21.15.6:0/1335506776 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9801f1a70 con 0x7ff9800706f0 2024-09-10T20:55:18.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:18.986+0000 7ff977400640 1 -- 172.21.15.6:0/1335506776 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7ff978032030 con 0x7ff9800706f0 2024-09-10T20:55:19.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.005+0000 7f3c38400640 1 -- 172.21.15.6:0/3815539125 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f3c300b70f0 con 0x7f3c30162400 2024-09-10T20:55:19.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.006+0000 7f744fa00640 1 -- 172.21.15.6:0/3976667302 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f74480b55e0 con 0x7f7448204d90 2024-09-10T20:55:19.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.016+0000 7f3c2d600640 1 -- 172.21.15.6:0/3815539125 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v11)=0 v11) ==== 119+0+0 (secure 0 0 0) 0x7f3c30069960 con 0x7f3c30162400 2024-09-10T20:55:19.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.022+0000 7f7444c00640 1 -- 172.21.15.6:0/3976667302 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7f74480b55e0 con 0x7f7448204d90 2024-09-10T20:55:19.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.022+0000 7f3c38400640 1 -- 172.21.15.6:0/3815539125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c30162400 msgr2=0x7f3c300caec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:19.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.022+0000 7f3c38400640 1 --2- 172.21.15.6:0/3815539125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c30162400 0x7f3c300caec0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c006010 tx=0x7f3c1c003820 comp rx=0 tx=0).stop 2024-09-10T20:55:19.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.024+0000 7f744fa00640 1 -- 172.21.15.6:0/3976667302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7448204d90 msgr2=0x7f74482051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:19.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.024+0000 7f744fa00640 1 --2- 172.21.15.6:0/3976667302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7448204d90 0x7f74482051f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f74480761f0 tx=0x7f744000cb90 comp rx=0 tx=0).stop 2024-09-10T20:55:19.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.024+0000 7f744fa00640 1 -- 172.21.15.6:0/3976667302 shutdown_connections 2024-09-10T20:55:19.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.024+0000 7f744fa00640 1 --2- 172.21.15.6:0/3976667302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7448204d90 0x7f74482051f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:19.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.024+0000 7f744fa00640 1 --2- 172.21.15.6:0/3976667302 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74480c6340 0x7f744806ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:19.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.024+0000 7f744fa00640 1 --2- 172.21.15.6:0/3976667302 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74480c5f60 0x7f744806f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:19.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.024+0000 7f744fa00640 1 -- 172.21.15.6:0/3976667302 >> 172.21.15.6:0/3976667302 conn(0x7f74480cfa20 msgr2=0x7f744816cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:19.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.022+0000 7f3c38400640 1 -- 172.21.15.6:0/3815539125 shutdown_connections 2024-09-10T20:55:19.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.022+0000 7f3c38400640 1 --2- 172.21.15.6:0/3815539125 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c300d0330 0x7f3c300cc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:19.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.022+0000 7f3c38400640 1 --2- 172.21.15.6:0/3815539125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c30162400 0x7f3c300caec0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:19.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.022+0000 7f3c38400640 1 --2- 172.21.15.6:0/3815539125 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c300b6c40 0x7f3c301f7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:19.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.022+0000 7f3c38400640 1 -- 172.21.15.6:0/3815539125 >> 172.21.15.6:0/3815539125 conn(0x7f3c3009d0c0 msgr2=0x7f3c300b5870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:19.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.023+0000 7f3c38400640 1 -- 172.21.15.6:0/3815539125 shutdown_connections 2024-09-10T20:55:19.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.023+0000 7f3c38400640 1 -- 172.21.15.6:0/3815539125 wait complete. 2024-09-10T20:55:19.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.024+0000 7f744fa00640 1 -- 172.21.15.6:0/3976667302 shutdown_connections 2024-09-10T20:55:19.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.024+0000 7fcbbe600640 1 -- 172.21.15.6:0/2604858897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7fcbb806ef30 con 0x7fcbb80cd920 2024-09-10T20:55:19.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.024+0000 7f744fa00640 1 -- 172.21.15.6:0/3976667302 wait complete. 2024-09-10T20:55:19.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.032+0000 7fcbaf400640 1 -- 172.21.15.6:0/2604858897 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v13)=0 v13) ==== 121+0+0 (secure 0 0 0) 0x7fcbb0023070 con 0x7fcbb80cd920 2024-09-10T20:55:19.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.035+0000 7fcbbe600640 1 -- 172.21.15.6:0/2604858897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbb80cd920 msgr2=0x7fcbb80b3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:19.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.035+0000 7fcbbe600640 1 --2- 172.21.15.6:0/2604858897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbb80cd920 0x7fcbb80b3530 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcbb000ba80 tx=0x7fcbb000bf40 comp rx=0 tx=0).stop 2024-09-10T20:55:19.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.036+0000 7fcbbe600640 1 -- 172.21.15.6:0/2604858897 shutdown_connections 2024-09-10T20:55:19.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.036+0000 7fcbbe600640 1 --2- 172.21.15.6:0/2604858897 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcbb8158150 0x7fcbb8158600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:19.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.038+0000 7fcbbe600640 1 --2- 172.21.15.6:0/2604858897 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbb815bcb0 0x7fcbb81f6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:19.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.038+0000 7fcbbe600640 1 --2- 172.21.15.6:0/2604858897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbb80cd920 0x7fcbb80b3530 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:19.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.038+0000 7fcbbe600640 1 -- 172.21.15.6:0/2604858897 >> 172.21.15.6:0/2604858897 conn(0x7fcbb80cfa20 msgr2=0x7fcbb80ce7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:19.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.038+0000 7fcbbe600640 1 -- 172.21.15.6:0/2604858897 shutdown_connections 2024-09-10T20:55:19.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.038+0000 7fcbbe600640 1 -- 172.21.15.6:0/2604858897 wait complete. 2024-09-10T20:55:19.059 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi006') 2024-09-10T20:55:19.078 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi006') 2024-09-10T20:55:19.078 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi006') 2024-09-10T20:55:19.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.086+0000 7f0613e00640 1 -- 172.21.15.6:0/3250749472 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f05ec005580 con 0x7f06140aedd0 2024-09-10T20:55:19.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.088+0000 7f3394a00640 1 -- 172.21.15.6:0/2230174572 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f3390161250 con 0x7f33901f4eb0 2024-09-10T20:55:19.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.093+0000 7f060aa00640 1 -- 172.21.15.6:0/3250749472 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v14)=0 v14) ==== 120+0+0 (secure 0 0 0) 0x7f0604012a30 con 0x7f06140aedd0 2024-09-10T20:55:19.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.093+0000 7f64b1a00640 1 -- 172.21.15.6:0/2070514711 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f64ac0b0d00 con 0x7f64ac0d10a0 2024-09-10T20:55:19.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.094+0000 7f0613e00640 1 -- 172.21.15.6:0/3250749472 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06140aedd0 msgr2=0x7f0614151b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:19.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.094+0000 7f0613e00640 1 --2- 172.21.15.6:0/3250749472 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06140aedd0 0x7f0614151b10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f060400c430 tx=0x7f060400c8f0 comp rx=0 tx=0).stop 2024-09-10T20:55:19.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.095+0000 7f0613e00640 1 -- 172.21.15.6:0/3250749472 shutdown_connections 2024-09-10T20:55:19.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.095+0000 7f0613e00640 1 --2- 172.21.15.6:0/3250749472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f061415abd0 0x7f06141f8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:19.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.095+0000 7f0613e00640 1 --2- 172.21.15.6:0/3250749472 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0614159b00 0x7f06141555c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:19.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.095+0000 7f0613e00640 1 --2- 172.21.15.6:0/3250749472 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06140aedd0 0x7f0614151b10 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:19.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.095+0000 7f0613e00640 1 -- 172.21.15.6:0/3250749472 >> 172.21.15.6:0/3250749472 conn(0x7f061406d660 msgr2=0x7f061415d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:19.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.095+0000 7f0613e00640 1 -- 172.21.15.6:0/3250749472 shutdown_connections 2024-09-10T20:55:19.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.095+0000 7f0613e00640 1 -- 172.21.15.6:0/3250749472 wait complete. 2024-09-10T20:55:19.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.102+0000 7f3387400640 1 -- 172.21.15.6:0/2230174572 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v15)=0 v15) ==== 121+0+0 (secure 0 0 0) 0x7f337c01aab0 con 0x7f33901f4eb0 2024-09-10T20:55:19.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.105+0000 7f3394a00640 1 -- 172.21.15.6:0/2230174572 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33901f4eb0 msgr2=0x7f33900b7740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:19.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.105+0000 7f3394a00640 1 --2- 172.21.15.6:0/2230174572 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33901f4eb0 0x7f33900b7740 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f337c00b440 tx=0x7f337c009f90 comp rx=0 tx=0).stop 2024-09-10T20:55:19.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.105+0000 7f3394a00640 1 -- 172.21.15.6:0/2230174572 shutdown_connections 2024-09-10T20:55:19.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.105+0000 7f3394a00640 1 --2- 172.21.15.6:0/2230174572 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f339006e710 0x7f33900b7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:19.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.105+0000 7f3394a00640 1 --2- 172.21.15.6:0/2230174572 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33901f4eb0 0x7f33900b7740 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:19.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.105+0000 7f3394a00640 1 --2- 172.21.15.6:0/2230174572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3374003a50 0x7f3390157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:19.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.105+0000 7f3394a00640 1 -- 172.21.15.6:0/2230174572 >> 172.21.15.6:0/2230174572 conn(0x7f339009d030 msgr2=0x7f33900b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:19.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.105+0000 7f3394a00640 1 -- 172.21.15.6:0/2230174572 shutdown_connections 2024-09-10T20:55:19.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.105+0000 7f3394a00640 1 -- 172.21.15.6:0/2230174572 wait complete. 2024-09-10T20:55:19.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.110+0000 7f64a2a00640 1 -- 172.21.15.6:0/2070514711 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v16)=0 v16) ==== 121+0+0 (secure 0 0 0) 0x7f64a4012b50 con 0x7f64ac0d10a0 2024-09-10T20:55:19.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.112+0000 7f64b1a00640 1 -- 172.21.15.6:0/2070514711 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64ac0d10a0 msgr2=0x7f64ac15ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:19.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.112+0000 7f64b1a00640 1 --2- 172.21.15.6:0/2070514711 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64ac0d10a0 0x7f64ac15ded0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f64a400caa0 tx=0x7f64a400cf60 comp rx=0 tx=0).stop 2024-09-10T20:55:19.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.112+0000 7f64b1a00640 1 -- 172.21.15.6:0/2070514711 shutdown_connections 2024-09-10T20:55:19.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.112+0000 7f64b1a00640 1 --2- 172.21.15.6:0/2070514711 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64ac0d10a0 0x7f64ac15ded0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:19.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.112+0000 7f64b1a00640 1 --2- 172.21.15.6:0/2070514711 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f64ac0d0780 0x7f64ac09dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:19.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.112+0000 7f64b1a00640 1 --2- 172.21.15.6:0/2070514711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64ac0cffc0 0x7f64ac0cd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:19.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.112+0000 7f64b1a00640 1 -- 172.21.15.6:0/2070514711 >> 172.21.15.6:0/2070514711 conn(0x7f64ac0d3ea0 msgr2=0x7f64ac0ce6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:19.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.112+0000 7f64b1a00640 1 -- 172.21.15.6:0/2070514711 shutdown_connections 2024-09-10T20:55:19.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.112+0000 7f64b1a00640 1 -- 172.21.15.6:0/2070514711 wait complete. 2024-09-10T20:55:19.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.116+0000 7f22f4e00640 1 -- 172.21.15.6:0/1888585592 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f22f015e0e0 con 0x7f22d4004800 2024-09-10T20:55:19.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.118+0000 7f727a000640 1 -- 172.21.15.6:0/3324162663 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f7254005580 con 0x7f728414ff90 2024-09-10T20:55:19.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.121+0000 7ff985200640 1 -- 172.21.15.6:0/1335506776 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7ff98015b930 con 0x7ff9800706f0 2024-09-10T20:55:19.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.123+0000 7f22e6000640 1 -- 172.21.15.6:0/1888585592 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v17)=0 v17) ==== 125+0+0 (secure 0 0 0) 0x7f22d801aba0 con 0x7f22d4004800 2024-09-10T20:55:19.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.124+0000 7f22f4e00640 1 -- 172.21.15.6:0/1888585592 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22d4004800 msgr2=0x7f22f02028b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:19.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.124+0000 7f22f4e00640 1 --2- 172.21.15.6:0/1888585592 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22d4004800 0x7f22f02028b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f22d8011ab0 tx=0x7f22d8011f70 comp rx=0 tx=0).stop 2024-09-10T20:55:19.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.125+0000 7f22f4e00640 1 -- 172.21.15.6:0/1888585592 shutdown_connections 2024-09-10T20:55:19.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.125+0000 7f22f4e00640 1 --2- 172.21.15.6:0/1888585592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22f00cded0 0x7f22f0160800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:19.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.125+0000 7f22f4e00640 1 --2- 172.21.15.6:0/1888585592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22f0162050 0x7f22f0160d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:19.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.125+0000 7f22f4e00640 1 --2- 172.21.15.6:0/1888585592 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22d4004800 0x7f22f02028b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:19.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.125+0000 7f22f4e00640 1 -- 172.21.15.6:0/1888585592 >> 172.21.15.6:0/1888585592 conn(0x7f22f009d0c0 msgr2=0x7f22f00d1790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:19.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.126+0000 7f22f4e00640 1 -- 172.21.15.6:0/1888585592 shutdown_connections 2024-09-10T20:55:19.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.126+0000 7f22f4e00640 1 -- 172.21.15.6:0/1888585592 wait complete. 2024-09-10T20:55:19.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.128+0000 7f7280c00640 1 -- 172.21.15.6:0/3324162663 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v18)=0 v18) ==== 120+0+0 (secure 0 0 0) 0x7f7274039dd0 con 0x7f728414ff90 2024-09-10T20:55:19.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.130+0000 7f727a000640 1 -- 172.21.15.6:0/3324162663 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f728414ff90 msgr2=0x7f7284152d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:19.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.130+0000 7f727a000640 1 --2- 172.21.15.6:0/3324162663 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f728414ff90 0x7f7284152d60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7284074270 tx=0x7f7274006450 comp rx=0 tx=0).stop 2024-09-10T20:55:19.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.130+0000 7f727a000640 1 -- 172.21.15.6:0/3324162663 shutdown_connections 2024-09-10T20:55:19.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.130+0000 7f727a000640 1 --2- 172.21.15.6:0/3324162663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72840b21b0 0x7f7284152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:19.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.130+0000 7f727a000640 1 --2- 172.21.15.6:0/3324162663 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f728414ff90 0x7f7284152d60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:19.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.130+0000 7f727a000640 1 --2- 172.21.15.6:0/3324162663 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7268004360 0x7f7284149d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:19.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.130+0000 7f727a000640 1 -- 172.21.15.6:0/3324162663 >> 172.21.15.6:0/3324162663 conn(0x7f728409d030 msgr2=0x7f72840b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:19.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.130+0000 7f727a000640 1 -- 172.21.15.6:0/3324162663 shutdown_connections 2024-09-10T20:55:19.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.130+0000 7f727a000640 1 -- 172.21.15.6:0/3324162663 wait complete. 2024-09-10T20:55:19.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.134+0000 7ff977400640 1 -- 172.21.15.6:0/1335506776 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v19)=0 v19) ==== 121+0+0 (secure 0 0 0) 0x7ff978032030 con 0x7ff9800706f0 2024-09-10T20:55:19.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.135+0000 7ff985200640 1 -- 172.21.15.6:0/1335506776 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9800706f0 msgr2=0x7ff98015c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:19.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.135+0000 7ff985200640 1 --2- 172.21.15.6:0/1335506776 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9800706f0 0x7ff98015c250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff978009bf0 tx=0x7ff978003f90 comp rx=0 tx=0).stop 2024-09-10T20:55:19.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.135+0000 7ff985200640 1 -- 172.21.15.6:0/1335506776 shutdown_connections 2024-09-10T20:55:19.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.135+0000 7ff985200640 1 --2- 172.21.15.6:0/1335506776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff980158310 0x7ff980149660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:19.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.135+0000 7ff985200640 1 --2- 172.21.15.6:0/1335506776 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9800734b0 0x7ff980149120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:19.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.135+0000 7ff985200640 1 --2- 172.21.15.6:0/1335506776 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9800706f0 0x7ff98015c250 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:19.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.135+0000 7ff985200640 1 -- 172.21.15.6:0/1335506776 >> 172.21.15.6:0/1335506776 conn(0x7ff9800cfdf0 msgr2=0x7ff98015af20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:19.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.135+0000 7ff985200640 1 -- 172.21.15.6:0/1335506776 shutdown_connections 2024-09-10T20:55:19.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.135+0000 7ff985200640 1 -- 172.21.15.6:0/1335506776 wait complete. 2024-09-10T20:55:19.140 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi006') 2024-09-10T20:55:19.153 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi006') 2024-09-10T20:55:19.153 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi006') 2024-09-10T20:55:19.153 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi006') 2024-09-10T20:55:19.153 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi006') 2024-09-10T20:55:19.156 INFO:tasks.ceph:Setting crush tunables to default 2024-09-10T20:55:19.156 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph osd crush tunables default 2024-09-10T20:55:19.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.351+0000 7f5b26400640 1 -- 172.21.15.6:0/905217310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b200b7c50 msgr2=0x7f5b20168cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:19.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.351+0000 7f5b26400640 1 --2- 172.21.15.6:0/905217310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b200b7c50 0x7f5b20168cd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5b18005fd0 tx=0x7f5b1802ab40 comp rx=0 tx=0).stop 2024-09-10T20:55:19.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.352+0000 7f5b26400640 1 -- 172.21.15.6:0/905217310 shutdown_connections 2024-09-10T20:55:19.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.352+0000 7f5b26400640 1 --2- 172.21.15.6:0/905217310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b200b7c50 0x7f5b20168cd0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:19.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.352+0000 7f5b26400640 1 -- 172.21.15.6:0/905217310 >> 172.21.15.6:0/905217310 conn(0x7f5b2009d0c0 msgr2=0x7f5b200d3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:19.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.352+0000 7f5b26400640 1 -- 172.21.15.6:0/905217310 shutdown_connections 2024-09-10T20:55:19.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.352+0000 7f5b26400640 1 -- 172.21.15.6:0/905217310 wait complete. 2024-09-10T20:55:19.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.353+0000 7f5b26400640 1 Processor -- start 2024-09-10T20:55:19.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.353+0000 7f5b26400640 1 -- start start 2024-09-10T20:55:19.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.354+0000 7f5b26400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b200b7c50 0x7f5b200caec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:19.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.354+0000 7f5b26400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b200d4850 0x7f5b20161690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:19.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.354+0000 7f5b26400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b20162400 0x7f5b20150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:19.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.354+0000 7f5b26400640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5b20169390 con 0x7f5b20162400 2024-09-10T20:55:19.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.354+0000 7f5b26400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5b20169210 con 0x7f5b200d4850 2024-09-10T20:55:19.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.354+0000 7f5b26400640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f5b20169510 con 0x7f5b200b7c50 2024-09-10T20:55:19.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.355+0000 7f5b1fe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b20162400 0x7f5b20150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:19.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.355+0000 7f5b1f400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b200b7c50 0x7f5b200caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:19.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.355+0000 7f5b1f400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b200b7c50 0x7f5b200caec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.6:33178/0 (socket says 172.21.15.6:33178) 2024-09-10T20:55:19.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.355+0000 7f5b1f400640 1 -- 172.21.15.6:0/2812713445 learned_addr learned my addr 172.21.15.6:0/2812713445 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:19.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.355+0000 7f5b16a00640 1 --2- 172.21.15.6:0/2812713445 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b200d4850 0x7f5b20161690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:19.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.355+0000 7f5b1f400640 1 -- 172.21.15.6:0/2812713445 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b200d4850 msgr2=0x7f5b20161690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:19.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.355+0000 7f5b1f400640 1 --2- 172.21.15.6:0/2812713445 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b200d4850 0x7f5b20161690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:19.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.355+0000 7f5b1f400640 1 -- 172.21.15.6:0/2812713445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b20162400 msgr2=0x7f5b20150710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:19.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.355+0000 7f5b1f400640 1 --2- 172.21.15.6:0/2812713445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b20162400 0x7f5b20150710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:19.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.355+0000 7f5b1f400640 1 -- 172.21.15.6:0/2812713445 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b200cb550 con 0x7f5b200b7c50 2024-09-10T20:55:19.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.355+0000 7f5b1fe00640 1 --2- 172.21.15.6:0/2812713445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b20162400 0x7f5b20150710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:55:19.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.355+0000 7f5b1f400640 1 --2- 172.21.15.6:0/2812713445 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b200b7c50 0x7f5b200caec0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5b1000c400 tx=0x7f5b1000c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:19.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.356+0000 7f5b17e00640 1 -- 172.21.15.6:0/2812713445 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b10017070 con 0x7f5b200b7c50 2024-09-10T20:55:19.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.356+0000 7f5b17e00640 1 -- 172.21.15.6:0/2812713445 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b100053c0 con 0x7f5b200b7c50 2024-09-10T20:55:19.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.356+0000 7f5b17e00640 1 -- 172.21.15.6:0/2812713445 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b10003850 con 0x7f5b200b7c50 2024-09-10T20:55:19.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.356+0000 7f5b26400640 1 -- 172.21.15.6:0/2812713445 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b200cb830 con 0x7f5b200b7c50 2024-09-10T20:55:19.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.356+0000 7f5b26400640 1 -- 172.21.15.6:0/2812713445 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b200cbdf0 con 0x7f5b200b7c50 2024-09-10T20:55:19.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.356+0000 7f5b17e00640 1 -- 172.21.15.6:0/2812713445 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f5b100039f0 con 0x7f5b200b7c50 2024-09-10T20:55:19.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.356+0000 7f5b17e00640 1 -- 172.21.15.6:0/2812713445 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5b1001c850 con 0x7f5b200b7c50 2024-09-10T20:55:19.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.357+0000 7f5b26400640 1 -- 172.21.15.6:0/2812713445 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b200d0330 con 0x7f5b200b7c50 2024-09-10T20:55:19.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.359+0000 7f5b17e00640 1 -- 172.21.15.6:0/2812713445 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f5b10021020 con 0x7f5b200b7c50 2024-09-10T20:55:19.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.428+0000 7f5b26400640 1 -- 172.21.15.6:0/2812713445 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f5b200b9d70 con 0x7f5b200b7c50 2024-09-10T20:55:19.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.434+0000 7f5b17e00640 1 -- 172.21.15.6:0/2812713445 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f5b1001ca50 con 0x7f5b200b7c50 2024-09-10T20:55:19.438 INFO:teuthology.orchestra.run.smithi006.stderr:adjusted tunables profile to default 2024-09-10T20:55:19.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.435+0000 7f5b26400640 1 -- 172.21.15.6:0/2812713445 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b200b7c50 msgr2=0x7f5b200caec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:19.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.435+0000 7f5b26400640 1 --2- 172.21.15.6:0/2812713445 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b200b7c50 0x7f5b200caec0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5b1000c400 tx=0x7f5b1000c8c0 comp rx=0 tx=0).stop 2024-09-10T20:55:19.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.435+0000 7f5b26400640 1 -- 172.21.15.6:0/2812713445 shutdown_connections 2024-09-10T20:55:19.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.435+0000 7f5b26400640 1 --2- 172.21.15.6:0/2812713445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b20162400 0x7f5b20150710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:19.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.435+0000 7f5b26400640 1 --2- 172.21.15.6:0/2812713445 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b200d4850 0x7f5b20161690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:19.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.435+0000 7f5b26400640 1 --2- 172.21.15.6:0/2812713445 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b200b7c50 0x7f5b200caec0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:19.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.435+0000 7f5b26400640 1 -- 172.21.15.6:0/2812713445 >> 172.21.15.6:0/2812713445 conn(0x7f5b2009d0c0 msgr2=0x7f5b200b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:19.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.435+0000 7f5b26400640 1 -- 172.21.15.6:0/2812713445 shutdown_connections 2024-09-10T20:55:19.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:19.435+0000 7f5b26400640 1 -- 172.21.15.6:0/2812713445 wait complete. 2024-09-10T20:55:19.454 INFO:tasks.ceph:check_enable_crimson: False 2024-09-10T20:55:19.454 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-10T20:55:19.454 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-10T20:55:19.454 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-10T20:55:19.510 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-10T20:55:19.511 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-10T20:55:19.606 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-10T20:55:19.606 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-10T20:55:19.706 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-10T20:55:19.706 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-10T20:55:19.802 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-10T20:55:19.802 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-10T20:55:19.859 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-10T20:55:19.859 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-10T20:55:19.957 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-10T20:55:19.957 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-10T20:55:20.053 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-10T20:55:20.053 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-10T20:55:20.149 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 0918c5c8-a028-4987-bad2-406c412ec3f7 0 2024-09-10T20:55:20.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.339+0000 7ff96e200640 1 -- 172.21.15.150:0/2143311383 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9680d0330 msgr2=0x7ff9680d0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:20.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.339+0000 7ff96e200640 1 --2- 172.21.15.150:0/2143311383 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9680d0330 0x7ff9680d0770 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff950009830 tx=0x7ff95002a510 comp rx=0 tx=0).stop 2024-09-10T20:55:20.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.339+0000 7ff96e200640 1 -- 172.21.15.150:0/2143311383 shutdown_connections 2024-09-10T20:55:20.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.340+0000 7ff96e200640 1 --2- 172.21.15.150:0/2143311383 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9680d0330 0x7ff9680d0770 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:20.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.340+0000 7ff96e200640 1 --2- 172.21.15.150:0/2143311383 >> v2:172.21.15.6:3300/0 conn(0x7ff968162400 0x7ff9680d4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:20.344 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.340+0000 7ff96e200640 1 -- 172.21.15.150:0/2143311383 >> 172.21.15.150:0/2143311383 conn(0x7ff96809d0c0 msgr2=0x7ff9680d3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:20.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.340+0000 7ff96e200640 1 -- 172.21.15.150:0/2143311383 shutdown_connections 2024-09-10T20:55:20.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.340+0000 7ff96e200640 1 -- 172.21.15.150:0/2143311383 wait complete. 2024-09-10T20:55:20.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.341+0000 7ff96e200640 1 Processor -- start 2024-09-10T20:55:20.345 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.341+0000 7ff96e200640 1 -- start start 2024-09-10T20:55:20.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.342+0000 7ff96e200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9680d0330 0x7ff9681f7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:20.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.342+0000 7ff96e200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9680d0cb0 0x7ff9680cd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:20.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.342+0000 7ff96e200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff968162400 0x7ff9680ca200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:20.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.342+0000 7ff96e200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff9680b7dd0 con 0x7ff9680d0330 2024-09-10T20:55:20.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.342+0000 7ff96e200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff9680b7c50 con 0x7ff9680d0cb0 2024-09-10T20:55:20.347 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.342+0000 7ff96e200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ff9680cf0d0 con 0x7ff968162400 2024-09-10T20:55:20.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.342+0000 7ff95fe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9680d0cb0 0x7ff9680cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:20.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.342+0000 7ff95fe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9680d0cb0 0x7ff9680cd300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43876/0 (socket says 172.21.15.150:43876) 2024-09-10T20:55:20.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.342+0000 7ff967400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9680d0330 0x7ff9681f7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:20.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.342+0000 7ff95fe00640 1 -- 172.21.15.150:0/3349954324 learned_addr learned my addr 172.21.15.150:0/3349954324 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-10T20:55:20.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.342+0000 7ff967e00640 1 --2- 172.21.15.150:0/3349954324 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff968162400 0x7ff9680ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:20.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.343+0000 7ff967400640 1 -- 172.21.15.150:0/3349954324 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff968162400 msgr2=0x7ff9680ca200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:20.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.343+0000 7ff967400640 1 --2- 172.21.15.150:0/3349954324 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff968162400 0x7ff9680ca200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:20.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.343+0000 7ff967400640 1 -- 172.21.15.150:0/3349954324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9680d0cb0 msgr2=0x7ff9680cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:20.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.343+0000 7ff967400640 1 --2- 172.21.15.150:0/3349954324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9680d0cb0 0x7ff9680cd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:20.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.343+0000 7ff967400640 1 -- 172.21.15.150:0/3349954324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9680a0120 con 0x7ff9680d0330 2024-09-10T20:55:20.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.343+0000 7ff967e00640 1 --2- 172.21.15.150:0/3349954324 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff968162400 0x7ff9680ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:55:20.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.343+0000 7ff967400640 1 --2- 172.21.15.150:0/3349954324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9680d0330 0x7ff9681f7c00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff95800e6d0 tx=0x7ff95800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:20.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.343+0000 7ff95f400640 1 -- 172.21.15.150:0/3349954324 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff95800cab0 con 0x7ff9680d0330 2024-09-10T20:55:20.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.344+0000 7ff95f400640 1 -- 172.21.15.150:0/3349954324 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff95800cd40 con 0x7ff9680d0330 2024-09-10T20:55:20.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.344+0000 7ff95f400640 1 -- 172.21.15.150:0/3349954324 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff958010690 con 0x7ff9680d0330 2024-09-10T20:55:20.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.344+0000 7ff96e200640 1 -- 172.21.15.150:0/3349954324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9681f8370 con 0x7ff9680d0330 2024-09-10T20:55:20.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.344+0000 7ff96e200640 1 -- 172.21.15.150:0/3349954324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9681f8930 con 0x7ff9680d0330 2024-09-10T20:55:20.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.344+0000 7ff95f400640 1 -- 172.21.15.150:0/3349954324 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7ff958010830 con 0x7ff9680d0330 2024-09-10T20:55:20.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.344+0000 7ff95f400640 1 -- 172.21.15.150:0/3349954324 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7ff958018cb0 con 0x7ff9680d0330 2024-09-10T20:55:20.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.345+0000 7ff96e200640 1 -- 172.21.15.150:0/3349954324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9680cf620 con 0x7ff9680d0330 2024-09-10T20:55:20.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.348+0000 7ff95f400640 1 -- 172.21.15.150:0/3349954324 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7ff9680a0120 con 0x7ff9680d0330 2024-09-10T20:55:20.426 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.422+0000 7ff96e200640 1 -- 172.21.15.150:0/3349954324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0918c5c8-a028-4987-bad2-406c412ec3f7", "id": 0} v 0) -- 0x7ff9680b65d0 con 0x7ff9680d0330 2024-09-10T20:55:20.430 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.426+0000 7ff95f400640 1 -- 172.21.15.150:0/3349954324 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0918c5c8-a028-4987-bad2-406c412ec3f7", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7ff958010ce0 con 0x7ff9680d0330 2024-09-10T20:55:20.430 INFO:teuthology.orchestra.run.smithi150.stdout:0 2024-09-10T20:55:20.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.428+0000 7ff96e200640 1 -- 172.21.15.150:0/3349954324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9680d0330 msgr2=0x7ff9681f7c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:20.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.428+0000 7ff96e200640 1 --2- 172.21.15.150:0/3349954324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9680d0330 0x7ff9681f7c00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff95800e6d0 tx=0x7ff95800eb90 comp rx=0 tx=0).stop 2024-09-10T20:55:20.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.428+0000 7ff96e200640 1 -- 172.21.15.150:0/3349954324 shutdown_connections 2024-09-10T20:55:20.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.428+0000 7ff96e200640 1 --2- 172.21.15.150:0/3349954324 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff968162400 0x7ff9680ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:20.432 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.428+0000 7ff96e200640 1 --2- 172.21.15.150:0/3349954324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9680d0cb0 0x7ff9680cd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:20.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.428+0000 7ff96e200640 1 --2- 172.21.15.150:0/3349954324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9680d0330 0x7ff9681f7c00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:20.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.428+0000 7ff96e200640 1 -- 172.21.15.150:0/3349954324 >> 172.21.15.150:0/3349954324 conn(0x7ff96809d0c0 msgr2=0x7ff96806e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:20.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.428+0000 7ff96e200640 1 -- 172.21.15.150:0/3349954324 shutdown_connections 2024-09-10T20:55:20.433 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.428+0000 7ff96e200640 1 -- 172.21.15.150:0/3349954324 wait complete. 2024-09-10T20:55:20.447 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 415e9c78-c3d9-46d6-b277-348453f42155 1 2024-09-10T20:55:20.601 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.596+0000 7fe32b800640 1 -- 172.21.15.150:0/4087527125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3240d4850 msgr2=0x7fe3240d0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:20.601 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.596+0000 7fe32b800640 1 --2- 172.21.15.150:0/4087527125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3240d4850 0x7fe3240d0a40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe310005fd0 tx=0x7fe31002a670 comp rx=0 tx=0).stop 2024-09-10T20:55:20.601 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.596+0000 7fe32b800640 1 -- 172.21.15.150:0/4087527125 shutdown_connections 2024-09-10T20:55:20.601 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.596+0000 7fe32b800640 1 --2- 172.21.15.150:0/4087527125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3240d4850 0x7fe3240d0a40 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:20.601 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.596+0000 7fe32b800640 1 -- 172.21.15.150:0/4087527125 >> 172.21.15.150:0/4087527125 conn(0x7fe32409d0c0 msgr2=0x7fe3240d3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:20.601 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.596+0000 7fe32b800640 1 -- 172.21.15.150:0/4087527125 shutdown_connections 2024-09-10T20:55:20.601 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.596+0000 7fe32b800640 1 -- 172.21.15.150:0/4087527125 wait complete. 2024-09-10T20:55:20.602 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.598+0000 7fe32b800640 1 Processor -- start 2024-09-10T20:55:20.602 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.598+0000 7fe32b800640 1 -- start start 2024-09-10T20:55:20.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.599+0000 7fe32b800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3240b6c40 0x7fe324156f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:20.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.599+0000 7fe32b800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3240d4850 0x7fe32415e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:20.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.599+0000 7fe32b800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe324162400 0x7fe3241f4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:20.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.599+0000 7fe32b800640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe3240b77e0 con 0x7fe324162400 2024-09-10T20:55:20.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.599+0000 7fe32b800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe3240cfc80 con 0x7fe3240d4850 2024-09-10T20:55:20.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.599+0000 7fe32b800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe3240b7960 con 0x7fe3240b6c40 2024-09-10T20:55:20.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.599+0000 7fe328e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3240b6c40 0x7fe324156f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:20.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.599+0000 7fe323e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3240d4850 0x7fe32415e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:20.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.599+0000 7fe328e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3240b6c40 0x7fe324156f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.150:60074/0 (socket says 172.21.15.150:60074) 2024-09-10T20:55:20.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.599+0000 7fe323e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3240d4850 0x7fe32415e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43904/0 (socket says 172.21.15.150:43904) 2024-09-10T20:55:20.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.599+0000 7fe328e00640 1 -- 172.21.15.150:0/2575474980 learned_addr learned my addr 172.21.15.150:0/2575474980 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-10T20:55:20.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.599+0000 7fe329800640 1 --2- 172.21.15.150:0/2575474980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe324162400 0x7fe3241f4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:20.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.600+0000 7fe328e00640 1 -- 172.21.15.150:0/2575474980 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3240d4850 msgr2=0x7fe32415e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:20.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.600+0000 7fe328e00640 1 --2- 172.21.15.150:0/2575474980 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3240d4850 0x7fe32415e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:20.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.600+0000 7fe328e00640 1 -- 172.21.15.150:0/2575474980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe324162400 msgr2=0x7fe3241f4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:20.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.600+0000 7fe328e00640 1 --2- 172.21.15.150:0/2575474980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe324162400 0x7fe3241f4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:20.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.600+0000 7fe328e00640 1 -- 172.21.15.150:0/2575474980 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe324158f50 con 0x7fe3240b6c40 2024-09-10T20:55:20.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.600+0000 7fe323e00640 1 --2- 172.21.15.150:0/2575474980 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3240d4850 0x7fe32415e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:55:20.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.600+0000 7fe328e00640 1 --2- 172.21.15.150:0/2575474980 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3240b6c40 0x7fe324156f00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe31800c370 tx=0x7fe31800c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:20.607 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.600+0000 7fe320c00640 1 -- 172.21.15.150:0/2575474980 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe318017070 con 0x7fe3240b6c40 2024-09-10T20:55:20.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.600+0000 7fe320c00640 1 -- 172.21.15.150:0/2575474980 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe3180035f0 con 0x7fe3240b6c40 2024-09-10T20:55:20.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.600+0000 7fe320c00640 1 -- 172.21.15.150:0/2575474980 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe318003a40 con 0x7fe3240b6c40 2024-09-10T20:55:20.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.600+0000 7fe32b800640 1 -- 172.21.15.150:0/2575474980 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe324159230 con 0x7fe3240b6c40 2024-09-10T20:55:20.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.600+0000 7fe32b800640 1 -- 172.21.15.150:0/2575474980 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3241f4410 con 0x7fe3240b6c40 2024-09-10T20:55:20.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.601+0000 7fe320c00640 1 -- 172.21.15.150:0/2575474980 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fe318003be0 con 0x7fe3240b6c40 2024-09-10T20:55:20.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.601+0000 7fe320c00640 1 -- 172.21.15.150:0/2575474980 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fe318012840 con 0x7fe3240b6c40 2024-09-10T20:55:20.608 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.601+0000 7fe32b800640 1 -- 172.21.15.150:0/2575474980 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3241f4200 con 0x7fe3240b6c40 2024-09-10T20:55:20.609 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.605+0000 7fe320c00640 1 -- 172.21.15.150:0/2575474980 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fe318021030 con 0x7fe3240b6c40 2024-09-10T20:55:20.684 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.680+0000 7fe32b800640 1 -- 172.21.15.150:0/2575474980 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd new", "uuid": "415e9c78-c3d9-46d6-b277-348453f42155", "id": 1} v 0) -- 0x7fe3240b70d0 con 0x7fe3240b6c40 2024-09-10T20:55:20.689 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.684+0000 7fe320c00640 1 -- 172.21.15.150:0/2575474980 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "415e9c78-c3d9-46d6-b277-348453f42155", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fe318012a90 con 0x7fe3240b6c40 2024-09-10T20:55:20.689 INFO:teuthology.orchestra.run.smithi150.stdout:1 2024-09-10T20:55:20.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.685+0000 7fe32b800640 1 -- 172.21.15.150:0/2575474980 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3240b6c40 msgr2=0x7fe324156f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:20.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.685+0000 7fe32b800640 1 --2- 172.21.15.150:0/2575474980 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3240b6c40 0x7fe324156f00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe31800c370 tx=0x7fe31800c830 comp rx=0 tx=0).stop 2024-09-10T20:55:20.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.685+0000 7fe32b800640 1 -- 172.21.15.150:0/2575474980 shutdown_connections 2024-09-10T20:55:20.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.685+0000 7fe32b800640 1 --2- 172.21.15.150:0/2575474980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe324162400 0x7fe3241f4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:20.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.685+0000 7fe32b800640 1 --2- 172.21.15.150:0/2575474980 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3240d4850 0x7fe32415e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:20.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.685+0000 7fe32b800640 1 --2- 172.21.15.150:0/2575474980 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3240b6c40 0x7fe324156f00 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:20.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.685+0000 7fe32b800640 1 -- 172.21.15.150:0/2575474980 >> 172.21.15.150:0/2575474980 conn(0x7fe32409d0c0 msgr2=0x7fe3240b9110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:20.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.686+0000 7fe32b800640 1 -- 172.21.15.150:0/2575474980 shutdown_connections 2024-09-10T20:55:20.690 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.686+0000 7fe32b800640 1 -- 172.21.15.150:0/2575474980 wait complete. 2024-09-10T20:55:20.704 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 763c1cf2-a43d-4c10-815d-eaf4a32afc1d 2 2024-09-10T20:55:20.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.856+0000 7fbfb3e00640 1 -- 172.21.15.150:0/347638758 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfb40d0f10 msgr2=0x7fbfb40d4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:20.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.856+0000 7fbfb3e00640 1 --2- 172.21.15.150:0/347638758 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfb40d0f10 0x7fbfb40d4500 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0009860 tx=0x7fbfa002a5a0 comp rx=0 tx=0).stop 2024-09-10T20:55:20.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.856+0000 7fbfb3e00640 1 -- 172.21.15.150:0/347638758 shutdown_connections 2024-09-10T20:55:20.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.856+0000 7fbfb3e00640 1 --2- 172.21.15.150:0/347638758 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfb40d0f10 0x7fbfb40d4500 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:20.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.856+0000 7fbfb3e00640 1 -- 172.21.15.150:0/347638758 >> 172.21.15.150:0/347638758 conn(0x7fbfb409d0f0 msgr2=0x7fbfb40d3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:20.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.856+0000 7fbfb3e00640 1 -- 172.21.15.150:0/347638758 shutdown_connections 2024-09-10T20:55:20.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.856+0000 7fbfb3e00640 1 -- 172.21.15.150:0/347638758 wait complete. 2024-09-10T20:55:20.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.857+0000 7fbfb3e00640 1 Processor -- start 2024-09-10T20:55:20.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.858+0000 7fbfb3e00640 1 -- start start 2024-09-10T20:55:20.864 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.858+0000 7fbfb3e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfb40b53e0 0x7fbfb41f8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:20.865 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.858+0000 7fbfb3e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfb40d0f10 0x7fbfb415d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:20.865 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.858+0000 7fbfb3e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfb4161610 0x7fbfb40cd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:20.865 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.859+0000 7fbfb3e00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb40b46a0 con 0x7fbfb40d0f10 2024-09-10T20:55:20.865 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.859+0000 7fbfb3e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb40b4520 con 0x7fbfb4161610 2024-09-10T20:55:20.865 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.859+0000 7fbfb3e00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fbfb40b4820 con 0x7fbfb40b53e0 2024-09-10T20:55:20.865 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.859+0000 7fbfb2a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfb40b53e0 0x7fbfb41f8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:20.865 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.859+0000 7fbfb2a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfb40b53e0 0x7fbfb41f8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.150:60092/0 (socket says 172.21.15.150:60092) 2024-09-10T20:55:20.865 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.859+0000 7fbfb2a00640 1 -- 172.21.15.150:0/2078859895 learned_addr learned my addr 172.21.15.150:0/2078859895 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-10T20:55:20.865 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.859+0000 7fbfb2000640 1 --2- 172.21.15.150:0/2078859895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfb40d0f10 0x7fbfb415d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:20.865 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.859+0000 7fbfb3400640 1 --2- 172.21.15.150:0/2078859895 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfb4161610 0x7fbfb40cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:20.866 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.859+0000 7fbfb2a00640 1 -- 172.21.15.150:0/2078859895 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfb4161610 msgr2=0x7fbfb40cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:20.866 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.859+0000 7fbfb2a00640 1 --2- 172.21.15.150:0/2078859895 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfb4161610 0x7fbfb40cd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:20.866 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.859+0000 7fbfb2a00640 1 -- 172.21.15.150:0/2078859895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfb40d0f10 msgr2=0x7fbfb415d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:20.866 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.859+0000 7fbfb2a00640 1 --2- 172.21.15.150:0/2078859895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfb40d0f10 0x7fbfb415d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:20.866 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.859+0000 7fbfb2a00640 1 -- 172.21.15.150:0/2078859895 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb41f8cd0 con 0x7fbfb40b53e0 2024-09-10T20:55:20.866 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.859+0000 7fbfb3400640 1 --2- 172.21.15.150:0/2078859895 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfb4161610 0x7fbfb40cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:55:20.866 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.859+0000 7fbfb2a00640 1 --2- 172.21.15.150:0/2078859895 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfb40b53e0 0x7fbfb41f8790 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbfa400c390 tx=0x7fbfa4001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:20.866 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.860+0000 7fbfaaa00640 1 -- 172.21.15.150:0/2078859895 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa4011790 con 0x7fbfb40b53e0 2024-09-10T20:55:20.866 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.860+0000 7fbfaaa00640 1 -- 172.21.15.150:0/2078859895 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbfa4017070 con 0x7fbfb40b53e0 2024-09-10T20:55:20.866 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.860+0000 7fbfb3e00640 1 -- 172.21.15.150:0/2078859895 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfb40cba80 con 0x7fbfb40b53e0 2024-09-10T20:55:20.866 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.860+0000 7fbfaaa00640 1 -- 172.21.15.150:0/2078859895 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa4011d00 con 0x7fbfb40b53e0 2024-09-10T20:55:20.866 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.860+0000 7fbfb3e00640 1 -- 172.21.15.150:0/2078859895 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfb40c8b80 con 0x7fbfb40b53e0 2024-09-10T20:55:20.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.860+0000 7fbfaaa00640 1 -- 172.21.15.150:0/2078859895 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fbfa401c460 con 0x7fbfb40b53e0 2024-09-10T20:55:20.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.860+0000 7fbfaaa00640 1 -- 172.21.15.150:0/2078859895 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fbfa401cba0 con 0x7fbfb40b53e0 2024-09-10T20:55:20.868 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.861+0000 7fbfb3e00640 1 -- 172.21.15.150:0/2078859895 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfb40d4500 con 0x7fbfb40b53e0 2024-09-10T20:55:20.868 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.865+0000 7fbfaaa00640 1 -- 172.21.15.150:0/2078859895 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fbfb41f8cd0 con 0x7fbfb40b53e0 2024-09-10T20:55:20.943 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.939+0000 7fbfb3e00640 1 -- 172.21.15.150:0/2078859895 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd new", "uuid": "763c1cf2-a43d-4c10-815d-eaf4a32afc1d", "id": 2} v 0) -- 0x7fbfb40b2f00 con 0x7fbfb40b53e0 2024-09-10T20:55:20.947 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.944+0000 7fbfaaa00640 1 -- 172.21.15.150:0/2078859895 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "763c1cf2-a43d-4c10-815d-eaf4a32afc1d", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fbfa401c780 con 0x7fbfb40b53e0 2024-09-10T20:55:20.948 INFO:teuthology.orchestra.run.smithi150.stdout:2 2024-09-10T20:55:20.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.945+0000 7fbfb3e00640 1 -- 172.21.15.150:0/2078859895 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfb40b53e0 msgr2=0x7fbfb41f8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:20.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.945+0000 7fbfb3e00640 1 --2- 172.21.15.150:0/2078859895 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfb40b53e0 0x7fbfb41f8790 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbfa400c390 tx=0x7fbfa4001e70 comp rx=0 tx=0).stop 2024-09-10T20:55:20.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.946+0000 7fbfb3e00640 1 -- 172.21.15.150:0/2078859895 shutdown_connections 2024-09-10T20:55:20.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.946+0000 7fbfb3e00640 1 --2- 172.21.15.150:0/2078859895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfb40d0f10 0x7fbfb415d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:20.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.946+0000 7fbfb3e00640 1 --2- 172.21.15.150:0/2078859895 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfb4161610 0x7fbfb40cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:20.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.946+0000 7fbfb3e00640 1 --2- 172.21.15.150:0/2078859895 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfb40b53e0 0x7fbfb41f8790 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:20.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.946+0000 7fbfb3e00640 1 -- 172.21.15.150:0/2078859895 >> 172.21.15.150:0/2078859895 conn(0x7fbfb409d0f0 msgr2=0x7fbfb415eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:20.949 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.946+0000 7fbfb3e00640 1 -- 172.21.15.150:0/2078859895 shutdown_connections 2024-09-10T20:55:20.950 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:20.946+0000 7fbfb3e00640 1 -- 172.21.15.150:0/2078859895 wait complete. 2024-09-10T20:55:20.964 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 877b1cc1-2434-4b32-af66-9c2485eac9e6 3 2024-09-10T20:55:21.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.115+0000 7f27a2a00640 1 -- 172.21.15.150:0/889615746 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f279c0cf380 msgr2=0x7f279c0d2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:21.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.115+0000 7f27a2a00640 1 --2- 172.21.15.150:0/889615746 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f279c0cf380 0x7f279c0d2520 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2788009830 tx=0x7f278802a5c0 comp rx=0 tx=0).stop 2024-09-10T20:55:21.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.115+0000 7f27a2a00640 1 -- 172.21.15.150:0/889615746 shutdown_connections 2024-09-10T20:55:21.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.115+0000 7f27a2a00640 1 --2- 172.21.15.150:0/889615746 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f279c0cf380 0x7f279c0d2520 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:21.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.115+0000 7f27a2a00640 1 -- 172.21.15.150:0/889615746 >> 172.21.15.150:0/889615746 conn(0x7f279c09d0a0 msgr2=0x7f279c0d3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:21.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.115+0000 7f27a2a00640 1 -- 172.21.15.150:0/889615746 shutdown_connections 2024-09-10T20:55:21.119 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.115+0000 7f27a2a00640 1 -- 172.21.15.150:0/889615746 wait complete. 2024-09-10T20:55:21.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.117+0000 7f27a2a00640 1 Processor -- start 2024-09-10T20:55:21.120 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.117+0000 7f27a2a00640 1 -- start start 2024-09-10T20:55:21.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.118+0000 7f27a2a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f279c0cf380 0x7f279c0b6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:21.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.118+0000 7f27a2a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f279c0d2a60 0x7f279c0cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:21.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.118+0000 7f27a2a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f279c15dc90 0x7f279c0cd930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:21.121 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.118+0000 7f27a2a00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f279c0b34d0 con 0x7f279c0d2a60 2024-09-10T20:55:21.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.118+0000 7f27a2a00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f279c0b3350 con 0x7f279c15dc90 2024-09-10T20:55:21.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.118+0000 7f27a2a00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f279c0b3650 con 0x7f279c0cf380 2024-09-10T20:55:21.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.118+0000 7f27a2000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f279c15dc90 0x7f279c0cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:21.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.118+0000 7f27a1600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f279c0cf380 0x7f279c0b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:21.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.118+0000 7f27a2000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f279c15dc90 0x7f279c0cd930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43930/0 (socket says 172.21.15.150:43930) 2024-09-10T20:55:21.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.118+0000 7f27a2000640 1 -- 172.21.15.150:0/4071725005 learned_addr learned my addr 172.21.15.150:0/4071725005 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-10T20:55:21.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.118+0000 7f27a1600640 1 --2- 172.21.15.150:0/4071725005 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f279c0cf380 0x7f279c0b6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.150:60098/0 (socket says 172.21.15.150:60098) 2024-09-10T20:55:21.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.118+0000 7f27a0c00640 1 --2- 172.21.15.150:0/4071725005 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f279c0d2a60 0x7f279c0cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:21.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.119+0000 7f27a1600640 1 -- 172.21.15.150:0/4071725005 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f279c15dc90 msgr2=0x7f279c0cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:21.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.119+0000 7f27a1600640 1 --2- 172.21.15.150:0/4071725005 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f279c15dc90 0x7f279c0cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:21.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.119+0000 7f27a1600640 1 -- 172.21.15.150:0/4071725005 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f279c0d2a60 msgr2=0x7f279c0cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:21.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.119+0000 7f27a1600640 1 --2- 172.21.15.150:0/4071725005 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f279c0d2a60 0x7f279c0cd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:21.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.119+0000 7f27a1600640 1 -- 172.21.15.150:0/4071725005 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f279c0c9a50 con 0x7f279c0cf380 2024-09-10T20:55:21.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.119+0000 7f27a2000640 1 --2- 172.21.15.150:0/4071725005 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f279c15dc90 0x7f279c0cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:55:21.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.119+0000 7f27a1600640 1 --2- 172.21.15.150:0/4071725005 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f279c0cf380 0x7f279c0b6020 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f279000c3c0 tx=0x7f279000c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:21.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.119+0000 7f2799600640 1 -- 172.21.15.150:0/4071725005 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27900052d0 con 0x7f279c0cf380 2024-09-10T20:55:21.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.119+0000 7f2799600640 1 -- 172.21.15.150:0/4071725005 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2790007020 con 0x7f279c0cf380 2024-09-10T20:55:21.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.119+0000 7f2799600640 1 -- 172.21.15.150:0/4071725005 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2790007470 con 0x7f279c0cf380 2024-09-10T20:55:21.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.119+0000 7f27a2a00640 1 -- 172.21.15.150:0/4071725005 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f279c0c9d30 con 0x7f279c0cf380 2024-09-10T20:55:21.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.120+0000 7f27a2a00640 1 -- 172.21.15.150:0/4071725005 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f279c0ca2f0 con 0x7f279c0cf380 2024-09-10T20:55:21.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.120+0000 7f2799600640 1 -- 172.21.15.150:0/4071725005 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f27900067d0 con 0x7f279c0cf380 2024-09-10T20:55:21.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.120+0000 7f2799600640 1 -- 172.21.15.150:0/4071725005 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f2790007610 con 0x7f279c0cf380 2024-09-10T20:55:21.125 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.121+0000 7f27a2a00640 1 -- 172.21.15.150:0/4071725005 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f279c0b3b10 con 0x7f279c0cf380 2024-09-10T20:55:21.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.124+0000 7f2799600640 1 -- 172.21.15.150:0/4071725005 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f2790003610 con 0x7f279c0cf380 2024-09-10T20:55:21.202 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.199+0000 7f27a2a00640 1 -- 172.21.15.150:0/4071725005 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd new", "uuid": "877b1cc1-2434-4b32-af66-9c2485eac9e6", "id": 3} v 0) -- 0x7f279c0b2700 con 0x7f279c0cf380 2024-09-10T20:55:21.207 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.204+0000 7f2799600640 1 -- 172.21.15.150:0/4071725005 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "877b1cc1-2434-4b32-af66-9c2485eac9e6", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f2790003c00 con 0x7f279c0cf380 2024-09-10T20:55:21.207 INFO:teuthology.orchestra.run.smithi150.stdout:3 2024-09-10T20:55:21.209 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.205+0000 7f27a2a00640 1 -- 172.21.15.150:0/4071725005 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f279c0cf380 msgr2=0x7f279c0b6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:21.209 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.205+0000 7f27a2a00640 1 --2- 172.21.15.150:0/4071725005 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f279c0cf380 0x7f279c0b6020 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f279000c3c0 tx=0x7f279000c880 comp rx=0 tx=0).stop 2024-09-10T20:55:21.209 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.205+0000 7f27a2a00640 1 -- 172.21.15.150:0/4071725005 shutdown_connections 2024-09-10T20:55:21.209 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.205+0000 7f27a2a00640 1 --2- 172.21.15.150:0/4071725005 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f279c0d2a60 0x7f279c0cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:21.209 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.205+0000 7f27a2a00640 1 --2- 172.21.15.150:0/4071725005 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f279c15dc90 0x7f279c0cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:21.209 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.205+0000 7f27a2a00640 1 --2- 172.21.15.150:0/4071725005 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f279c0cf380 0x7f279c0b6020 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:21.209 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.205+0000 7f27a2a00640 1 -- 172.21.15.150:0/4071725005 >> 172.21.15.150:0/4071725005 conn(0x7f279c09d0a0 msgr2=0x7f279c0b0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:21.209 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.206+0000 7f27a2a00640 1 -- 172.21.15.150:0/4071725005 shutdown_connections 2024-09-10T20:55:21.209 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.206+0000 7f27a2a00640 1 -- 172.21.15.150:0/4071725005 wait complete. 2024-09-10T20:55:21.223 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new e0b27501-dfdc-4e7f-b73a-9573c869267a 4 2024-09-10T20:55:21.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.374+0000 7fd46b200640 1 -- 172.21.15.150:0/3378162274 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd46c0d0d40 msgr2=0x7fd46c0d1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:21.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.374+0000 7fd46b200640 1 --2- 172.21.15.150:0/3378162274 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd46c0d0d40 0x7fd46c0d1e70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd46c08e090 tx=0x7fd46402a820 comp rx=0 tx=0).stop 2024-09-10T20:55:21.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.374+0000 7fd46b200640 1 -- 172.21.15.150:0/3378162274 shutdown_connections 2024-09-10T20:55:21.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.374+0000 7fd46b200640 1 --2- 172.21.15.150:0/3378162274 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd46c0d0d40 0x7fd46c0d1e70 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:21.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.374+0000 7fd46b200640 1 --2- 172.21.15.150:0/3378162274 >> v2:172.21.15.6:3300/0 conn(0x7fd46c0b53e0 0x7fd46c0d0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:21.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.374+0000 7fd46b200640 1 --2- 172.21.15.150:0/3378162274 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd46c161610 0x7fd46c0d4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:21.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.374+0000 7fd46b200640 1 -- 172.21.15.150:0/3378162274 >> 172.21.15.150:0/3378162274 conn(0x7fd46c09d0f0 msgr2=0x7fd46c0d3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:21.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.375+0000 7fd46b200640 1 -- 172.21.15.150:0/3378162274 shutdown_connections 2024-09-10T20:55:21.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.375+0000 7fd46b200640 1 -- 172.21.15.150:0/3378162274 wait complete. 2024-09-10T20:55:21.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.376+0000 7fd46b200640 1 Processor -- start 2024-09-10T20:55:21.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.376+0000 7fd46b200640 1 -- start start 2024-09-10T20:55:21.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.377+0000 7fd46b200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd46c0b53e0 0x7fd46c0ca080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:21.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.377+0000 7fd46b200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd46c0d0d40 0x7fd46c0b7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:21.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.377+0000 7fd46b200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd46c161610 0x7fd46c1502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:21.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.377+0000 7fd46b200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd46c0d2740 con 0x7fd46c0d0d40 2024-09-10T20:55:21.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.377+0000 7fd46b200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd46c0d25c0 con 0x7fd46c0b53e0 2024-09-10T20:55:21.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.377+0000 7fd46b200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd46c0d28c0 con 0x7fd46c161610 2024-09-10T20:55:21.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.377+0000 7fd469e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd46c0b53e0 0x7fd46c0ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:21.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.377+0000 7fd46a800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd46c161610 0x7fd46c1502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:21.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.377+0000 7fd46a800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd46c161610 0x7fd46c1502e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.150:60122/0 (socket says 172.21.15.150:60122) 2024-09-10T20:55:21.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.377+0000 7fd463e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd46c0d0d40 0x7fd46c0b7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:21.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.377+0000 7fd46a800640 1 -- 172.21.15.150:0/2493695765 learned_addr learned my addr 172.21.15.150:0/2493695765 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-10T20:55:21.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.378+0000 7fd46a800640 1 -- 172.21.15.150:0/2493695765 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd46c0b53e0 msgr2=0x7fd46c0ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:21.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.378+0000 7fd46a800640 1 --2- 172.21.15.150:0/2493695765 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd46c0b53e0 0x7fd46c0ca080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:21.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.378+0000 7fd46a800640 1 -- 172.21.15.150:0/2493695765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd46c0d0d40 msgr2=0x7fd46c0b7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:21.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.378+0000 7fd46a800640 1 --2- 172.21.15.150:0/2493695765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd46c0d0d40 0x7fd46c0b7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:21.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.378+0000 7fd46a800640 1 -- 172.21.15.150:0/2493695765 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd46c0c8460 con 0x7fd46c161610 2024-09-10T20:55:21.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.378+0000 7fd46a800640 1 --2- 172.21.15.150:0/2493695765 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd46c161610 0x7fd46c1502e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd464009b30 tx=0x7fd464032be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:21.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.378+0000 7fd462000640 1 -- 172.21.15.150:0/2493695765 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd464037040 con 0x7fd46c161610 2024-09-10T20:55:21.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.378+0000 7fd462000640 1 -- 172.21.15.150:0/2493695765 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd464042070 con 0x7fd46c161610 2024-09-10T20:55:21.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.378+0000 7fd46b200640 1 -- 172.21.15.150:0/2493695765 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd46c0c8740 con 0x7fd46c161610 2024-09-10T20:55:21.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.379+0000 7fd462000640 1 -- 172.21.15.150:0/2493695765 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd464004040 con 0x7fd46c161610 2024-09-10T20:55:21.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.379+0000 7fd46b200640 1 -- 172.21.15.150:0/2493695765 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd46c0c8d00 con 0x7fd46c161610 2024-09-10T20:55:21.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.379+0000 7fd462000640 1 -- 172.21.15.150:0/2493695765 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fd46403a030 con 0x7fd46c161610 2024-09-10T20:55:21.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.379+0000 7fd462000640 1 -- 172.21.15.150:0/2493695765 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fd464032450 con 0x7fd46c161610 2024-09-10T20:55:21.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.380+0000 7fd46b200640 1 -- 172.21.15.150:0/2493695765 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd46c0d1e70 con 0x7fd46c161610 2024-09-10T20:55:21.385 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.382+0000 7fd462000640 1 -- 172.21.15.150:0/2493695765 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fd4640041e0 con 0x7fd46c161610 2024-09-10T20:55:21.459 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.455+0000 7fd46b200640 1 -- 172.21.15.150:0/2493695765 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e0b27501-dfdc-4e7f-b73a-9573c869267a", "id": 4} v 0) -- 0x7fd46c06ee90 con 0x7fd46c161610 2024-09-10T20:55:21.463 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.460+0000 7fd462000640 1 -- 172.21.15.150:0/2493695765 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e0b27501-dfdc-4e7f-b73a-9573c869267a", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fd4640043c0 con 0x7fd46c161610 2024-09-10T20:55:21.463 INFO:teuthology.orchestra.run.smithi150.stdout:4 2024-09-10T20:55:21.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.461+0000 7fd46b200640 1 -- 172.21.15.150:0/2493695765 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd46c161610 msgr2=0x7fd46c1502e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:21.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.461+0000 7fd46b200640 1 --2- 172.21.15.150:0/2493695765 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd46c161610 0x7fd46c1502e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd464009b30 tx=0x7fd464032be0 comp rx=0 tx=0).stop 2024-09-10T20:55:21.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.461+0000 7fd46b200640 1 -- 172.21.15.150:0/2493695765 shutdown_connections 2024-09-10T20:55:21.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.461+0000 7fd46b200640 1 --2- 172.21.15.150:0/2493695765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd46c0d0d40 0x7fd46c0b7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:21.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.461+0000 7fd46b200640 1 --2- 172.21.15.150:0/2493695765 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd46c161610 0x7fd46c1502e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:21.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.461+0000 7fd46b200640 1 --2- 172.21.15.150:0/2493695765 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd46c0b53e0 0x7fd46c0ca080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:21.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.461+0000 7fd46b200640 1 -- 172.21.15.150:0/2493695765 >> 172.21.15.150:0/2493695765 conn(0x7fd46c09d0f0 msgr2=0x7fd46c0cfea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:21.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.461+0000 7fd46b200640 1 -- 172.21.15.150:0/2493695765 shutdown_connections 2024-09-10T20:55:21.465 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.461+0000 7fd46b200640 1 -- 172.21.15.150:0/2493695765 wait complete. 2024-09-10T20:55:21.478 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 67e48053-4f15-44fd-a30c-c9522f86d169 5 2024-09-10T20:55:21.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.629+0000 7fa4d7e00640 1 -- 172.21.15.150:0/1531911291 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4d815dc90 msgr2=0x7fa4d80d46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:21.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.629+0000 7fa4d7e00640 1 --2- 172.21.15.150:0/1531911291 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4d815dc90 0x7fa4d80d46a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa4d808e5a0 tx=0x7fa4c802a530 comp rx=0 tx=0).stop 2024-09-10T20:55:21.633 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.629+0000 7fa4d7e00640 1 -- 172.21.15.150:0/1531911291 shutdown_connections 2024-09-10T20:55:21.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.629+0000 7fa4d7e00640 1 --2- 172.21.15.150:0/1531911291 >> v2:172.21.15.6:3300/0 conn(0x7fa4d80cf380 0x7fa4d80d2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:21.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.629+0000 7fa4d7e00640 1 --2- 172.21.15.150:0/1531911291 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4d815dc90 0x7fa4d80d46a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:21.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.629+0000 7fa4d7e00640 1 -- 172.21.15.150:0/1531911291 >> 172.21.15.150:0/1531911291 conn(0x7fa4d809d0a0 msgr2=0x7fa4d80d3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:21.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.629+0000 7fa4d7e00640 1 -- 172.21.15.150:0/1531911291 shutdown_connections 2024-09-10T20:55:21.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.629+0000 7fa4d7e00640 1 -- 172.21.15.150:0/1531911291 wait complete. 2024-09-10T20:55:21.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.631+0000 7fa4d7e00640 1 Processor -- start 2024-09-10T20:55:21.634 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.631+0000 7fa4d7e00640 1 -- start start 2024-09-10T20:55:21.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.632+0000 7fa4d7e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4d80cf380 0x7fa4d80b90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:21.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.632+0000 7fa4d7e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4d80d2a60 0x7fa4d80b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:21.635 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.632+0000 7fa4d7e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4d815dc90 0x7fa4d80b7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:21.636 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.632+0000 7fa4d7e00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d815e270 con 0x7fa4d815dc90 2024-09-10T20:55:21.636 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.632+0000 7fa4d7e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d8162250 con 0x7fa4d80cf380 2024-09-10T20:55:21.636 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.632+0000 7fa4d7e00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa4d80b3350 con 0x7fa4d80d2a60 2024-09-10T20:55:21.636 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.632+0000 7fa4d6a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4d80cf380 0x7fa4d80b90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:21.636 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.632+0000 7fa4d6000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4d80d2a60 0x7fa4d80b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:21.636 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.632+0000 7fa4d6000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4d80d2a60 0x7fa4d80b5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.150:60126/0 (socket says 172.21.15.150:60126) 2024-09-10T20:55:21.636 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.632+0000 7fa4d6000640 1 -- 172.21.15.150:0/2005346888 learned_addr learned my addr 172.21.15.150:0/2005346888 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-10T20:55:21.636 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.632+0000 7fa4d7400640 1 --2- 172.21.15.150:0/2005346888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4d815dc90 0x7fa4d80b7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:21.637 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.633+0000 7fa4d6000640 1 -- 172.21.15.150:0/2005346888 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4d80cf380 msgr2=0x7fa4d80b90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:21.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.633+0000 7fa4d6000640 1 --2- 172.21.15.150:0/2005346888 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4d80cf380 0x7fa4d80b90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:21.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.633+0000 7fa4d6000640 1 -- 172.21.15.150:0/2005346888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4d815dc90 msgr2=0x7fa4d80b7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:21.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.633+0000 7fa4d6000640 1 --2- 172.21.15.150:0/2005346888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4d815dc90 0x7fa4d80b7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:21.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.633+0000 7fa4d6000640 1 -- 172.21.15.150:0/2005346888 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d81f8210 con 0x7fa4d80d2a60 2024-09-10T20:55:21.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.633+0000 7fa4d7400640 1 --2- 172.21.15.150:0/2005346888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4d815dc90 0x7fa4d80b7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:55:21.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.633+0000 7fa4d6000640 1 --2- 172.21.15.150:0/2005346888 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4d80d2a60 0x7fa4d80b5ee0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa4c400d770 tx=0x7fa4c400dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:21.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.633+0000 7fa4cea00640 1 -- 172.21.15.150:0/2005346888 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4017070 con 0x7fa4d80d2a60 2024-09-10T20:55:21.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.633+0000 7fa4cea00640 1 -- 172.21.15.150:0/2005346888 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa4c4009d20 con 0x7fa4d80d2a60 2024-09-10T20:55:21.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.633+0000 7fa4d7e00640 1 -- 172.21.15.150:0/2005346888 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4d81f84f0 con 0x7fa4d80d2a60 2024-09-10T20:55:21.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.633+0000 7fa4cea00640 1 -- 172.21.15.150:0/2005346888 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4005280 con 0x7fa4d80d2a60 2024-09-10T20:55:21.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.634+0000 7fa4d7e00640 1 -- 172.21.15.150:0/2005346888 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4d80b56e0 con 0x7fa4d80d2a60 2024-09-10T20:55:21.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.634+0000 7fa4cea00640 1 -- 172.21.15.150:0/2005346888 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fa4c4005420 con 0x7fa4d80d2a60 2024-09-10T20:55:21.638 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.634+0000 7fa4cea00640 1 -- 172.21.15.150:0/2005346888 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fa4c4004d20 con 0x7fa4d80d2a60 2024-09-10T20:55:21.639 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.635+0000 7fa4d7e00640 1 -- 172.21.15.150:0/2005346888 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4d80b9620 con 0x7fa4d80d2a60 2024-09-10T20:55:21.639 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.637+0000 7fa4cea00640 1 -- 172.21.15.150:0/2005346888 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fa4c40047a0 con 0x7fa4d80d2a60 2024-09-10T20:55:21.714 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.711+0000 7fa4d7e00640 1 -- 172.21.15.150:0/2005346888 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd new", "uuid": "67e48053-4f15-44fd-a30c-c9522f86d169", "id": 5} v 0) -- 0x7fa4d80d2520 con 0x7fa4d80d2a60 2024-09-10T20:55:21.718 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.715+0000 7fa4cea00640 1 -- 172.21.15.150:0/2005346888 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "67e48053-4f15-44fd-a30c-c9522f86d169", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fa4c4004980 con 0x7fa4d80d2a60 2024-09-10T20:55:21.718 INFO:teuthology.orchestra.run.smithi150.stdout:5 2024-09-10T20:55:21.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.717+0000 7fa4d7e00640 1 -- 172.21.15.150:0/2005346888 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4d80d2a60 msgr2=0x7fa4d80b5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:21.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.717+0000 7fa4d7e00640 1 --2- 172.21.15.150:0/2005346888 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4d80d2a60 0x7fa4d80b5ee0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa4c400d770 tx=0x7fa4c400dc30 comp rx=0 tx=0).stop 2024-09-10T20:55:21.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.717+0000 7fa4d7e00640 1 -- 172.21.15.150:0/2005346888 shutdown_connections 2024-09-10T20:55:21.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.717+0000 7fa4d7e00640 1 --2- 172.21.15.150:0/2005346888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4d815dc90 0x7fa4d80b7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:21.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.717+0000 7fa4d7e00640 1 --2- 172.21.15.150:0/2005346888 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4d80d2a60 0x7fa4d80b5ee0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:21.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.717+0000 7fa4d7e00640 1 --2- 172.21.15.150:0/2005346888 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4d80cf380 0x7fa4d80b90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:21.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.717+0000 7fa4d7e00640 1 -- 172.21.15.150:0/2005346888 >> 172.21.15.150:0/2005346888 conn(0x7fa4d809d0a0 msgr2=0x7fa4d80b11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:21.720 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.717+0000 7fa4d7e00640 1 -- 172.21.15.150:0/2005346888 shutdown_connections 2024-09-10T20:55:21.721 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.717+0000 7fa4d7e00640 1 -- 172.21.15.150:0/2005346888 wait complete. 2024-09-10T20:55:21.740 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 1456df2e-ae91-45a4-bc3a-a06c753092af 6 2024-09-10T20:55:21.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.891+0000 7f5da1600640 1 -- 172.21.15.150:0/1506349552 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d9c073cd0 msgr2=0x7f5d9c0cf150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:21.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.891+0000 7f5da1600640 1 --2- 172.21.15.150:0/1506349552 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d9c073cd0 0x7f5d9c0cf150 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5d94005fd0 tx=0x7f5d9402a870 comp rx=0 tx=0).stop 2024-09-10T20:55:21.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.891+0000 7f5da1600640 1 -- 172.21.15.150:0/1506349552 shutdown_connections 2024-09-10T20:55:21.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.891+0000 7f5da1600640 1 --2- 172.21.15.150:0/1506349552 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d9c073cd0 0x7f5d9c0cf150 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:21.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.891+0000 7f5da1600640 1 --2- 172.21.15.150:0/1506349552 >> v2:172.21.15.6:3300/0 conn(0x7f5d9c15b9d0 0x7f5d9c160170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:21.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.891+0000 7f5da1600640 1 -- 172.21.15.150:0/1506349552 >> 172.21.15.150:0/1506349552 conn(0x7f5d9c0b27c0 msgr2=0x7f5d9c0b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:21.895 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.891+0000 7f5da1600640 1 -- 172.21.15.150:0/1506349552 shutdown_connections 2024-09-10T20:55:21.896 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.891+0000 7f5da1600640 1 -- 172.21.15.150:0/1506349552 wait complete. 2024-09-10T20:55:21.896 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.893+0000 7f5da1600640 1 Processor -- start 2024-09-10T20:55:21.896 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.893+0000 7f5da1600640 1 -- start start 2024-09-10T20:55:21.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.894+0000 7f5da1600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d9c06faf0 0x7f5d9c1f56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:21.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.894+0000 7f5da1600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d9c073cd0 0x7f5d9c151dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:21.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.894+0000 7f5da1600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d9c15b9d0 0x7f5d9c1552d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:21.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.894+0000 7f5da1600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9c0cfa20 con 0x7f5d9c06faf0 2024-09-10T20:55:21.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.894+0000 7f5da1600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9c0cf8a0 con 0x7f5d9c073cd0 2024-09-10T20:55:21.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.894+0000 7f5da1600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f5d9c0cfba0 con 0x7f5d9c15b9d0 2024-09-10T20:55:21.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.894+0000 7f5d93e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d9c073cd0 0x7f5d9c151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:21.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.894+0000 7f5d93e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d9c073cd0 0x7f5d9c151dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43988/0 (socket says 172.21.15.150:43988) 2024-09-10T20:55:21.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.894+0000 7f5d9aa00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d9c06faf0 0x7f5d9c1f56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:21.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.894+0000 7f5d93e00640 1 -- 172.21.15.150:0/4292453563 learned_addr learned my addr 172.21.15.150:0/4292453563 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-10T20:55:21.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.894+0000 7f5d9b400640 1 --2- 172.21.15.150:0/4292453563 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d9c15b9d0 0x7f5d9c1552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:21.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.895+0000 7f5d93e00640 1 -- 172.21.15.150:0/4292453563 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d9c15b9d0 msgr2=0x7f5d9c1552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:21.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.895+0000 7f5d93e00640 1 --2- 172.21.15.150:0/4292453563 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d9c15b9d0 0x7f5d9c1552d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:21.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.895+0000 7f5d93e00640 1 -- 172.21.15.150:0/4292453563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d9c06faf0 msgr2=0x7f5d9c1f56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:21.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.895+0000 7f5d93e00640 1 --2- 172.21.15.150:0/4292453563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d9c06faf0 0x7f5d9c1f56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:21.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.895+0000 7f5d93e00640 1 -- 172.21.15.150:0/4292453563 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d9c1506d0 con 0x7f5d9c073cd0 2024-09-10T20:55:21.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.895+0000 7f5d9aa00640 1 --2- 172.21.15.150:0/4292453563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d9c06faf0 0x7f5d9c1f56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:55:21.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.895+0000 7f5d93e00640 1 --2- 172.21.15.150:0/4292453563 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d9c073cd0 0x7f5d9c151dc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5d8400c450 tx=0x7f5d8400c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:21.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.895+0000 7f5d92a00640 1 -- 172.21.15.150:0/4292453563 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d84011790 con 0x7f5d9c073cd0 2024-09-10T20:55:21.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.896+0000 7f5d92a00640 1 -- 172.21.15.150:0/4292453563 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d84017070 con 0x7f5d9c073cd0 2024-09-10T20:55:21.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.896+0000 7f5da1600640 1 -- 172.21.15.150:0/4292453563 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d9c152d20 con 0x7f5d9c073cd0 2024-09-10T20:55:21.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.896+0000 7f5d92a00640 1 -- 172.21.15.150:0/4292453563 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d84011c80 con 0x7f5d9c073cd0 2024-09-10T20:55:21.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.896+0000 7f5da1600640 1 -- 172.21.15.150:0/4292453563 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d9c1532e0 con 0x7f5d9c073cd0 2024-09-10T20:55:21.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.896+0000 7f5d92a00640 1 -- 172.21.15.150:0/4292453563 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f5d8401c460 con 0x7f5d9c073cd0 2024-09-10T20:55:21.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.896+0000 7f5d92a00640 1 -- 172.21.15.150:0/4292453563 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f5d8401cd70 con 0x7f5d9c073cd0 2024-09-10T20:55:21.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.897+0000 7f5da1600640 1 -- 172.21.15.150:0/4292453563 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d9c074fa0 con 0x7f5d9c073cd0 2024-09-10T20:55:21.902 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.899+0000 7f5d92a00640 1 -- 172.21.15.150:0/4292453563 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f5d9c074fa0 con 0x7f5d9c073cd0 2024-09-10T20:55:21.976 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.973+0000 7f5da1600640 1 -- 172.21.15.150:0/4292453563 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1456df2e-ae91-45a4-bc3a-a06c753092af", "id": 6} v 0) -- 0x7f5d9c0cf150 con 0x7f5d9c073cd0 2024-09-10T20:55:21.980 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.976+0000 7f5d92a00640 1 -- 172.21.15.150:0/4292453563 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1456df2e-ae91-45a4-bc3a-a06c753092af", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f5d9c1606b0 con 0x7f5d9c073cd0 2024-09-10T20:55:21.980 INFO:teuthology.orchestra.run.smithi150.stdout:6 2024-09-10T20:55:21.981 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.978+0000 7f5da1600640 1 -- 172.21.15.150:0/4292453563 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d9c073cd0 msgr2=0x7f5d9c151dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:21.981 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.978+0000 7f5da1600640 1 --2- 172.21.15.150:0/4292453563 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d9c073cd0 0x7f5d9c151dc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5d8400c450 tx=0x7f5d8400c910 comp rx=0 tx=0).stop 2024-09-10T20:55:21.981 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.978+0000 7f5da1600640 1 -- 172.21.15.150:0/4292453563 shutdown_connections 2024-09-10T20:55:21.981 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.978+0000 7f5da1600640 1 --2- 172.21.15.150:0/4292453563 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d9c15b9d0 0x7f5d9c1552d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:21.981 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.978+0000 7f5da1600640 1 --2- 172.21.15.150:0/4292453563 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d9c073cd0 0x7f5d9c151dc0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:21.981 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.978+0000 7f5da1600640 1 --2- 172.21.15.150:0/4292453563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d9c06faf0 0x7f5d9c1f56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:21.981 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.978+0000 7f5da1600640 1 -- 172.21.15.150:0/4292453563 >> 172.21.15.150:0/4292453563 conn(0x7f5d9c0b27c0 msgr2=0x7f5d9c0d0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:21.982 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.978+0000 7f5da1600640 1 -- 172.21.15.150:0/4292453563 shutdown_connections 2024-09-10T20:55:21.982 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:21.978+0000 7f5da1600640 1 -- 172.21.15.150:0/4292453563 wait complete. 2024-09-10T20:55:21.995 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new a9daafcb-5ecd-43bd-ab0a-dc4b480cfc2a 7 2024-09-10T20:55:22.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.149+0000 7efc3aa00640 1 -- 172.21.15.150:0/1119637052 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc340cf380 msgr2=0x7efc340d2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:22.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.149+0000 7efc3aa00640 1 --2- 172.21.15.150:0/1119637052 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc340cf380 0x7efc340d2520 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7efc20009830 tx=0x7efc2002a530 comp rx=0 tx=0).stop 2024-09-10T20:55:22.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.149+0000 7efc3aa00640 1 -- 172.21.15.150:0/1119637052 shutdown_connections 2024-09-10T20:55:22.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.149+0000 7efc3aa00640 1 --2- 172.21.15.150:0/1119637052 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc340cf380 0x7efc340d2520 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:22.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.149+0000 7efc3aa00640 1 --2- 172.21.15.150:0/1119637052 >> v2:172.21.15.150:3300/0 conn(0x7efc340d2a60 0x7efc34161930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:22.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.149+0000 7efc3aa00640 1 -- 172.21.15.150:0/1119637052 >> 172.21.15.150:0/1119637052 conn(0x7efc3409d0a0 msgr2=0x7efc340d3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:22.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.149+0000 7efc3aa00640 1 -- 172.21.15.150:0/1119637052 shutdown_connections 2024-09-10T20:55:22.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.149+0000 7efc3aa00640 1 -- 172.21.15.150:0/1119637052 wait complete. 2024-09-10T20:55:22.154 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.151+0000 7efc3aa00640 1 Processor -- start 2024-09-10T20:55:22.154 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.151+0000 7efc3aa00640 1 -- start start 2024-09-10T20:55:22.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.152+0000 7efc3aa00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc340cf380 0x7efc341f7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:22.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.152+0000 7efc3aa00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc340d2a60 0x7efc340b6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:22.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.152+0000 7efc3aa00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc3415dc90 0x7efc340b9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:22.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.152+0000 7efc3aa00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7efc34162200 con 0x7efc340d2a60 2024-09-10T20:55:22.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.152+0000 7efc3aa00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7efc34162080 con 0x7efc3415dc90 2024-09-10T20:55:22.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.152+0000 7efc3aa00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7efc340b3350 con 0x7efc340cf380 2024-09-10T20:55:22.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.152+0000 7efc39600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc340cf380 0x7efc341f7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:22.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.152+0000 7efc39600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc340cf380 0x7efc341f7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.150:60150/0 (socket says 172.21.15.150:60150) 2024-09-10T20:55:22.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.152+0000 7efc39600640 1 -- 172.21.15.150:0/4083959492 learned_addr learned my addr 172.21.15.150:0/4083959492 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-10T20:55:22.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.152+0000 7efc3a000640 1 --2- 172.21.15.150:0/4083959492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc3415dc90 0x7efc340b9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:22.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.152+0000 7efc38c00640 1 --2- 172.21.15.150:0/4083959492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc340d2a60 0x7efc340b6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:22.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.153+0000 7efc39600640 1 -- 172.21.15.150:0/4083959492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc3415dc90 msgr2=0x7efc340b9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:22.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.153+0000 7efc39600640 1 --2- 172.21.15.150:0/4083959492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc3415dc90 0x7efc340b9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:22.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.153+0000 7efc39600640 1 -- 172.21.15.150:0/4083959492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc340d2a60 msgr2=0x7efc340b6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:22.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.153+0000 7efc39600640 1 --2- 172.21.15.150:0/4083959492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc340d2a60 0x7efc340b6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:22.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.153+0000 7efc39600640 1 -- 172.21.15.150:0/4083959492 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc341f8400 con 0x7efc340cf380 2024-09-10T20:55:22.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.153+0000 7efc3a000640 1 --2- 172.21.15.150:0/4083959492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc3415dc90 0x7efc340b9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:55:22.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.153+0000 7efc39600640 1 --2- 172.21.15.150:0/4083959492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc340cf380 0x7efc341f7c60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efc2800c3a0 tx=0x7efc2800c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:22.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.153+0000 7efc31600640 1 -- 172.21.15.150:0/4083959492 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc28011790 con 0x7efc340cf380 2024-09-10T20:55:22.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.153+0000 7efc31600640 1 -- 172.21.15.150:0/4083959492 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efc28017070 con 0x7efc340cf380 2024-09-10T20:55:22.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.153+0000 7efc31600640 1 -- 172.21.15.150:0/4083959492 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc28011cc0 con 0x7efc340cf380 2024-09-10T20:55:22.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.153+0000 7efc3aa00640 1 -- 172.21.15.150:0/4083959492 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc341f86e0 con 0x7efc340cf380 2024-09-10T20:55:22.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.153+0000 7efc3aa00640 1 -- 172.21.15.150:0/4083959492 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efc340b8f40 con 0x7efc340cf380 2024-09-10T20:55:22.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.154+0000 7efc31600640 1 -- 172.21.15.150:0/4083959492 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7efc2801c460 con 0x7efc340cf380 2024-09-10T20:55:22.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.154+0000 7efc31600640 1 -- 172.21.15.150:0/4083959492 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7efc28012790 con 0x7efc340cf380 2024-09-10T20:55:22.159 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.155+0000 7efc3aa00640 1 -- 172.21.15.150:0/4083959492 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc34069650 con 0x7efc340cf380 2024-09-10T20:55:22.160 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.157+0000 7efc31600640 1 -- 172.21.15.150:0/4083959492 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7efc34069650 con 0x7efc340cf380 2024-09-10T20:55:22.234 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.231+0000 7efc3aa00640 1 -- 172.21.15.150:0/4083959492 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a9daafcb-5ecd-43bd-ab0a-dc4b480cfc2a", "id": 7} v 0) -- 0x7efc340b8d10 con 0x7efc340cf380 2024-09-10T20:55:22.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.235+0000 7efc31600640 1 -- 172.21.15.150:0/4083959492 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a9daafcb-5ecd-43bd-ab0a-dc4b480cfc2a", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7efc28012ab0 con 0x7efc340cf380 2024-09-10T20:55:22.238 INFO:teuthology.orchestra.run.smithi150.stdout:7 2024-09-10T20:55:22.239 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.236+0000 7efc3aa00640 1 -- 172.21.15.150:0/4083959492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc340cf380 msgr2=0x7efc341f7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:22.239 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.236+0000 7efc3aa00640 1 --2- 172.21.15.150:0/4083959492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc340cf380 0x7efc341f7c60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efc2800c3a0 tx=0x7efc2800c860 comp rx=0 tx=0).stop 2024-09-10T20:55:22.240 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.236+0000 7efc3aa00640 1 -- 172.21.15.150:0/4083959492 shutdown_connections 2024-09-10T20:55:22.240 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.236+0000 7efc3aa00640 1 --2- 172.21.15.150:0/4083959492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc340d2a60 0x7efc340b6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:22.240 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.236+0000 7efc3aa00640 1 --2- 172.21.15.150:0/4083959492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc3415dc90 0x7efc340b9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:22.240 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.236+0000 7efc3aa00640 1 --2- 172.21.15.150:0/4083959492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc340cf380 0x7efc341f7c60 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:22.240 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.236+0000 7efc3aa00640 1 -- 172.21.15.150:0/4083959492 >> 172.21.15.150:0/4083959492 conn(0x7efc3409d0a0 msgr2=0x7efc340b0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:22.240 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.236+0000 7efc3aa00640 1 -- 172.21.15.150:0/4083959492 shutdown_connections 2024-09-10T20:55:22.240 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:55:22.236+0000 7efc3aa00640 1 -- 172.21.15.150:0/4083959492 wait complete. 2024-09-10T20:55:22.254 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-10T20:55:22.254 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-10T20:55:22.259 INFO:tasks.ceph.osd.0:Started 2024-09-10T20:55:22.259 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-10T20:55:22.259 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-10T20:55:22.264 INFO:tasks.ceph.osd.1:Started 2024-09-10T20:55:22.264 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-10T20:55:22.264 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-10T20:55:22.269 INFO:tasks.ceph.osd.2:Started 2024-09-10T20:55:22.269 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-10T20:55:22.269 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-10T20:55:22.274 INFO:tasks.ceph.osd.3:Started 2024-09-10T20:55:22.274 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-10T20:55:22.274 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-10T20:55:22.278 INFO:tasks.ceph.osd.4:Started 2024-09-10T20:55:22.278 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-10T20:55:22.278 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-10T20:55:22.282 INFO:tasks.ceph.osd.5:Started 2024-09-10T20:55:22.282 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-10T20:55:22.282 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-10T20:55:22.286 INFO:tasks.ceph.osd.6:Started 2024-09-10T20:55:22.286 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-10T20:55:22.286 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-10T20:55:22.291 INFO:tasks.ceph.osd.7:Started 2024-09-10T20:55:22.291 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T20:55:22.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.485+0000 7f7ef5a00640 1 -- 172.21.15.6:0/3554733769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ef0070610 msgr2=0x7f7ef00ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:22.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.485+0000 7f7ef5a00640 1 --2- 172.21.15.6:0/3554733769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ef0070610 0x7f7ef00ce840 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7ef00cd4b0 tx=0x7f7edc02b930 comp rx=0 tx=0).stop 2024-09-10T20:55:22.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.485+0000 7f7ef5a00640 1 -- 172.21.15.6:0/3554733769 shutdown_connections 2024-09-10T20:55:22.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.485+0000 7f7ef5a00640 1 --2- 172.21.15.6:0/3554733769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ef0070610 0x7f7ef00ce840 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:22.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.485+0000 7f7ef5a00640 1 --2- 172.21.15.6:0/3554733769 >> v2:172.21.15.150:3300/0 conn(0x7f7ef00aef00 0x7f7ef00d0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:22.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.485+0000 7f7ef5a00640 1 -- 172.21.15.6:0/3554733769 >> 172.21.15.6:0/3554733769 conn(0x7f7ef00cfa20 msgr2=0x7f7ef00cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:22.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.485+0000 7f7ef5a00640 1 -- 172.21.15.6:0/3554733769 shutdown_connections 2024-09-10T20:55:22.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.485+0000 7f7ef5a00640 1 -- 172.21.15.6:0/3554733769 wait complete. 2024-09-10T20:55:22.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.486+0000 7f7ef5a00640 1 Processor -- start 2024-09-10T20:55:22.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.487+0000 7f7ef5a00640 1 -- start start 2024-09-10T20:55:22.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.487+0000 7f7ef5a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ef0070610 0x7f7ef00c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:22.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.487+0000 7f7ef5a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ef0072560 0x7f7ef00af620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:22.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.488+0000 7f7ef5a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ef00aef00 0x7f7ef00afb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:22.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.488+0000 7f7ef5a00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef015de40 con 0x7f7ef0072560 2024-09-10T20:55:22.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.488+0000 7f7ef5a00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef015dcc0 con 0x7f7ef0070610 2024-09-10T20:55:22.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.488+0000 7f7ef5a00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f7ef015dfc0 con 0x7f7ef00aef00 2024-09-10T20:55:22.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.488+0000 7f7eee000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ef0072560 0x7f7ef00af620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:22.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.488+0000 7f7eee000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ef0072560 0x7f7ef00af620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51374/0 (socket says 172.21.15.6:51374) 2024-09-10T20:55:22.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.488+0000 7f7eee000640 1 -- 172.21.15.6:0/2763288755 learned_addr learned my addr 172.21.15.6:0/2763288755 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:22.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.488+0000 7f7eeea00640 1 --2- 172.21.15.6:0/2763288755 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ef0070610 0x7f7ef00c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:22.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.488+0000 7f7eef400640 1 --2- 172.21.15.6:0/2763288755 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ef00aef00 0x7f7ef00afb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:22.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.488+0000 7f7eee000640 1 -- 172.21.15.6:0/2763288755 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ef00aef00 msgr2=0x7f7ef00afb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:22.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.488+0000 7f7eee000640 1 --2- 172.21.15.6:0/2763288755 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ef00aef00 0x7f7ef00afb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:22.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.488+0000 7f7eee000640 1 -- 172.21.15.6:0/2763288755 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ef0070610 msgr2=0x7f7ef00c62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:22.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.488+0000 7f7eee000640 1 --2- 172.21.15.6:0/2763288755 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ef0070610 0x7f7ef00c62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:22.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.488+0000 7f7eee000640 1 -- 172.21.15.6:0/2763288755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ef00c5250 con 0x7f7ef0072560 2024-09-10T20:55:22.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.488+0000 7f7eeea00640 1 --2- 172.21.15.6:0/2763288755 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ef0070610 0x7f7ef00c62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:55:22.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.489+0000 7f7eee000640 1 --2- 172.21.15.6:0/2763288755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ef0072560 0x7f7ef00af620 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7edc000c00 tx=0x7f7edc0042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:22.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.489+0000 7f7ee6a00640 1 -- 172.21.15.6:0/2763288755 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7edc03e070 con 0x7f7ef0072560 2024-09-10T20:55:22.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.489+0000 7f7ee6a00640 1 -- 172.21.15.6:0/2763288755 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7edc004ca0 con 0x7f7ef0072560 2024-09-10T20:55:22.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.489+0000 7f7ee6a00640 1 -- 172.21.15.6:0/2763288755 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7edc031870 con 0x7f7ef0072560 2024-09-10T20:55:22.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.489+0000 7f7ef5a00640 1 -- 172.21.15.6:0/2763288755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ef00c5530 con 0x7f7ef0072560 2024-09-10T20:55:22.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.489+0000 7f7ef5a00640 1 -- 172.21.15.6:0/2763288755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ef00c5af0 con 0x7f7ef0072560 2024-09-10T20:55:22.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.489+0000 7f7ee6a00640 1 -- 172.21.15.6:0/2763288755 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f7edc00b040 con 0x7f7ef0072560 2024-09-10T20:55:22.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.490+0000 7f7ee6a00640 1 -- 172.21.15.6:0/2763288755 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f7edc003df0 con 0x7f7ef0072560 2024-09-10T20:55:22.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.490+0000 7f7ef5a00640 1 -- 172.21.15.6:0/2763288755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ef00d0540 con 0x7f7ef0072560 2024-09-10T20:55:22.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.492+0000 7f7ee6a00640 1 -- 172.21.15.6:0/2763288755 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f7edc031a10 con 0x7f7ef0072560 2024-09-10T20:55:22.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.557+0000 7f7ef5a00640 1 -- 172.21.15.6:0/2763288755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7ef0069d20 con 0x7f7ef0072560 2024-09-10T20:55:22.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.558+0000 7f7ee6a00640 1 -- 172.21.15.6:0/2763288755 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f7edc004e50 con 0x7f7ef0072560 2024-09-10T20:55:22.563 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:55:22.563 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":10,"fsid":"9e04309e-61c3-4c78-82db-9576e465d98a","created":"2024-09-10T20:55:17.972466+0000","modified":"2024-09-10T20:55:22.232252+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T20:55:22.232252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0918c5c8-a028-4987-bad2-406c412ec3f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"415e9c78-c3d9-46d6-b277-348453f42155","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"763c1cf2-a43d-4c10-815d-eaf4a32afc1d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"877b1cc1-2434-4b32-af66-9c2485eac9e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e0b27501-dfdc-4e7f-b73a-9573c869267a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"67e48053-4f15-44fd-a30c-c9522f86d169","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1456df2e-ae91-45a4-bc3a-a06c753092af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a9daafcb-5ecd-43bd-ab0a-dc4b480cfc2a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:55:22.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.559+0000 7f7ef5a00640 1 -- 172.21.15.6:0/2763288755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ef0072560 msgr2=0x7f7ef00af620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:22.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.559+0000 7f7ef5a00640 1 --2- 172.21.15.6:0/2763288755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ef0072560 0x7f7ef00af620 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7edc000c00 tx=0x7f7edc0042c0 comp rx=0 tx=0).stop 2024-09-10T20:55:22.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.559+0000 7f7ef5a00640 1 -- 172.21.15.6:0/2763288755 shutdown_connections 2024-09-10T20:55:22.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.559+0000 7f7ef5a00640 1 --2- 172.21.15.6:0/2763288755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ef0072560 0x7f7ef00af620 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:22.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.559+0000 7f7ef5a00640 1 --2- 172.21.15.6:0/2763288755 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ef00aef00 0x7f7ef00afb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:22.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.559+0000 7f7ef5a00640 1 --2- 172.21.15.6:0/2763288755 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ef0070610 0x7f7ef00c62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:22.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.559+0000 7f7ef5a00640 1 -- 172.21.15.6:0/2763288755 >> 172.21.15.6:0/2763288755 conn(0x7f7ef00cfa20 msgr2=0x7f7ef00cfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:22.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.559+0000 7f7ef5a00640 1 -- 172.21.15.6:0/2763288755 shutdown_connections 2024-09-10T20:55:22.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:22.559+0000 7f7ef5a00640 1 -- 172.21.15.6:0/2763288755 wait complete. 2024-09-10T20:55:22.579 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-10T20:55:22.579 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-10T20:55:23.385 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T20:55:23.527 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.522+0000 7f76f8a00640 1 -- 172.21.15.6:0/3363913117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76f40cf420 msgr2=0x7f76f40cf880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:23.528 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.522+0000 7f76f8a00640 1 --2- 172.21.15.6:0/3363913117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76f40cf420 0x7f76f40cf880 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f76dc005fd0 tx=0x7f76dc02a5d0 comp rx=0 tx=0).stop 2024-09-10T20:55:23.528 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.522+0000 7f76f8a00640 1 -- 172.21.15.6:0/3363913117 shutdown_connections 2024-09-10T20:55:23.528 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.522+0000 7f76f8a00640 1 --2- 172.21.15.6:0/3363913117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76f40cf420 0x7f76f40cf880 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:23.528 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.522+0000 7f76f8a00640 1 --2- 172.21.15.6:0/3363913117 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76f415dc60 0x7f76f4162370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:23.528 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.522+0000 7f76f8a00640 1 -- 172.21.15.6:0/3363913117 >> 172.21.15.6:0/3363913117 conn(0x7f76f409d050 msgr2=0x7f76f40d3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:23.528 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.522+0000 7f76f8a00640 1 -- 172.21.15.6:0/3363913117 shutdown_connections 2024-09-10T20:55:23.528 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.522+0000 7f76f8a00640 1 -- 172.21.15.6:0/3363913117 wait complete. 2024-09-10T20:55:23.528 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.524+0000 7f76f8a00640 1 Processor -- start 2024-09-10T20:55:23.529 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.524+0000 7f76f8a00640 1 -- start start 2024-09-10T20:55:23.530 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.525+0000 7f76f8a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76f40cf420 0x7f76f41f3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:23.530 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.525+0000 7f76f8a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76f40d1970 0x7f76f40b9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:23.530 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.525+0000 7f76f8a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76f415dc60 0x7f76f415b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:23.531 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.525+0000 7f76f8a00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f76f415f1d0 con 0x7f76f40d1970 2024-09-10T20:55:23.531 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.525+0000 7f76f8a00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f76f415f050 con 0x7f76f40cf420 2024-09-10T20:55:23.531 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.525+0000 7f76f8a00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f76f40d0e50 con 0x7f76f415dc60 2024-09-10T20:55:23.531 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.525+0000 7f76ebe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76f40d1970 0x7f76f40b9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:23.531 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.525+0000 7f76f3400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76f40cf420 0x7f76f41f3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:23.531 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.525+0000 7f76ebe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76f40d1970 0x7f76f40b9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51390/0 (socket says 172.21.15.6:51390) 2024-09-10T20:55:23.531 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.525+0000 7f76ebe00640 1 -- 172.21.15.6:0/3258158658 learned_addr learned my addr 172.21.15.6:0/3258158658 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:23.531 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.525+0000 7f76f3e00640 1 --2- 172.21.15.6:0/3258158658 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76f415dc60 0x7f76f415b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:23.531 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.526+0000 7f76ebe00640 1 -- 172.21.15.6:0/3258158658 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76f415dc60 msgr2=0x7f76f415b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:23.531 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.526+0000 7f76ebe00640 1 --2- 172.21.15.6:0/3258158658 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76f415dc60 0x7f76f415b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:23.531 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.526+0000 7f76ebe00640 1 -- 172.21.15.6:0/3258158658 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76f40cf420 msgr2=0x7f76f41f3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:23.531 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.526+0000 7f76ebe00640 1 --2- 172.21.15.6:0/3258158658 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76f40cf420 0x7f76f41f3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:23.531 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.526+0000 7f76ebe00640 1 -- 172.21.15.6:0/3258158658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76f414dce0 con 0x7f76f40d1970 2024-09-10T20:55:23.532 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.526+0000 7f76f3400640 1 --2- 172.21.15.6:0/3258158658 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76f40cf420 0x7f76f41f3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:55:23.532 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.526+0000 7f76ebe00640 1 --2- 172.21.15.6:0/3258158658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76f40d1970 0x7f76f40b9310 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f76dc009850 tx=0x7f76dc0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:23.533 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.526+0000 7f76eb400640 1 -- 172.21.15.6:0/3258158658 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76dc03f070 con 0x7f76f40d1970 2024-09-10T20:55:23.533 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.526+0000 7f76eb400640 1 -- 172.21.15.6:0/3258158658 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f76dc005600 con 0x7f76f40d1970 2024-09-10T20:55:23.533 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.526+0000 7f76f8a00640 1 -- 172.21.15.6:0/3258158658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76f414cf20 con 0x7f76f40d1970 2024-09-10T20:55:23.533 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.526+0000 7f76eb400640 1 -- 172.21.15.6:0/3258158658 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76dc035030 con 0x7f76f40d1970 2024-09-10T20:55:23.533 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.527+0000 7f76f8a00640 1 -- 172.21.15.6:0/3258158658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76f414d4e0 con 0x7f76f40d1970 2024-09-10T20:55:23.533 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.527+0000 7f76f8a00640 1 -- 172.21.15.6:0/3258158658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76f414aa30 con 0x7f76f40d1970 2024-09-10T20:55:23.533 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.528+0000 7f76eb400640 1 -- 172.21.15.6:0/3258158658 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 2) ==== 50324+0+0 (secure 0 0 0) 0x7f76dc0049e0 con 0x7f76f40d1970 2024-09-10T20:55:23.533 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.529+0000 7f76eb400640 1 -- 172.21.15.6:0/3258158658 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f76dc072bc0 con 0x7f76f40d1970 2024-09-10T20:55:23.535 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.531+0000 7f76eb400640 1 -- 172.21.15.6:0/3258158658 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f76f414aa30 con 0x7f76f40d1970 2024-09-10T20:55:23.600 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.595+0000 7f76f8a00640 1 -- 172.21.15.6:0/3258158658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f76f415d520 con 0x7f76f40d1970 2024-09-10T20:55:23.601 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.596+0000 7f76eb400640 1 -- 172.21.15.6:0/3258158658 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f76dc03b460 con 0x7f76f40d1970 2024-09-10T20:55:23.601 INFO:teuthology.misc.health.smithi006.stdout: 2024-09-10T20:55:23.601 INFO:teuthology.misc.health.smithi006.stdout:{"epoch":10,"fsid":"9e04309e-61c3-4c78-82db-9576e465d98a","created":"2024-09-10T20:55:17.972466+0000","modified":"2024-09-10T20:55:22.232252+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T20:55:22.232252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0918c5c8-a028-4987-bad2-406c412ec3f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"415e9c78-c3d9-46d6-b277-348453f42155","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"763c1cf2-a43d-4c10-815d-eaf4a32afc1d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"877b1cc1-2434-4b32-af66-9c2485eac9e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e0b27501-dfdc-4e7f-b73a-9573c869267a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"67e48053-4f15-44fd-a30c-c9522f86d169","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1456df2e-ae91-45a4-bc3a-a06c753092af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a9daafcb-5ecd-43bd-ab0a-dc4b480cfc2a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:55:23.602 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.597+0000 7f76f8a00640 1 -- 172.21.15.6:0/3258158658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76f40d1970 msgr2=0x7f76f40b9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:23.602 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.597+0000 7f76f8a00640 1 --2- 172.21.15.6:0/3258158658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76f40d1970 0x7f76f40b9310 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f76dc009850 tx=0x7f76dc0038a0 comp rx=0 tx=0).stop 2024-09-10T20:55:23.602 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.597+0000 7f76f8a00640 1 -- 172.21.15.6:0/3258158658 shutdown_connections 2024-09-10T20:55:23.602 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.597+0000 7f76f8a00640 1 --2- 172.21.15.6:0/3258158658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76f40d1970 0x7f76f40b9310 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:23.602 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.597+0000 7f76f8a00640 1 --2- 172.21.15.6:0/3258158658 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76f415dc60 0x7f76f415b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:23.602 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.597+0000 7f76f8a00640 1 --2- 172.21.15.6:0/3258158658 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76f40cf420 0x7f76f41f3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:23.602 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.597+0000 7f76f8a00640 1 -- 172.21.15.6:0/3258158658 >> 172.21.15.6:0/3258158658 conn(0x7f76f409d050 msgr2=0x7f76f40d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:23.602 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.597+0000 7f76f8a00640 1 -- 172.21.15.6:0/3258158658 shutdown_connections 2024-09-10T20:55:23.603 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:23.597+0000 7f76f8a00640 1 -- 172.21.15.6:0/3258158658 wait complete. 2024-09-10T20:55:23.614 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-10T20:55:23.813 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-10T20:55:23.808+0000 7f2596a2e640 -1 Falling back to public interface 2024-09-10T20:55:23.815 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-10T20:55:23.811+0000 7f99999a6640 -1 Falling back to public interface 2024-09-10T20:55:23.824 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-10T20:55:23.819+0000 7f8a78815640 -1 Falling back to public interface 2024-09-10T20:55:23.882 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-09-10T20:55:23.878+0000 7f8b4f444640 -1 Falling back to public interface 2024-09-10T20:55:24.076 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-09-10T20:55:24.073+0000 7fe261aae640 -1 Falling back to public interface 2024-09-10T20:55:24.094 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-10T20:55:24.090+0000 7efc034d6640 -1 Falling back to public interface 2024-09-10T20:55:24.115 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-09-10T20:55:24.112+0000 7fa17101e640 -1 Falling back to public interface 2024-09-10T20:55:24.181 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-09-10T20:55:24.177+0000 7f490da00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-10T20:55:24.181 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-09-10T20:55:24.178+0000 7f490da00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-10T20:55:24.404 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-09-10T20:55:24.401+0000 7f97e4411640 -1 Falling back to public interface 2024-09-10T20:55:27.481 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-10T20:55:27.476+0000 7f8a78815640 -1 osd.3 0 log_to_monitors true 2024-09-10T20:55:27.736 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-10T20:55:27.732+0000 7f2596a2e640 -1 osd.0 0 log_to_monitors true 2024-09-10T20:55:27.813 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-10T20:55:27.808+0000 7efc034d6640 -1 osd.2 0 log_to_monitors true 2024-09-10T20:55:28.016 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-10T20:55:28.011+0000 7f99999a6640 -1 osd.1 0 log_to_monitors true 2024-09-10T20:55:28.043 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-09-10T20:55:28.039+0000 7fe261aae640 -1 osd.5 0 log_to_monitors true 2024-09-10T20:55:28.348 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-09-10T20:55:28.344+0000 7f8b4f444640 -1 osd.7 0 log_to_monitors true 2024-09-10T20:55:28.356 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-09-10T20:55:28.352+0000 7fa17101e640 -1 osd.6 0 log_to_monitors true 2024-09-10T20:55:28.621 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-09-10T20:55:28.617+0000 7f97e4411640 -1 osd.4 0 log_to_monitors true 2024-09-10T20:55:29.649 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-10T20:55:29.645+0000 7f8a73200640 -1 osd.3 0 waiting for initial osdmap 2024-09-10T20:55:29.742 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-10T20:55:29.738+0000 7f8a69200640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T20:55:30.422 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T20:55:30.592 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.588+0000 7f26e4c00640 1 -- 172.21.15.6:0/312879002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26e006d560 msgr2=0x7f26e00cdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:30.592 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.588+0000 7f26e4c00640 1 --2- 172.21.15.6:0/312879002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26e006d560 0x7f26e00cdc70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f26d8005fd0 tx=0x7f26d802a8b0 comp rx=0 tx=0).stop 2024-09-10T20:55:30.592 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.588+0000 7f26e4c00640 1 -- 172.21.15.6:0/312879002 shutdown_connections 2024-09-10T20:55:30.592 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.588+0000 7f26e4c00640 1 --2- 172.21.15.6:0/312879002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26e006d560 0x7f26e00cdc70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:30.592 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.588+0000 7f26e4c00640 1 --2- 172.21.15.6:0/312879002 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26e0152a20 0x7f26e0073fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:30.592 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.588+0000 7f26e4c00640 1 -- 172.21.15.6:0/312879002 >> 172.21.15.6:0/312879002 conn(0x7f26e00b1a20 msgr2=0x7f26e00b1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:30.592 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.588+0000 7f26e4c00640 1 -- 172.21.15.6:0/312879002 shutdown_connections 2024-09-10T20:55:30.593 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.588+0000 7f26e4c00640 1 -- 172.21.15.6:0/312879002 wait complete. 2024-09-10T20:55:30.594 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.590+0000 7f26e4c00640 1 Processor -- start 2024-09-10T20:55:30.594 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.590+0000 7f26e4c00640 1 -- start start 2024-09-10T20:55:30.595 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.591+0000 7f26e4c00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26e006d560 0x7f26e01f85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:30.595 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.591+0000 7f26e4c00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26e0152a20 0x7f26e006f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:30.595 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.591+0000 7f26e4c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26e015c740 0x7f26e006f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:30.595 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.591+0000 7f26e4c00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f26e00ce1b0 con 0x7f26e0152a20 2024-09-10T20:55:30.595 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.591+0000 7f26e4c00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f26e015ce30 con 0x7f26e015c740 2024-09-10T20:55:30.595 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.591+0000 7f26e4c00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f26e00ce330 con 0x7f26e006d560 2024-09-10T20:55:30.596 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.592+0000 7f26df400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26e006d560 0x7f26e01f85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:30.596 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.592+0000 7f26df400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26e006d560 0x7f26e01f85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.6:54992/0 (socket says 172.21.15.6:54992) 2024-09-10T20:55:30.596 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.592+0000 7f26df400640 1 -- 172.21.15.6:0/2821412438 learned_addr learned my addr 172.21.15.6:0/2821412438 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:30.596 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.592+0000 7f26df400640 1 -- 172.21.15.6:0/2821412438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26e015c740 msgr2=0x7f26e006f780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T20:55:30.596 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.592+0000 7f26df400640 1 --2- 172.21.15.6:0/2821412438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26e015c740 0x7f26e006f780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:30.597 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.592+0000 7f26df400640 1 -- 172.21.15.6:0/2821412438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26e0152a20 msgr2=0x7f26e006f240 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T20:55:30.597 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.592+0000 7f26df400640 1 --2- 172.21.15.6:0/2821412438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26e0152a20 0x7f26e006f240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:30.597 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.592+0000 7f26df400640 1 -- 172.21.15.6:0/2821412438 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26e014ef80 con 0x7f26e006d560 2024-09-10T20:55:30.597 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.593+0000 7f26df400640 1 --2- 172.21.15.6:0/2821412438 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26e006d560 0x7f26e01f85e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f26d000c920 tx=0x7f26d000cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:30.605 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.601+0000 7f26d7400640 1 -- 172.21.15.6:0/2821412438 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d0007c70 con 0x7f26e006d560 2024-09-10T20:55:30.605 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.601+0000 7f26d7400640 1 -- 172.21.15.6:0/2821412438 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f26d000f450 con 0x7f26e006d560 2024-09-10T20:55:30.605 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.601+0000 7f26d7400640 1 -- 172.21.15.6:0/2821412438 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d000f860 con 0x7f26e006d560 2024-09-10T20:55:30.605 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.601+0000 7f26e4c00640 1 -- 172.21.15.6:0/2821412438 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26e014f260 con 0x7f26e006d560 2024-09-10T20:55:30.605 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.601+0000 7f26e4c00640 1 -- 172.21.15.6:0/2821412438 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f26e014f820 con 0x7f26e006d560 2024-09-10T20:55:30.606 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.602+0000 7f26e4c00640 1 -- 172.21.15.6:0/2821412438 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26e00ce7e0 con 0x7f26e006d560 2024-09-10T20:55:30.609 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.604+0000 7f26d7400640 1 -- 172.21.15.6:0/2821412438 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 4) ==== 100545+0+0 (secure 0 0 0) 0x7f26d0020030 con 0x7f26e006d560 2024-09-10T20:55:30.609 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.605+0000 7f26d7400640 1 --2- 172.21.15.6:0/2821412438 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f26c0077ee0 0x7f26c007a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:30.609 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.605+0000 7f26d7400640 1 -- 172.21.15.6:0/2821412438 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(14..14 src has 1..14) ==== 2511+0+0 (secure 0 0 0) 0x7f26d0099650 con 0x7f26e006d560 2024-09-10T20:55:30.609 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.605+0000 7f26dea00640 1 --2- 172.21.15.6:0/2821412438 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f26c0077ee0 0x7f26c007a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:30.610 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.607+0000 7f26dea00640 1 --2- 172.21.15.6:0/2821412438 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f26c0077ee0 0x7f26c007a3a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f26e014d4c0 tx=0x7f26cc007a10 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:30.618 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.614+0000 7f26d7400640 1 -- 172.21.15.6:0/2821412438 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f26d0014030 con 0x7f26e006d560 2024-09-10T20:55:30.969 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.965+0000 7f26e4c00640 1 -- 172.21.15.6:0/2821412438 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f26e014e580 con 0x7f26e006d560 2024-09-10T20:55:30.970 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.967+0000 7f26d7400640 1 -- 172.21.15.6:0/2821412438 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+7543 (secure 0 0 0) 0x7f26d0062e10 con 0x7f26e006d560 2024-09-10T20:55:30.971 INFO:teuthology.misc.health.smithi006.stdout: 2024-09-10T20:55:30.971 INFO:teuthology.misc.health.smithi006.stdout:{"epoch":14,"fsid":"9e04309e-61c3-4c78-82db-9576e465d98a","created":"2024-09-10T20:55:17.972466+0000","modified":"2024-09-10T20:55:30.538224+0000","last_up_change":"2024-09-10T20:55:30.538224+0000","last_in_change":"2024-09-10T20:55:22.232252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0918c5c8-a028-4987-bad2-406c412ec3f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"415e9c78-c3d9-46d6-b277-348453f42155","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"763c1cf2-a43d-4c10-815d-eaf4a32afc1d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"877b1cc1-2434-4b32-af66-9c2485eac9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6817","nonce":3911674247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6819","nonce":3911674247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6823","nonce":3911674247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6821","nonce":3911674247}]},"public_addr":"172.21.15.6:6817/3911674247","cluster_addr":"172.21.15.6:6819/3911674247","heartbeat_back_addr":"172.21.15.6:6823/3911674247","heartbeat_front_addr":"172.21.15.6:6821/3911674247","state":["exists","up"]},{"osd":4,"uuid":"e0b27501-dfdc-4e7f-b73a-9573c869267a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"67e48053-4f15-44fd-a30c-c9522f86d169","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1456df2e-ae91-45a4-bc3a-a06c753092af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a9daafcb-5ecd-43bd-ab0a-dc4b480cfc2a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:55:30.975 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.970+0000 7f26e4c00640 1 -- 172.21.15.6:0/2821412438 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f26c0077ee0 msgr2=0x7f26c007a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:30.975 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.970+0000 7f26e4c00640 1 --2- 172.21.15.6:0/2821412438 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f26c0077ee0 0x7f26c007a3a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f26e014d4c0 tx=0x7f26cc007a10 comp rx=0 tx=0).stop 2024-09-10T20:55:30.975 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.971+0000 7f26e4c00640 1 -- 172.21.15.6:0/2821412438 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26e006d560 msgr2=0x7f26e01f85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:30.975 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.971+0000 7f26e4c00640 1 --2- 172.21.15.6:0/2821412438 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26e006d560 0x7f26e01f85e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f26d000c920 tx=0x7f26d000cde0 comp rx=0 tx=0).stop 2024-09-10T20:55:30.975 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.971+0000 7f26e4c00640 1 -- 172.21.15.6:0/2821412438 shutdown_connections 2024-09-10T20:55:30.975 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.971+0000 7f26e4c00640 1 --2- 172.21.15.6:0/2821412438 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f26c0077ee0 0x7f26c007a3a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:30.975 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.971+0000 7f26e4c00640 1 --2- 172.21.15.6:0/2821412438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26e0152a20 0x7f26e006f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:30.975 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.971+0000 7f26e4c00640 1 --2- 172.21.15.6:0/2821412438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26e015c740 0x7f26e006f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:30.976 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.971+0000 7f26e4c00640 1 --2- 172.21.15.6:0/2821412438 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26e006d560 0x7f26e01f85e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:30.976 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.971+0000 7f26e4c00640 1 -- 172.21.15.6:0/2821412438 >> 172.21.15.6:0/2821412438 conn(0x7f26e00b1a20 msgr2=0x7f26e0153030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:30.976 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.971+0000 7f26e4c00640 1 -- 172.21.15.6:0/2821412438 shutdown_connections 2024-09-10T20:55:30.976 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:30.971+0000 7f26e4c00640 1 -- 172.21.15.6:0/2821412438 wait complete. 2024-09-10T20:55:30.996 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-10T20:55:31.392 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-10T20:55:31.388+0000 7efbfee00640 -1 osd.2 0 waiting for initial osdmap 2024-09-10T20:55:31.400 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-10T20:55:31.396+0000 7efbf4400640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T20:55:31.401 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-10T20:55:31.398+0000 7f9994800640 -1 osd.1 0 waiting for initial osdmap 2024-09-10T20:55:31.405 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-10T20:55:31.401+0000 7f2590e00640 -1 osd.0 0 waiting for initial osdmap 2024-09-10T20:55:31.407 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-10T20:55:31.403+0000 7f998a800640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T20:55:31.425 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-10T20:55:31.422+0000 7f2586e00640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T20:55:31.435 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-09-10T20:55:31.431+0000 7f8b4a200640 -1 osd.7 0 waiting for initial osdmap 2024-09-10T20:55:31.445 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-09-10T20:55:31.441+0000 7f8b40200640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T20:55:31.484 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-09-10T20:55:31.480+0000 7fa16ba00640 -1 osd.6 0 waiting for initial osdmap 2024-09-10T20:55:31.492 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-09-10T20:55:31.488+0000 7fa161a00640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T20:55:31.547 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-09-10T20:55:31.543+0000 7fe25ca00640 -1 osd.5 0 waiting for initial osdmap 2024-09-10T20:55:31.557 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-09-10T20:55:31.553+0000 7fe252a00640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T20:55:31.930 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-09-10T20:55:31.926+0000 7f97dec00640 -1 osd.4 0 waiting for initial osdmap 2024-09-10T20:55:31.973 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-09-10T20:55:31.931+0000 7f97d4c00640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T20:55:37.802 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T20:55:37.954 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:37.950+0000 7fcd0ce00640 1 -- 172.21.15.6:0/1225196775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd080cdd90 msgr2=0x7fcd08072600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:37.954 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:37.950+0000 7fcd0ce00640 1 --2- 172.21.15.6:0/1225196775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd080cdd90 0x7fcd08072600 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fcd08051530 tx=0x7fcd0002aa30 comp rx=0 tx=0).stop 2024-09-10T20:55:37.954 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:37.950+0000 7fcd0ce00640 1 -- 172.21.15.6:0/1225196775 shutdown_connections 2024-09-10T20:55:37.954 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:37.950+0000 7fcd0ce00640 1 --2- 172.21.15.6:0/1225196775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd080cdd90 0x7fcd08072600 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:37.954 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:37.950+0000 7fcd0ce00640 1 --2- 172.21.15.6:0/1225196775 >> v2:172.21.15.150:3300/0 conn(0x7fcd08158510 0x7fcd0815ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:37.954 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:37.950+0000 7fcd0ce00640 1 -- 172.21.15.6:0/1225196775 >> 172.21.15.6:0/1225196775 conn(0x7fcd080cfab0 msgr2=0x7fcd080cfe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:37.954 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:37.950+0000 7fcd0ce00640 1 -- 172.21.15.6:0/1225196775 shutdown_connections 2024-09-10T20:55:37.954 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:37.950+0000 7fcd0ce00640 1 -- 172.21.15.6:0/1225196775 wait complete. 2024-09-10T20:55:37.955 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:37.952+0000 7fcd0ce00640 1 Processor -- start 2024-09-10T20:55:37.955 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:37.952+0000 7fcd0ce00640 1 -- start start 2024-09-10T20:55:37.957 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:37.952+0000 7fcd0ce00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd080aec70 0x7fcd08149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:37.957 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:37.953+0000 7fcd0ce00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd080cdd90 0x7fcd080b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:37.957 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:37.953+0000 7fcd0ce00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd08158510 0x7fcd080b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:37.957 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:37.953+0000 7fcd0ce00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcd08072b40 con 0x7fcd080aec70 2024-09-10T20:55:37.957 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:37.953+0000 7fcd0ce00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fcd080af0b0 con 0x7fcd080cdd90 2024-09-10T20:55:37.958 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:37.953+0000 7fcd0ce00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fcd08072cc0 con 0x7fcd08158510 2024-09-10T20:55:37.958 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:37.953+0000 7fcd05e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd080aec70 0x7fcd08149dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:37.958 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:37.953+0000 7fcd05e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd080aec70 0x7fcd08149dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52128/0 (socket says 172.21.15.6:52128) 2024-09-10T20:55:37.958 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:37.953+0000 7fcd05e00640 1 -- 172.21.15.6:0/746714693 learned_addr learned my addr 172.21.15.6:0/746714693 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:37.958 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:37.953+0000 7fccfd400640 1 --2- 172.21.15.6:0/746714693 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd080cdd90 0x7fcd080b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:37.958 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:37.953+0000 7fcd06800640 1 --2- 172.21.15.6:0/746714693 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd08158510 0x7fcd080b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:37.958 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:37.953+0000 7fcd05e00640 1 -- 172.21.15.6:0/746714693 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd08158510 msgr2=0x7fcd080b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:37.958 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:37.953+0000 7fcd05e00640 1 --2- 172.21.15.6:0/746714693 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd08158510 0x7fcd080b50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:37.958 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:37.953+0000 7fcd05e00640 1 -- 172.21.15.6:0/746714693 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd080cdd90 msgr2=0x7fcd080b4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:37.958 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:37.953+0000 7fcd05e00640 1 --2- 172.21.15.6:0/746714693 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd080cdd90 0x7fcd080b4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:37.958 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:37.953+0000 7fcd05e00640 1 -- 172.21.15.6:0/746714693 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd08158980 con 0x7fcd080aec70 2024-09-10T20:55:37.958 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:37.954+0000 7fcd05e00640 1 --2- 172.21.15.6:0/746714693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd080aec70 0x7fcd08149dc0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fccf800e790 tx=0x7fccf800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:37.959 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:37.954+0000 7fccfea00640 1 -- 172.21.15.6:0/746714693 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf800eea0 con 0x7fcd080aec70 2024-09-10T20:55:37.959 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:37.954+0000 7fccfea00640 1 -- 172.21.15.6:0/746714693 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fccf800cdb0 con 0x7fcd080aec70 2024-09-10T20:55:37.959 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:37.954+0000 7fccfea00640 1 -- 172.21.15.6:0/746714693 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf8010690 con 0x7fcd080aec70 2024-09-10T20:55:37.960 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:37.954+0000 7fcd0ce00640 1 -- 172.21.15.6:0/746714693 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd08158c60 con 0x7fcd080aec70 2024-09-10T20:55:37.960 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:37.954+0000 7fcd0ce00640 1 -- 172.21.15.6:0/746714693 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd08159220 con 0x7fcd080aec70 2024-09-10T20:55:37.960 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:37.955+0000 7fcd0ce00640 1 -- 172.21.15.6:0/746714693 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd08073170 con 0x7fcd080aec70 2024-09-10T20:55:37.960 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:37.956+0000 7fccfea00640 1 -- 172.21.15.6:0/746714693 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fccf8010830 con 0x7fcd080aec70 2024-09-10T20:55:37.961 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:37.957+0000 7fccfea00640 1 --2- 172.21.15.6:0/746714693 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fcce4077f70 0x7fcce407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:37.961 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:37.957+0000 7fccfea00640 1 -- 172.21.15.6:0/746714693 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fccf809a4e0 con 0x7fcd080aec70 2024-09-10T20:55:37.961 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:37.957+0000 7fccfd400640 1 --2- 172.21.15.6:0/746714693 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fcce4077f70 0x7fcce407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:37.962 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:37.958+0000 7fccfd400640 1 --2- 172.21.15.6:0/746714693 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fcce4077f70 0x7fcce407a430 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcd08162950 tx=0x7fccf0009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:37.966 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:37.962+0000 7fccfea00640 1 -- 172.21.15.6:0/746714693 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fccf8063290 con 0x7fcd080aec70 2024-09-10T20:55:38.162 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:38.158+0000 7fcd0ce00640 1 -- 172.21.15.6:0/746714693 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcd08069880 con 0x7fcd080aec70 2024-09-10T20:55:38.162 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:38.158+0000 7fccfea00640 1 -- 172.21.15.6:0/746714693 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12836 (secure 0 0 0) 0x7fccf8062b90 con 0x7fcd080aec70 2024-09-10T20:55:38.163 INFO:teuthology.misc.health.smithi006.stdout: 2024-09-10T20:55:38.163 INFO:teuthology.misc.health.smithi006.stdout:{"epoch":18,"fsid":"9e04309e-61c3-4c78-82db-9576e465d98a","created":"2024-09-10T20:55:17.972466+0000","modified":"2024-09-10T20:55:35.667967+0000","last_up_change":"2024-09-10T20:55:32.392769+0000","last_in_change":"2024-09-10T20:55:22.232252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:55:33.196464+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0918c5c8-a028-4987-bad2-406c412ec3f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6801","nonce":895515615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6803","nonce":895515615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6807","nonce":895515615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6805","nonce":895515615}]},"public_addr":"172.21.15.6:6801/895515615","cluster_addr":"172.21.15.6:6803/895515615","heartbeat_back_addr":"172.21.15.6:6807/895515615","heartbeat_front_addr":"172.21.15.6:6805/895515615","state":["exists","up"]},{"osd":1,"uuid":"415e9c78-c3d9-46d6-b277-348453f42155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6809","nonce":1129113250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6811","nonce":1129113250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6815","nonce":1129113250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6813","nonce":1129113250}]},"public_addr":"172.21.15.6:6809/1129113250","cluster_addr":"172.21.15.6:6811/1129113250","heartbeat_back_addr":"172.21.15.6:6815/1129113250","heartbeat_front_addr":"172.21.15.6:6813/1129113250","state":["exists","up"]},{"osd":2,"uuid":"763c1cf2-a43d-4c10-815d-eaf4a32afc1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6825","nonce":3847470051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6827","nonce":3847470051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6831","nonce":3847470051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6829","nonce":3847470051}]},"public_addr":"172.21.15.6:6825/3847470051","cluster_addr":"172.21.15.6:6827/3847470051","heartbeat_back_addr":"172.21.15.6:6831/3847470051","heartbeat_front_addr":"172.21.15.6:6829/3847470051","state":["exists","up"]},{"osd":3,"uuid":"877b1cc1-2434-4b32-af66-9c2485eac9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6817","nonce":3911674247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6819","nonce":3911674247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6823","nonce":3911674247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6821","nonce":3911674247}]},"public_addr":"172.21.15.6:6817/3911674247","cluster_addr":"172.21.15.6:6819/3911674247","heartbeat_back_addr":"172.21.15.6:6823/3911674247","heartbeat_front_addr":"172.21.15.6:6821/3911674247","state":["exists","up"]},{"osd":4,"uuid":"e0b27501-dfdc-4e7f-b73a-9573c869267a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6827","nonce":2568527750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6829","nonce":2568527750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6833","nonce":2568527750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6831","nonce":2568527750}]},"public_addr":"172.21.15.150:6827/2568527750","cluster_addr":"172.21.15.150:6829/2568527750","heartbeat_back_addr":"172.21.15.150:6833/2568527750","heartbeat_front_addr":"172.21.15.150:6831/2568527750","state":["exists","up"]},{"osd":5,"uuid":"67e48053-4f15-44fd-a30c-c9522f86d169","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6811","nonce":371417736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6813","nonce":371417736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6817","nonce":371417736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6815","nonce":371417736}]},"public_addr":"172.21.15.150:6811/371417736","cluster_addr":"172.21.15.150:6813/371417736","heartbeat_back_addr":"172.21.15.150:6817/371417736","heartbeat_front_addr":"172.21.15.150:6815/371417736","state":["exists","up"]},{"osd":6,"uuid":"1456df2e-ae91-45a4-bc3a-a06c753092af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6819","nonce":2329248366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6821","nonce":2329248366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6825","nonce":2329248366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6823","nonce":2329248366}]},"public_addr":"172.21.15.150:6819/2329248366","cluster_addr":"172.21.15.150:6821/2329248366","heartbeat_back_addr":"172.21.15.150:6825/2329248366","heartbeat_front_addr":"172.21.15.150:6823/2329248366","state":["exists","up"]},{"osd":7,"uuid":"a9daafcb-5ecd-43bd-ab0a-dc4b480cfc2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6803","nonce":527018351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6805","nonce":527018351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6809","nonce":527018351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6807","nonce":527018351}]},"public_addr":"172.21.15.150:6803/527018351","cluster_addr":"172.21.15.150:6805/527018351","heartbeat_back_addr":"172.21.15.150:6809/527018351","heartbeat_front_addr":"172.21.15.150:6807/527018351","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.710061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.024506+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.824320+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.431608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.637032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.054828+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.333290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.358875+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:55:38.165 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:38.161+0000 7fcd0ce00640 1 -- 172.21.15.6:0/746714693 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fcce4077f70 msgr2=0x7fcce407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:38.165 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:38.161+0000 7fcd0ce00640 1 --2- 172.21.15.6:0/746714693 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fcce4077f70 0x7fcce407a430 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcd08162950 tx=0x7fccf0009040 comp rx=0 tx=0).stop 2024-09-10T20:55:38.165 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:38.161+0000 7fcd0ce00640 1 -- 172.21.15.6:0/746714693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd080aec70 msgr2=0x7fcd08149dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:38.165 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:38.161+0000 7fcd0ce00640 1 --2- 172.21.15.6:0/746714693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd080aec70 0x7fcd08149dc0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fccf800e790 tx=0x7fccf800ec50 comp rx=0 tx=0).stop 2024-09-10T20:55:38.165 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:38.161+0000 7fcd0ce00640 1 -- 172.21.15.6:0/746714693 shutdown_connections 2024-09-10T20:55:38.165 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:38.161+0000 7fcd0ce00640 1 --2- 172.21.15.6:0/746714693 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fcce4077f70 0x7fcce407a430 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:38.165 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:38.161+0000 7fcd0ce00640 1 --2- 172.21.15.6:0/746714693 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd08158510 0x7fcd080b50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:38.166 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:38.161+0000 7fcd0ce00640 1 --2- 172.21.15.6:0/746714693 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd080cdd90 0x7fcd080b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:38.166 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:38.161+0000 7fcd0ce00640 1 --2- 172.21.15.6:0/746714693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd080aec70 0x7fcd08149dc0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:38.166 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:38.161+0000 7fcd0ce00640 1 -- 172.21.15.6:0/746714693 >> 172.21.15.6:0/746714693 conn(0x7fcd080cfab0 msgr2=0x7fcd080b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:38.166 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:38.161+0000 7fcd0ce00640 1 -- 172.21.15.6:0/746714693 shutdown_connections 2024-09-10T20:55:38.166 INFO:teuthology.misc.health.smithi006.stderr:2024-09-10T20:55:38.161+0000 7fcd0ce00640 1 -- 172.21.15.6:0/746714693 wait complete. 2024-09-10T20:55:38.178 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-10T20:55:38.178 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-10T20:55:38.178 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T20:55:38.178 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T20:55:38.182 INFO:tasks.ceph.mds.a:Started 2024-09-10T20:55:38.182 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T20:55:38.182 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T20:55:38.189 INFO:tasks.ceph.mds.c:Started 2024-09-10T20:55:38.189 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T20:55:38.190 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T20:55:38.194 INFO:tasks.ceph.mds.b:Started 2024-09-10T20:55:38.195 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T20:55:38.195 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T20:55:38.199 INFO:tasks.ceph.mds.d:Started 2024-09-10T20:55:38.199 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-10T20:55:38.199 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:55:38.312 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2024-09-10T20:55:38.313 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2024-09-10T20:55:38.333 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2024-09-10T20:55:38.333 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2024-09-10T20:55:38.364 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T20:55:38.369 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T20:55:38.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.364+0000 7f0068400640 1 -- 172.21.15.6:0/2758243733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0048004020 msgr2=0x7f0048004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:38.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.364+0000 7f0068400640 1 --2- 172.21.15.6:0/2758243733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0048004020 0x7f0048004800 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f004c006f90 tx=0x7f0048005830 comp rx=0 tx=0).stop 2024-09-10T20:55:38.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.364+0000 7f0066400640 1 -- 172.21.15.6:0/2758243733 reap_dead start 2024-09-10T20:55:38.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.364+0000 7f0068400640 1 -- 172.21.15.6:0/2758243733 shutdown_connections 2024-09-10T20:55:38.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.364+0000 7f0068400640 1 -- 172.21.15.6:0/2758243733 >> 172.21.15.6:0/2758243733 conn(0x7f006009d2c0 msgr2=0x7f00600d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:38.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.364+0000 7f0068400640 1 -- 172.21.15.6:0/2758243733 shutdown_connections 2024-09-10T20:55:38.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.364+0000 7f0068400640 1 -- 172.21.15.6:0/2758243733 wait complete. 2024-09-10T20:55:38.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.366+0000 7f0068400640 1 Processor -- start 2024-09-10T20:55:38.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.366+0000 7f0068400640 1 -- start start 2024-09-10T20:55:38.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.367+0000 7f0068400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0048004020 0x7f00601f88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:38.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.367+0000 7f0068400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00601f4220 0x7f006015fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:38.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.367+0000 7f0068400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0060160230 0x7f00600b6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:38.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.367+0000 7f0068400640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0060162e30 con 0x7f0060160230 2024-09-10T20:55:38.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.367+0000 7f0068400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0060162cb0 con 0x7f00601f4220 2024-09-10T20:55:38.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.367+0000 7f0068400640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f0060162060 con 0x7f0048004020 2024-09-10T20:55:38.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.367+0000 7f0066400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0060160230 0x7f00600b6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:38.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.367+0000 7f0066400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0060160230 0x7f00600b6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52198/0 (socket says 172.21.15.6:52198) 2024-09-10T20:55:38.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.367+0000 7f0066400640 1 -- 172.21.15.6:0/2645305522 learned_addr learned my addr 172.21.15.6:0/2645305522 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:38.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.368+0000 7f0065000640 1 --2- 172.21.15.6:0/2645305522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00601f4220 0x7f006015fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:38.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.368+0000 7f0065a00640 1 --2- 172.21.15.6:0/2645305522 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0048004020 0x7f00601f88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:38.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.368+0000 7f0066400640 1 -- 172.21.15.6:0/2645305522 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0048004020 msgr2=0x7f00601f88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:38.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.368+0000 7f0066400640 1 --2- 172.21.15.6:0/2645305522 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0048004020 0x7f00601f88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:38.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.368+0000 7f0066400640 1 -- 172.21.15.6:0/2645305522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00601f4220 msgr2=0x7f006015fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:38.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.368+0000 7f0066400640 1 --2- 172.21.15.6:0/2645305522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00601f4220 0x7f006015fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:38.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.368+0000 7f0066400640 1 -- 172.21.15.6:0/2645305522 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00601f8e10 con 0x7f0060160230 2024-09-10T20:55:38.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.368+0000 7f0065000640 1 --2- 172.21.15.6:0/2645305522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00601f4220 0x7f006015fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:55:38.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.368+0000 7f0066400640 1 --2- 172.21.15.6:0/2645305522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0060160230 0x7f00600b6ea0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0058005fd0 tx=0x7f005800f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:38.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.368+0000 7f005d600640 1 -- 172.21.15.6:0/2645305522 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0058004b20 con 0x7f0060160230 2024-09-10T20:55:38.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.368+0000 7f005d600640 1 -- 172.21.15.6:0/2645305522 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0058004cc0 con 0x7f0060160230 2024-09-10T20:55:38.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.368+0000 7f005d600640 1 -- 172.21.15.6:0/2645305522 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0058003bd0 con 0x7f0060160230 2024-09-10T20:55:38.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.368+0000 7f0068400640 1 -- 172.21.15.6:0/2645305522 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00600b90f0 con 0x7f0060160230 2024-09-10T20:55:38.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.369+0000 7f0068400640 1 -- 172.21.15.6:0/2645305522 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f006015e540 con 0x7f0060160230 2024-09-10T20:55:38.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.370+0000 7f0068400640 1 -- 172.21.15.6:0/2645305522 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0060162550 con 0x7f0060160230 2024-09-10T20:55:38.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.372+0000 7f005d600640 1 -- 172.21.15.6:0/2645305522 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f0058018070 con 0x7f0060160230 2024-09-10T20:55:38.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.373+0000 7f005d600640 1 --2- 172.21.15.6:0/2645305522 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f0040077f70 0x7f004007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:38.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.373+0000 7f005d600640 1 -- 172.21.15.6:0/2645305522 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f005809a0d0 con 0x7f0060160230 2024-09-10T20:55:38.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.373+0000 7f0065a00640 1 --2- 172.21.15.6:0/2645305522 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f0040077f70 0x7f004007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:38.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.374+0000 7f0065a00640 1 --2- 172.21.15.6:0/2645305522 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f0040077f70 0x7f004007a430 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0054009ab0 tx=0x7f0054005f90 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:38.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.378+0000 7f005d600640 1 -- 172.21.15.6:0/2645305522 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f00601f8e10 con 0x7f0060160230 2024-09-10T20:55:38.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.610+0000 7f0068400640 1 -- 172.21.15.6:0/2645305522 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f006006e5e0 con 0x7f0060160230 2024-09-10T20:55:38.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.610+0000 7f005d600640 1 -- 172.21.15.6:0/2645305522 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1425 (secure 0 0 0) 0x7f0058062f10 con 0x7f0060160230 2024-09-10T20:55:38.615 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:55:38.615 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":2,"btime":"2024-09-10T20:55:38:317319+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4329,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/77885972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":77885972},{"type":"v1","addr":"172.21.15.6:6834","nonce":77885972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-10T20:55:38.616 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 2 2024-09-10T20:55:38.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.612+0000 7f0068400640 1 -- 172.21.15.6:0/2645305522 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f0040077f70 msgr2=0x7f004007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:38.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.612+0000 7f0068400640 1 --2- 172.21.15.6:0/2645305522 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f0040077f70 0x7f004007a430 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0054009ab0 tx=0x7f0054005f90 comp rx=0 tx=0).stop 2024-09-10T20:55:38.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.612+0000 7f0068400640 1 -- 172.21.15.6:0/2645305522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0060160230 msgr2=0x7f00600b6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:38.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.612+0000 7f0068400640 1 --2- 172.21.15.6:0/2645305522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0060160230 0x7f00600b6ea0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0058005fd0 tx=0x7f005800f3c0 comp rx=0 tx=0).stop 2024-09-10T20:55:38.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.613+0000 7f0068400640 1 -- 172.21.15.6:0/2645305522 shutdown_connections 2024-09-10T20:55:38.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.613+0000 7f0068400640 1 --2- 172.21.15.6:0/2645305522 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f0040077f70 0x7f004007a430 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:38.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.613+0000 7f0068400640 1 --2- 172.21.15.6:0/2645305522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0060160230 0x7f00600b6ea0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:38.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.613+0000 7f0068400640 1 --2- 172.21.15.6:0/2645305522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00601f4220 0x7f006015fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:38.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.613+0000 7f0068400640 1 --2- 172.21.15.6:0/2645305522 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0048004020 0x7f00601f88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:38.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.613+0000 7f0068400640 1 -- 172.21.15.6:0/2645305522 >> 172.21.15.6:0/2645305522 conn(0x7f006009d2c0 msgr2=0x7f00601616c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:38.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.613+0000 7f0068400640 1 -- 172.21.15.6:0/2645305522 shutdown_connections 2024-09-10T20:55:38.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:38.613+0000 7f0068400640 1 -- 172.21.15.6:0/2645305522 wait complete. 2024-09-10T20:55:40.633 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:55:40.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:40.802+0000 7f8a47c00640 1 -- 172.21.15.6:0/275378663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a24005210 msgr2=0x7f8a2400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:40.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:40.802+0000 7f8a47c00640 1 --2- 172.21.15.6:0/275378663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a24005210 0x7f8a2400b9c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8a38001e40 tx=0x7f8a24005830 comp rx=0 tx=0).stop 2024-09-10T20:55:40.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:40.802+0000 7f8a47c00640 1 -- 172.21.15.6:0/275378663 shutdown_connections 2024-09-10T20:55:40.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:40.802+0000 7f8a47c00640 1 --2- 172.21.15.6:0/275378663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a24005210 0x7f8a2400b9c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:40.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:40.802+0000 7f8a47c00640 1 -- 172.21.15.6:0/275378663 >> 172.21.15.6:0/275378663 conn(0x7f8a400cfa20 msgr2=0x7f8a400cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:40.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:40.802+0000 7f8a47c00640 1 -- 172.21.15.6:0/275378663 shutdown_connections 2024-09-10T20:55:40.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:40.802+0000 7f8a47c00640 1 -- 172.21.15.6:0/275378663 wait complete. 2024-09-10T20:55:40.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:40.803+0000 7f8a47c00640 1 Processor -- start 2024-09-10T20:55:40.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:40.804+0000 7f8a47c00640 1 -- start start 2024-09-10T20:55:40.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:40.804+0000 7f8a47c00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a24005210 0x7f8a4014e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:40.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:40.804+0000 7f8a47c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a400ad880 0x7f8a400adce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:40.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:40.804+0000 7f8a47c00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a401f4960 0x7f8a401f4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:40.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:40.804+0000 7f8a47c00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8a40074740 con 0x7f8a401f4960 2024-09-10T20:55:40.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:40.804+0000 7f8a47c00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8a400745c0 con 0x7f8a400ad880 2024-09-10T20:55:40.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:40.804+0000 7f8a47c00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8a4014f590 con 0x7f8a24005210 2024-09-10T20:55:40.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:40.805+0000 7f8a45c00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a401f4960 0x7f8a401f4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:40.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:40.805+0000 7f8a45c00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a401f4960 0x7f8a401f4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52208/0 (socket says 172.21.15.6:52208) 2024-09-10T20:55:40.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:40.805+0000 7f8a45c00640 1 -- 172.21.15.6:0/1296491424 learned_addr learned my addr 172.21.15.6:0/1296491424 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:40.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:40.805+0000 7f8a45200640 1 --2- 172.21.15.6:0/1296491424 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a24005210 0x7f8a4014e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:40.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:40.805+0000 7f8a37e00640 1 --2- 172.21.15.6:0/1296491424 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a400ad880 0x7f8a400adce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:40.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:40.805+0000 7f8a45c00640 1 -- 172.21.15.6:0/1296491424 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a24005210 msgr2=0x7f8a4014e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:40.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:40.805+0000 7f8a45c00640 1 --2- 172.21.15.6:0/1296491424 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a24005210 0x7f8a4014e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:40.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:40.805+0000 7f8a45c00640 1 -- 172.21.15.6:0/1296491424 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a400ad880 msgr2=0x7f8a400adce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:40.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:40.805+0000 7f8a45c00640 1 --2- 172.21.15.6:0/1296491424 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a400ad880 0x7f8a400adce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:40.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:40.805+0000 7f8a45c00640 1 -- 172.21.15.6:0/1296491424 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a4014e7d0 con 0x7f8a401f4960 2024-09-10T20:55:40.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:40.805+0000 7f8a45c00640 1 --2- 172.21.15.6:0/1296491424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a401f4960 0x7f8a401f4de0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8a38001f60 tx=0x7f8a38006280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:40.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:40.806+0000 7f8a3d600640 1 -- 172.21.15.6:0/1296491424 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a38006680 con 0x7f8a401f4960 2024-09-10T20:55:40.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:40.806+0000 7f8a3d600640 1 -- 172.21.15.6:0/1296491424 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a38006820 con 0x7f8a401f4960 2024-09-10T20:55:40.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:40.806+0000 7f8a47c00640 1 -- 172.21.15.6:0/1296491424 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a4014eab0 con 0x7f8a401f4960 2024-09-10T20:55:40.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:40.806+0000 7f8a3d600640 1 -- 172.21.15.6:0/1296491424 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a380336a0 con 0x7f8a401f4960 2024-09-10T20:55:40.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:40.806+0000 7f8a47c00640 1 -- 172.21.15.6:0/1296491424 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a401f5320 con 0x7f8a401f4960 2024-09-10T20:55:40.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:40.807+0000 7f8a47c00640 1 -- 172.21.15.6:0/1296491424 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a400ce3f0 con 0x7f8a401f4960 2024-09-10T20:55:40.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:40.808+0000 7f8a3d600640 1 -- 172.21.15.6:0/1296491424 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8a38033840 con 0x7f8a401f4960 2024-09-10T20:55:40.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:40.809+0000 7f8a3d600640 1 --2- 172.21.15.6:0/1296491424 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f8a1c077f70 0x7f8a1c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:40.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:40.809+0000 7f8a3d600640 1 -- 172.21.15.6:0/1296491424 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f8a380b9930 con 0x7f8a401f4960 2024-09-10T20:55:40.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:40.809+0000 7f8a45200640 1 --2- 172.21.15.6:0/1296491424 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f8a1c077f70 0x7f8a1c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:40.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:40.810+0000 7f8a45200640 1 --2- 172.21.15.6:0/1296491424 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f8a1c077f70 0x7f8a1c07a430 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8a40074d60 tx=0x7f8a30006720 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:40.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:40.813+0000 7f8a3d600640 1 -- 172.21.15.6:0/1296491424 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f8a38082770 con 0x7f8a401f4960 2024-09-10T20:55:41.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.043+0000 7f8a47c00640 1 -- 172.21.15.6:0/1296491424 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8a40069d20 con 0x7f8a401f4960 2024-09-10T20:55:41.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.044+0000 7f8a3d600640 1 -- 172.21.15.6:0/1296491424 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3900 (secure 0 0 0) 0x7f8a38082070 con 0x7f8a401f4960 2024-09-10T20:55:41.048 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:55:41.049 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":3,"btime":"2024-09-10T20:55:39:319604+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4329,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/77885972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":77885972},{"type":"v1","addr":"172.21.15.6:6834","nonce":77885972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4341,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/1181849476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1181849476},{"type":"v1","addr":"172.21.15.150:6836","nonce":1181849476}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4344,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/3860565837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":3860565837},{"type":"v1","addr":"172.21.15.150:6837","nonce":3860565837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4375,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3230367141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3230367141},{"type":"v1","addr":"172.21.15.6:6835","nonce":3230367141}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-10T20:55:41.049 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 3 2024-09-10T20:55:41.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.046+0000 7f8a47c00640 1 -- 172.21.15.6:0/1296491424 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f8a1c077f70 msgr2=0x7f8a1c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:41.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.046+0000 7f8a47c00640 1 --2- 172.21.15.6:0/1296491424 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f8a1c077f70 0x7f8a1c07a430 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8a40074d60 tx=0x7f8a30006720 comp rx=0 tx=0).stop 2024-09-10T20:55:41.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.046+0000 7f8a47c00640 1 -- 172.21.15.6:0/1296491424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a401f4960 msgr2=0x7f8a401f4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:41.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.046+0000 7f8a47c00640 1 --2- 172.21.15.6:0/1296491424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a401f4960 0x7f8a401f4de0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8a38001f60 tx=0x7f8a38006280 comp rx=0 tx=0).stop 2024-09-10T20:55:41.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.046+0000 7f8a47c00640 1 -- 172.21.15.6:0/1296491424 shutdown_connections 2024-09-10T20:55:41.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.046+0000 7f8a47c00640 1 --2- 172.21.15.6:0/1296491424 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f8a1c077f70 0x7f8a1c07a430 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:41.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.046+0000 7f8a47c00640 1 --2- 172.21.15.6:0/1296491424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a401f4960 0x7f8a401f4de0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:41.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.046+0000 7f8a47c00640 1 --2- 172.21.15.6:0/1296491424 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a400ad880 0x7f8a400adce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:41.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.046+0000 7f8a47c00640 1 --2- 172.21.15.6:0/1296491424 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a24005210 0x7f8a4014e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:41.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.046+0000 7f8a47c00640 1 -- 172.21.15.6:0/1296491424 >> 172.21.15.6:0/1296491424 conn(0x7f8a400cfa20 msgr2=0x7f8a4015e880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:41.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.046+0000 7f8a47c00640 1 -- 172.21.15.6:0/1296491424 shutdown_connections 2024-09-10T20:55:41.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.046+0000 7f8a47c00640 1 -- 172.21.15.6:0/1296491424 wait complete. 2024-09-10T20:55:41.067 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T20:55:41.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.222+0000 7f2a3da00640 1 -- 172.21.15.6:0/3669767588 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a3806f090 msgr2=0x7f2a3815eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:41.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.222+0000 7f2a3da00640 1 --2- 172.21.15.6:0/3669767588 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a3806f090 0x7f2a3815eb20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2a28009860 tx=0x7f2a2802a4b0 comp rx=0 tx=0).stop 2024-09-10T20:55:41.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.222+0000 7f2a3da00640 1 -- 172.21.15.6:0/3669767588 shutdown_connections 2024-09-10T20:55:41.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.222+0000 7f2a3da00640 1 --2- 172.21.15.6:0/3669767588 >> v2:172.21.15.150:3300/0 conn(0x7f2a380af060 0x7f2a3815f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:41.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.222+0000 7f2a3da00640 1 --2- 172.21.15.6:0/3669767588 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a3806f090 0x7f2a3815eb20 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:41.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.222+0000 7f2a3da00640 1 -- 172.21.15.6:0/3669767588 >> 172.21.15.6:0/3669767588 conn(0x7f2a380cfa20 msgr2=0x7f2a380cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:41.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.222+0000 7f2a3da00640 1 -- 172.21.15.6:0/3669767588 shutdown_connections 2024-09-10T20:55:41.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.222+0000 7f2a3da00640 1 -- 172.21.15.6:0/3669767588 wait complete. 2024-09-10T20:55:41.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.224+0000 7f2a3da00640 1 Processor -- start 2024-09-10T20:55:41.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.224+0000 7f2a3da00640 1 -- start start 2024-09-10T20:55:41.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.225+0000 7f2a3da00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a3806f090 0x7f2a380b5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:41.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.225+0000 7f2a3da00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a380af060 0x7f2a381e6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:41.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.225+0000 7f2a3da00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a380cdc40 0x7f2a381f7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:41.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.225+0000 7f2a3da00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2a3815f5a0 con 0x7f2a380cdc40 2024-09-10T20:55:41.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.225+0000 7f2a3da00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2a3806f680 con 0x7f2a3806f090 2024-09-10T20:55:41.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.225+0000 7f2a3da00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f2a3815f720 con 0x7f2a380af060 2024-09-10T20:55:41.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.225+0000 7f2a37400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a380cdc40 0x7f2a381f7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:41.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.225+0000 7f2a37400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a380cdc40 0x7f2a381f7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52218/0 (socket says 172.21.15.6:52218) 2024-09-10T20:55:41.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.225+0000 7f2a37400640 1 -- 172.21.15.6:0/955230761 learned_addr learned my addr 172.21.15.6:0/955230761 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:41.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.225+0000 7f2a36a00640 1 --2- 172.21.15.6:0/955230761 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a3806f090 0x7f2a380b5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:41.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.225+0000 7f2a2e000640 1 --2- 172.21.15.6:0/955230761 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a380af060 0x7f2a381e6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:41.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.226+0000 7f2a37400640 1 -- 172.21.15.6:0/955230761 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a380af060 msgr2=0x7f2a381e6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:41.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.226+0000 7f2a37400640 1 --2- 172.21.15.6:0/955230761 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a380af060 0x7f2a381e6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:41.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.226+0000 7f2a37400640 1 -- 172.21.15.6:0/955230761 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a3806f090 msgr2=0x7f2a380b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:41.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.226+0000 7f2a37400640 1 --2- 172.21.15.6:0/955230761 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a3806f090 0x7f2a380b5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:41.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.226+0000 7f2a37400640 1 -- 172.21.15.6:0/955230761 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a381e58a0 con 0x7f2a380cdc40 2024-09-10T20:55:41.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.226+0000 7f2a2e000640 1 --2- 172.21.15.6:0/955230761 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a380af060 0x7f2a381e6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:55:41.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.226+0000 7f2a37400640 1 --2- 172.21.15.6:0/955230761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a380cdc40 0x7f2a381f7ae0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2a3000cae0 tx=0x7f2a3000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:41.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.226+0000 7f2a2f400640 1 -- 172.21.15.6:0/955230761 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a30016020 con 0x7f2a380cdc40 2024-09-10T20:55:41.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.226+0000 7f2a2f400640 1 -- 172.21.15.6:0/955230761 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2a3000ad30 con 0x7f2a380cdc40 2024-09-10T20:55:41.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.226+0000 7f2a2f400640 1 -- 172.21.15.6:0/955230761 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a30012680 con 0x7f2a380cdc40 2024-09-10T20:55:41.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.226+0000 7f2a3da00640 1 -- 172.21.15.6:0/955230761 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a380b5780 con 0x7f2a380cdc40 2024-09-10T20:55:41.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.226+0000 7f2a3da00640 1 -- 172.21.15.6:0/955230761 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a381e5b40 con 0x7f2a380cdc40 2024-09-10T20:55:41.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.227+0000 7f2a3da00640 1 -- 172.21.15.6:0/955230761 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a3815eb20 con 0x7f2a380cdc40 2024-09-10T20:55:41.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.228+0000 7f2a2f400640 1 -- 172.21.15.6:0/955230761 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2a30012820 con 0x7f2a380cdc40 2024-09-10T20:55:41.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.229+0000 7f2a2f400640 1 --2- 172.21.15.6:0/955230761 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2a14077f70 0x7f2a1407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:41.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.230+0000 7f2a2f400640 1 -- 172.21.15.6:0/955230761 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f2a3009a090 con 0x7f2a380cdc40 2024-09-10T20:55:41.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.230+0000 7f2a36a00640 1 --2- 172.21.15.6:0/955230761 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2a14077f70 0x7f2a1407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:41.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.231+0000 7f2a36a00640 1 --2- 172.21.15.6:0/955230761 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2a14077f70 0x7f2a1407a430 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2a28034000 tx=0x7f2a28004730 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:41.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.234+0000 7f2a2f400640 1 -- 172.21.15.6:0/955230761 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2a30020030 con 0x7f2a380cdc40 2024-09-10T20:55:41.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.434+0000 7f2a3da00640 1 -- 172.21.15.6:0/955230761 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f2a381e5d10 con 0x7f2a380cdc40 2024-09-10T20:55:41.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.435+0000 7f2a2f400640 1 -- 172.21.15.6:0/955230761 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) ==== 84+0+65 (secure 0 0 0) 0x7f2a30062e40 con 0x7f2a380cdc40 2024-09-10T20:55:41.439 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:55:41.439 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2024-09-10T20:55:41.439 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-10T20:55:41.439 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2024-09-10T20:55:41.440 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2024-09-10T20:55:41.440 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-10T20:55:41.440 INFO:teuthology.orchestra.run.smithi006.stdout:] 2024-09-10T20:55:41.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.437+0000 7f2a3da00640 1 -- 172.21.15.6:0/955230761 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2a14077f70 msgr2=0x7f2a1407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:41.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.437+0000 7f2a3da00640 1 --2- 172.21.15.6:0/955230761 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2a14077f70 0x7f2a1407a430 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2a28034000 tx=0x7f2a28004730 comp rx=0 tx=0).stop 2024-09-10T20:55:41.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.437+0000 7f2a3da00640 1 -- 172.21.15.6:0/955230761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a380cdc40 msgr2=0x7f2a381f7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:41.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.437+0000 7f2a3da00640 1 --2- 172.21.15.6:0/955230761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a380cdc40 0x7f2a381f7ae0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2a3000cae0 tx=0x7f2a3000a060 comp rx=0 tx=0).stop 2024-09-10T20:55:41.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.437+0000 7f2a3da00640 1 -- 172.21.15.6:0/955230761 shutdown_connections 2024-09-10T20:55:41.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.437+0000 7f2a3da00640 1 --2- 172.21.15.6:0/955230761 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2a14077f70 0x7f2a1407a430 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:41.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.437+0000 7f2a3da00640 1 --2- 172.21.15.6:0/955230761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a380cdc40 0x7f2a381f7ae0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:41.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.437+0000 7f2a3da00640 1 --2- 172.21.15.6:0/955230761 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a380af060 0x7f2a381e6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:41.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.437+0000 7f2a3da00640 1 --2- 172.21.15.6:0/955230761 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a3806f090 0x7f2a380b5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:41.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.437+0000 7f2a3da00640 1 -- 172.21.15.6:0/955230761 >> 172.21.15.6:0/955230761 conn(0x7f2a380cfa20 msgr2=0x7f2a38155030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:41.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.437+0000 7f2a3da00640 1 -- 172.21.15.6:0/955230761 shutdown_connections 2024-09-10T20:55:41.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.437+0000 7f2a3da00640 1 -- 172.21.15.6:0/955230761 wait complete. 2024-09-10T20:55:41.456 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T20:55:41.457 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T20:55:41.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.617+0000 7f94abe00640 1 -- 172.21.15.6:0/161468618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94ac155060 msgr2=0x7f94ac0cf6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:41.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.617+0000 7f94abe00640 1 --2- 172.21.15.6:0/161468618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94ac155060 0x7f94ac0cf6f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f94ac073460 tx=0x7f949802a580 comp rx=0 tx=0).stop 2024-09-10T20:55:41.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.617+0000 7f94abe00640 1 -- 172.21.15.6:0/161468618 shutdown_connections 2024-09-10T20:55:41.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.617+0000 7f94abe00640 1 --2- 172.21.15.6:0/161468618 >> v2:172.21.15.150:3300/0 conn(0x7f94ac0cfc30 0x7f94ac15aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:41.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.617+0000 7f94abe00640 1 --2- 172.21.15.6:0/161468618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94ac155060 0x7f94ac0cf6f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:41.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.617+0000 7f94abe00640 1 -- 172.21.15.6:0/161468618 >> 172.21.15.6:0/161468618 conn(0x7f94ac06cb70 msgr2=0x7f94ac06cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:41.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.617+0000 7f94abe00640 1 -- 172.21.15.6:0/161468618 shutdown_connections 2024-09-10T20:55:41.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.617+0000 7f94abe00640 1 -- 172.21.15.6:0/161468618 wait complete. 2024-09-10T20:55:41.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.619+0000 7f94abe00640 1 Processor -- start 2024-09-10T20:55:41.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.619+0000 7f94abe00640 1 -- start start 2024-09-10T20:55:41.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.620+0000 7f94abe00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94ac0cfc30 0x7f94ac14ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:41.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.620+0000 7f94abe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94ac154c80 0x7f94ac0cc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:41.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.620+0000 7f94abe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94ac155060 0x7f94ac0cc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:41.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.620+0000 7f94abe00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f94ac06e510 con 0x7f94ac155060 2024-09-10T20:55:41.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.620+0000 7f94abe00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f94ac06e390 con 0x7f94ac154c80 2024-09-10T20:55:41.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.620+0000 7f94abe00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f94ac06e690 con 0x7f94ac0cfc30 2024-09-10T20:55:41.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.620+0000 7f94ab400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94ac155060 0x7f94ac0cc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:41.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.620+0000 7f94ab400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94ac155060 0x7f94ac0cc7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52236/0 (socket says 172.21.15.6:52236) 2024-09-10T20:55:41.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.620+0000 7f94ab400640 1 -- 172.21.15.6:0/2947789428 learned_addr learned my addr 172.21.15.6:0/2947789428 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:41.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.620+0000 7f94aaa00640 1 --2- 172.21.15.6:0/2947789428 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94ac0cfc30 0x7f94ac14ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:41.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.620+0000 7f94aa000640 1 --2- 172.21.15.6:0/2947789428 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94ac154c80 0x7f94ac0cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:41.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.620+0000 7f94ab400640 1 -- 172.21.15.6:0/2947789428 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94ac0cfc30 msgr2=0x7f94ac14ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:41.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.620+0000 7f94ab400640 1 --2- 172.21.15.6:0/2947789428 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94ac0cfc30 0x7f94ac14ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:41.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.620+0000 7f94ab400640 1 -- 172.21.15.6:0/2947789428 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94ac154c80 msgr2=0x7f94ac0cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:41.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.620+0000 7f94ab400640 1 --2- 172.21.15.6:0/2947789428 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94ac154c80 0x7f94ac0cc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:41.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.620+0000 7f94ab400640 1 -- 172.21.15.6:0/2947789428 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94ac156400 con 0x7f94ac155060 2024-09-10T20:55:41.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.621+0000 7f94ab400640 1 --2- 172.21.15.6:0/2947789428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94ac155060 0x7f94ac0cc7b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f94a400e960 tx=0x7f94a400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:41.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.621+0000 7f94a2a00640 1 -- 172.21.15.6:0/2947789428 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a4004d20 con 0x7f94ac155060 2024-09-10T20:55:41.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.621+0000 7f94a2a00640 1 -- 172.21.15.6:0/2947789428 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f94a400cb20 con 0x7f94ac155060 2024-09-10T20:55:41.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.621+0000 7f94a2a00640 1 -- 172.21.15.6:0/2947789428 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a4005020 con 0x7f94ac155060 2024-09-10T20:55:41.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.621+0000 7f94abe00640 1 -- 172.21.15.6:0/2947789428 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94ac0b1120 con 0x7f94ac155060 2024-09-10T20:55:41.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.621+0000 7f94abe00640 1 -- 172.21.15.6:0/2947789428 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94ac1f83d0 con 0x7f94ac155060 2024-09-10T20:55:41.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.622+0000 7f94abe00640 1 -- 172.21.15.6:0/2947789428 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94ac1f7ee0 con 0x7f94ac155060 2024-09-10T20:55:41.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.623+0000 7f94a2a00640 1 -- 172.21.15.6:0/2947789428 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f94a400f040 con 0x7f94ac155060 2024-09-10T20:55:41.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.624+0000 7f94a2a00640 1 --2- 172.21.15.6:0/2947789428 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f948c077f70 0x7f948c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:41.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.624+0000 7f94a2a00640 1 -- 172.21.15.6:0/2947789428 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f94a4099f60 con 0x7f94ac155060 2024-09-10T20:55:41.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.625+0000 7f94aaa00640 1 --2- 172.21.15.6:0/2947789428 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f948c077f70 0x7f948c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:41.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.625+0000 7f94aaa00640 1 --2- 172.21.15.6:0/2947789428 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f948c077f70 0x7f948c07a430 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f949c0017c0 tx=0x7f949c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:41.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.628+0000 7f94a2a00640 1 -- 172.21.15.6:0/2947789428 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f94a4016030 con 0x7f94ac155060 2024-09-10T20:55:41.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:41.824+0000 7f94abe00640 1 -- 172.21.15.6:0/2947789428 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f94ac06ebb0 con 0x7f94ac155060 2024-09-10T20:55:42.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.334+0000 7f94a2a00640 1 -- 172.21.15.6:0/2947789428 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) ==== 138+0+0 (secure 0 0 0) 0x7f94a4062750 con 0x7f94ac155060 2024-09-10T20:55:42.339 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2024-09-10T20:55:42.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.338+0000 7f94abe00640 1 -- 172.21.15.6:0/2947789428 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f948c077f70 msgr2=0x7f948c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:42.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.339+0000 7f94abe00640 1 --2- 172.21.15.6:0/2947789428 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f948c077f70 0x7f948c07a430 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f949c0017c0 tx=0x7f949c009040 comp rx=0 tx=0).stop 2024-09-10T20:55:42.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.339+0000 7f94abe00640 1 -- 172.21.15.6:0/2947789428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94ac155060 msgr2=0x7f94ac0cc7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:42.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.339+0000 7f94abe00640 1 --2- 172.21.15.6:0/2947789428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94ac155060 0x7f94ac0cc7b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f94a400e960 tx=0x7f94a400ee20 comp rx=0 tx=0).stop 2024-09-10T20:55:42.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.339+0000 7f94abe00640 1 -- 172.21.15.6:0/2947789428 shutdown_connections 2024-09-10T20:55:42.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.339+0000 7f94abe00640 1 --2- 172.21.15.6:0/2947789428 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f948c077f70 0x7f948c07a430 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:42.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.339+0000 7f94abe00640 1 --2- 172.21.15.6:0/2947789428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94ac155060 0x7f94ac0cc7b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:42.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.339+0000 7f94abe00640 1 --2- 172.21.15.6:0/2947789428 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94ac154c80 0x7f94ac0cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:42.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.339+0000 7f94abe00640 1 --2- 172.21.15.6:0/2947789428 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94ac0cfc30 0x7f94ac14ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:42.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.339+0000 7f94abe00640 1 -- 172.21.15.6:0/2947789428 >> 172.21.15.6:0/2947789428 conn(0x7f94ac06cb70 msgr2=0x7f94ac15bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:42.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.339+0000 7f94abe00640 1 -- 172.21.15.6:0/2947789428 shutdown_connections 2024-09-10T20:55:42.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.339+0000 7f94abe00640 1 -- 172.21.15.6:0/2947789428 wait complete. 2024-09-10T20:55:42.364 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T20:55:42.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.530+0000 7f4bd1a00640 1 -- 172.21.15.6:0/3288948313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bcc0af060 msgr2=0x7f4bcc15f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:42.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.530+0000 7f4bd1a00640 1 --2- 172.21.15.6:0/3288948313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bcc0af060 0x7f4bcc15f060 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc074e80 tx=0x7f4bb802a4d0 comp rx=0 tx=0).stop 2024-09-10T20:55:42.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.530+0000 7f4bd1a00640 1 -- 172.21.15.6:0/3288948313 shutdown_connections 2024-09-10T20:55:42.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.530+0000 7f4bd1a00640 1 --2- 172.21.15.6:0/3288948313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bcc0af060 0x7f4bcc15f060 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:42.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.530+0000 7f4bd1a00640 1 --2- 172.21.15.6:0/3288948313 >> v2:172.21.15.150:3300/0 conn(0x7f4bcc06f090 0x7f4bcc15eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:42.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.530+0000 7f4bd1a00640 1 -- 172.21.15.6:0/3288948313 >> 172.21.15.6:0/3288948313 conn(0x7f4bcc0cfa20 msgr2=0x7f4bcc0cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:42.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.530+0000 7f4bd1a00640 1 -- 172.21.15.6:0/3288948313 shutdown_connections 2024-09-10T20:55:42.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.530+0000 7f4bd1a00640 1 -- 172.21.15.6:0/3288948313 wait complete. 2024-09-10T20:55:42.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.531+0000 7f4bd1a00640 1 Processor -- start 2024-09-10T20:55:42.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.532+0000 7f4bd1a00640 1 -- start start 2024-09-10T20:55:42.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.532+0000 7f4bd1a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bcc06f090 0x7f4bcc1f89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:42.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.532+0000 7f4bd1a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bcc0af060 0x7f4bcc0b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:42.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.532+0000 7f4bd1a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4bcc0cdc40 0x7f4bcc0b4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:42.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.532+0000 7f4bd1a00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4bcc15f5a0 con 0x7f4bcc06f090 2024-09-10T20:55:42.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.532+0000 7f4bd1a00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4bcc06f680 con 0x7f4bcc0af060 2024-09-10T20:55:42.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.532+0000 7f4bd1a00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f4bcc15f720 con 0x7f4bcc0cdc40 2024-09-10T20:55:42.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.533+0000 7f4bcaa00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bcc06f090 0x7f4bcc1f89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:42.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.533+0000 7f4bcaa00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bcc06f090 0x7f4bcc1f89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52250/0 (socket says 172.21.15.6:52250) 2024-09-10T20:55:42.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.533+0000 7f4bcaa00640 1 -- 172.21.15.6:0/415632701 learned_addr learned my addr 172.21.15.6:0/415632701 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:42.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.533+0000 7f4bcb400640 1 --2- 172.21.15.6:0/415632701 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4bcc0cdc40 0x7f4bcc0b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:42.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.533+0000 7f4bca000640 1 --2- 172.21.15.6:0/415632701 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bcc0af060 0x7f4bcc0b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:42.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.533+0000 7f4bcaa00640 1 -- 172.21.15.6:0/415632701 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4bcc0cdc40 msgr2=0x7f4bcc0b4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:42.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.533+0000 7f4bcaa00640 1 --2- 172.21.15.6:0/415632701 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4bcc0cdc40 0x7f4bcc0b4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:42.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.533+0000 7f4bcaa00640 1 -- 172.21.15.6:0/415632701 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bcc0af060 msgr2=0x7f4bcc0b28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:42.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.533+0000 7f4bcaa00640 1 --2- 172.21.15.6:0/415632701 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bcc0af060 0x7f4bcc0b28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:42.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.533+0000 7f4bcaa00640 1 -- 172.21.15.6:0/415632701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bcc0c6410 con 0x7f4bcc06f090 2024-09-10T20:55:42.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.534+0000 7f4bcaa00640 1 --2- 172.21.15.6:0/415632701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bcc06f090 0x7f4bcc1f89f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc00d950 tx=0x7f4bbc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:42.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.534+0000 7f4bc2a00640 1 -- 172.21.15.6:0/415632701 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc017070 con 0x7f4bcc06f090 2024-09-10T20:55:42.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.534+0000 7f4bc2a00640 1 -- 172.21.15.6:0/415632701 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4bbc009cc0 con 0x7f4bcc06f090 2024-09-10T20:55:42.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.534+0000 7f4bd1a00640 1 -- 172.21.15.6:0/415632701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bcc0c3550 con 0x7f4bcc06f090 2024-09-10T20:55:42.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.534+0000 7f4bc2a00640 1 -- 172.21.15.6:0/415632701 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc0106c0 con 0x7f4bcc06f090 2024-09-10T20:55:42.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.534+0000 7f4bd1a00640 1 -- 172.21.15.6:0/415632701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bcc0c3b10 con 0x7f4bcc06f090 2024-09-10T20:55:42.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.535+0000 7f4bd1a00640 1 -- 172.21.15.6:0/415632701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bcc15eb20 con 0x7f4bcc06f090 2024-09-10T20:55:42.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.537+0000 7f4bc2a00640 1 -- 172.21.15.6:0/415632701 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4bbc010860 con 0x7f4bcc06f090 2024-09-10T20:55:42.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.537+0000 7f4bc2a00640 1 --2- 172.21.15.6:0/415632701 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4bac077f70 0x7f4bac07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:42.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.538+0000 7f4bc2a00640 1 -- 172.21.15.6:0/415632701 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5227+0+0 (secure 0 0 0) 0x7f4bbc09a290 con 0x7f4bcc06f090 2024-09-10T20:55:42.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.538+0000 7f4bca000640 1 --2- 172.21.15.6:0/415632701 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4bac077f70 0x7f4bac07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:42.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.539+0000 7f4bca000640 1 --2- 172.21.15.6:0/415632701 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4bac077f70 0x7f4bac07a430 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8033000 tx=0x7f4bb8004730 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:42.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.541+0000 7f4bc2a00640 1 -- 172.21.15.6:0/415632701 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4bbc062990 con 0x7f4bcc06f090 2024-09-10T20:55:42.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:42.739+0000 7f4bd1a00640 1 -- 172.21.15.6:0/415632701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f4bcc069d50 con 0x7f4bcc06f090 2024-09-10T20:55:43.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.341+0000 7f4bc2a00640 1 -- 172.21.15.6:0/415632701 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) ==== 170+0+0 (secure 0 0 0) 0x7f4bbc0673c0 con 0x7f4bcc06f090 2024-09-10T20:55:43.345 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2024-09-10T20:55:43.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.344+0000 7f4bd1a00640 1 -- 172.21.15.6:0/415632701 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4bac077f70 msgr2=0x7f4bac07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:43.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.344+0000 7f4bd1a00640 1 --2- 172.21.15.6:0/415632701 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4bac077f70 0x7f4bac07a430 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8033000 tx=0x7f4bb8004730 comp rx=0 tx=0).stop 2024-09-10T20:55:43.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.344+0000 7f4bd1a00640 1 -- 172.21.15.6:0/415632701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bcc06f090 msgr2=0x7f4bcc1f89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:43.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.344+0000 7f4bd1a00640 1 --2- 172.21.15.6:0/415632701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bcc06f090 0x7f4bcc1f89f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc00d950 tx=0x7f4bbc00de10 comp rx=0 tx=0).stop 2024-09-10T20:55:43.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.344+0000 7f4bd1a00640 1 -- 172.21.15.6:0/415632701 shutdown_connections 2024-09-10T20:55:43.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.344+0000 7f4bd1a00640 1 --2- 172.21.15.6:0/415632701 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4bac077f70 0x7f4bac07a430 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:43.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.344+0000 7f4bd1a00640 1 --2- 172.21.15.6:0/415632701 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4bcc0cdc40 0x7f4bcc0b4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:43.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.344+0000 7f4bd1a00640 1 --2- 172.21.15.6:0/415632701 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bcc0af060 0x7f4bcc0b28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:43.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.344+0000 7f4bd1a00640 1 --2- 172.21.15.6:0/415632701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bcc06f090 0x7f4bcc1f89f0 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc00d950 tx=0x7f4bbc00de10 comp rx=0 tx=0).stop 2024-09-10T20:55:43.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.344+0000 7f4bd1a00640 1 -- 172.21.15.6:0/415632701 >> 172.21.15.6:0/415632701 conn(0x7f4bcc0cfa20 msgr2=0x7f4bcc0adff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:43.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.344+0000 7f4bd1a00640 1 -- 172.21.15.6:0/415632701 shutdown_connections 2024-09-10T20:55:43.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.345+0000 7f4bd1a00640 1 -- 172.21.15.6:0/415632701 wait complete. 2024-09-10T20:55:43.380 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T20:55:43.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.541+0000 7f3db1600640 1 -- 172.21.15.6:0/2184734500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dac0ce510 msgr2=0x7f3dac072400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:43.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.541+0000 7f3db1600640 1 --2- 172.21.15.6:0/2184734500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dac0ce510 0x7f3dac072400 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3d980098e0 tx=0x7f3d9802a540 comp rx=0 tx=0).stop 2024-09-10T20:55:43.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.541+0000 7f3db1600640 1 -- 172.21.15.6:0/2184734500 shutdown_connections 2024-09-10T20:55:43.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.541+0000 7f3db1600640 1 --2- 172.21.15.6:0/2184734500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dac0ce510 0x7f3dac072400 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:43.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.541+0000 7f3db1600640 1 -- 172.21.15.6:0/2184734500 >> 172.21.15.6:0/2184734500 conn(0x7f3dac06d660 msgr2=0x7f3dac0b1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:43.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.541+0000 7f3db1600640 1 -- 172.21.15.6:0/2184734500 shutdown_connections 2024-09-10T20:55:43.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.541+0000 7f3db1600640 1 -- 172.21.15.6:0/2184734500 wait complete. 2024-09-10T20:55:43.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.543+0000 7f3db1600640 1 Processor -- start 2024-09-10T20:55:43.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.543+0000 7f3db1600640 1 -- start start 2024-09-10T20:55:43.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.544+0000 7f3db1600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3dac0ce510 0x7f3dac159790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:43.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.544+0000 7f3db1600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dac154d60 0x7f3dac14f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:43.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.544+0000 7f3db1600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3dac15e4b0 0x7f3dac0b3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:43.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.544+0000 7f3db1600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac06fbd0 con 0x7f3dac154d60 2024-09-10T20:55:43.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.544+0000 7f3db1600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac06fa50 con 0x7f3dac0ce510 2024-09-10T20:55:43.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.544+0000 7f3db1600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3dac06fd50 con 0x7f3dac15e4b0 2024-09-10T20:55:43.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.544+0000 7f3dab400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dac154d60 0x7f3dac14f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:43.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.544+0000 7f3dab400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dac154d60 0x7f3dac14f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52274/0 (socket says 172.21.15.6:52274) 2024-09-10T20:55:43.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.544+0000 7f3dab400640 1 -- 172.21.15.6:0/2101360729 learned_addr learned my addr 172.21.15.6:0/2101360729 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:43.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.544+0000 7f3dabe00640 1 --2- 172.21.15.6:0/2101360729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3dac0ce510 0x7f3dac159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:43.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.544+0000 7f3db0c00640 1 --2- 172.21.15.6:0/2101360729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3dac15e4b0 0x7f3dac0b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:43.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.544+0000 7f3dab400640 1 -- 172.21.15.6:0/2101360729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3dac15e4b0 msgr2=0x7f3dac0b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:43.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.544+0000 7f3dab400640 1 --2- 172.21.15.6:0/2101360729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3dac15e4b0 0x7f3dac0b3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:43.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.544+0000 7f3dab400640 1 -- 172.21.15.6:0/2101360729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3dac0ce510 msgr2=0x7f3dac159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:43.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.544+0000 7f3dab400640 1 --2- 172.21.15.6:0/2101360729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3dac0ce510 0x7f3dac159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:43.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.544+0000 7f3dab400640 1 -- 172.21.15.6:0/2101360729 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dac155750 con 0x7f3dac154d60 2024-09-10T20:55:43.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.544+0000 7f3dabe00640 1 --2- 172.21.15.6:0/2101360729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3dac0ce510 0x7f3dac159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:55:43.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.544+0000 7f3db0c00640 1 --2- 172.21.15.6:0/2101360729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3dac15e4b0 0x7f3dac0b3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:55:43.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.545+0000 7f3dab400640 1 --2- 172.21.15.6:0/2101360729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dac154d60 0x7f3dac14f410 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3d9802ab30 tx=0x7f3d98004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:43.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.545+0000 7f3da3e00640 1 -- 172.21.15.6:0/2101360729 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d98040070 con 0x7f3dac154d60 2024-09-10T20:55:43.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.545+0000 7f3da3e00640 1 -- 172.21.15.6:0/2101360729 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3d9803c920 con 0x7f3dac154d60 2024-09-10T20:55:43.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.545+0000 7f3da3e00640 1 -- 172.21.15.6:0/2101360729 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9803cd30 con 0x7f3dac154d60 2024-09-10T20:55:43.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.545+0000 7f3db1600640 1 -- 172.21.15.6:0/2101360729 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dac0b2a40 con 0x7f3dac154d60 2024-09-10T20:55:43.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.545+0000 7f3db1600640 1 -- 172.21.15.6:0/2101360729 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dac0b3000 con 0x7f3dac154d60 2024-09-10T20:55:43.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.546+0000 7f3db1600640 1 -- 172.21.15.6:0/2101360729 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dac0b2870 con 0x7f3dac154d60 2024-09-10T20:55:43.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.547+0000 7f3da3e00640 1 -- 172.21.15.6:0/2101360729 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3d98045460 con 0x7f3dac154d60 2024-09-10T20:55:43.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.548+0000 7f3da3e00640 1 --2- 172.21.15.6:0/2101360729 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3d8c077fa0 0x7f3d8c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:43.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.548+0000 7f3da3e00640 1 -- 172.21.15.6:0/2101360729 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5609+0+0 (secure 0 0 0) 0x7f3d980bb5b0 con 0x7f3dac154d60 2024-09-10T20:55:43.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.549+0000 7f3dabe00640 1 --2- 172.21.15.6:0/2101360729 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3d8c077fa0 0x7f3d8c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:43.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.549+0000 7f3dabe00640 1 --2- 172.21.15.6:0/2101360729 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3d8c077fa0 0x7f3d8c07a460 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c001750 tx=0x7f3d9c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:43.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.553+0000 7f3da3e00640 1 -- 172.21.15.6:0/2101360729 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f3d98084100 con 0x7f3dac154d60 2024-09-10T20:55:43.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:43.800+0000 7f3db1600640 1 -- 172.21.15.6:0/2101360729 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f3dac0701d0 con 0x7f3dac154d60 2024-09-10T20:55:44.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.343+0000 7f3da3e00640 1 -- 172.21.15.6:0/2101360729 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f3d98083a00 con 0x7f3dac154d60 2024-09-10T20:55:44.347 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 2 and data pool 3 2024-09-10T20:55:44.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.349+0000 7f3db1600640 1 -- 172.21.15.6:0/2101360729 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3d8c077fa0 msgr2=0x7f3d8c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:44.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.349+0000 7f3db1600640 1 --2- 172.21.15.6:0/2101360729 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3d8c077fa0 0x7f3d8c07a460 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c001750 tx=0x7f3d9c009040 comp rx=0 tx=0).stop 2024-09-10T20:55:44.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.349+0000 7f3db1600640 1 -- 172.21.15.6:0/2101360729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dac154d60 msgr2=0x7f3dac14f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:44.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.349+0000 7f3db1600640 1 --2- 172.21.15.6:0/2101360729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dac154d60 0x7f3dac14f410 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3d9802ab30 tx=0x7f3d98004a50 comp rx=0 tx=0).stop 2024-09-10T20:55:44.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.349+0000 7f3db1600640 1 -- 172.21.15.6:0/2101360729 shutdown_connections 2024-09-10T20:55:44.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.349+0000 7f3db1600640 1 --2- 172.21.15.6:0/2101360729 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3d8c077fa0 0x7f3d8c07a460 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:44.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.349+0000 7f3db1600640 1 --2- 172.21.15.6:0/2101360729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dac154d60 0x7f3dac14f410 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:44.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.349+0000 7f3db1600640 1 --2- 172.21.15.6:0/2101360729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3dac15e4b0 0x7f3dac0b3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:44.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.349+0000 7f3db1600640 1 --2- 172.21.15.6:0/2101360729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3dac0ce510 0x7f3dac159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:44.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.349+0000 7f3db1600640 1 -- 172.21.15.6:0/2101360729 >> 172.21.15.6:0/2101360729 conn(0x7f3dac06d660 msgr2=0x7f3dac1605f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:44.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.351+0000 7f3db1600640 1 -- 172.21.15.6:0/2101360729 shutdown_connections 2024-09-10T20:55:44.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.352+0000 7f3db1600640 1 -- 172.21.15.6:0/2101360729 wait complete. 2024-09-10T20:55:44.396 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T20:55:44.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.553+0000 7ff4d5000640 1 -- 172.21.15.6:0/2411316399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4d00d2a60 msgr2=0x7ff4d0161930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:44.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.553+0000 7ff4d5000640 1 --2- 172.21.15.6:0/2411316399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4d00d2a60 0x7ff4d0161930 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff4d008e5a0 tx=0x7ff4c802aac0 comp rx=0 tx=0).stop 2024-09-10T20:55:44.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.553+0000 7ff4d5000640 1 -- 172.21.15.6:0/2411316399 shutdown_connections 2024-09-10T20:55:44.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.553+0000 7ff4d5000640 1 --2- 172.21.15.6:0/2411316399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4d00d2a60 0x7ff4d0161930 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:44.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.553+0000 7ff4d5000640 1 --2- 172.21.15.6:0/2411316399 >> v2:172.21.15.150:3300/0 conn(0x7ff4d00cf380 0x7ff4d00d2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:44.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.553+0000 7ff4d5000640 1 -- 172.21.15.6:0/2411316399 >> 172.21.15.6:0/2411316399 conn(0x7ff4d009d0a0 msgr2=0x7ff4d00d3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:44.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.553+0000 7ff4d5000640 1 -- 172.21.15.6:0/2411316399 shutdown_connections 2024-09-10T20:55:44.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.553+0000 7ff4d5000640 1 -- 172.21.15.6:0/2411316399 wait complete. 2024-09-10T20:55:44.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.554+0000 7ff4d5000640 1 Processor -- start 2024-09-10T20:55:44.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.554+0000 7ff4d5000640 1 -- start start 2024-09-10T20:55:44.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.555+0000 7ff4d5000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4d00cf380 0x7ff4d0160f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:44.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.555+0000 7ff4d5000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4d00d2a60 0x7ff4d014d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:44.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.555+0000 7ff4d5000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4d015dc90 0x7ff4d014d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:44.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.555+0000 7ff4d5000640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d01622b0 con 0x7ff4d00cf380 2024-09-10T20:55:44.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.555+0000 7ff4d5000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d0162130 con 0x7ff4d015dc90 2024-09-10T20:55:44.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.555+0000 7ff4d5000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ff4d00b3350 con 0x7ff4d00d2a60 2024-09-10T20:55:44.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.556+0000 7ff4cf400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4d00cf380 0x7ff4d0160f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:44.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.556+0000 7ff4cf400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4d00cf380 0x7ff4d0160f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52288/0 (socket says 172.21.15.6:52288) 2024-09-10T20:55:44.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.556+0000 7ff4cf400640 1 -- 172.21.15.6:0/483799169 learned_addr learned my addr 172.21.15.6:0/483799169 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:44.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.556+0000 7ff4cfe00640 1 --2- 172.21.15.6:0/483799169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4d015dc90 0x7ff4d014d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:44.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.556+0000 7ff4cea00640 1 --2- 172.21.15.6:0/483799169 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4d00d2a60 0x7ff4d014d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:44.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.556+0000 7ff4cf400640 1 -- 172.21.15.6:0/483799169 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4d00d2a60 msgr2=0x7ff4d014d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:44.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.556+0000 7ff4cf400640 1 --2- 172.21.15.6:0/483799169 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4d00d2a60 0x7ff4d014d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:44.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.556+0000 7ff4cf400640 1 -- 172.21.15.6:0/483799169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4d015dc90 msgr2=0x7ff4d014d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:44.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.556+0000 7ff4cf400640 1 --2- 172.21.15.6:0/483799169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4d015dc90 0x7ff4d014d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:44.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.556+0000 7ff4cf400640 1 -- 172.21.15.6:0/483799169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4d00c9f50 con 0x7ff4d00cf380 2024-09-10T20:55:44.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.556+0000 7ff4cf400640 1 --2- 172.21.15.6:0/483799169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4d00cf380 0x7ff4d0160f00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff4c000c370 tx=0x7ff4c000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:44.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.556+0000 7ff4c7400640 1 -- 172.21.15.6:0/483799169 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c00052d0 con 0x7ff4d00cf380 2024-09-10T20:55:44.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.557+0000 7ff4c7400640 1 -- 172.21.15.6:0/483799169 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff4c0007020 con 0x7ff4d00cf380 2024-09-10T20:55:44.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.557+0000 7ff4c7400640 1 -- 172.21.15.6:0/483799169 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c0007470 con 0x7ff4d00cf380 2024-09-10T20:55:44.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.557+0000 7ff4d5000640 1 -- 172.21.15.6:0/483799169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4d00ca230 con 0x7ff4d00cf380 2024-09-10T20:55:44.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.557+0000 7ff4d5000640 1 -- 172.21.15.6:0/483799169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4d00ca7f0 con 0x7ff4d00cf380 2024-09-10T20:55:44.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.558+0000 7ff4d5000640 1 -- 172.21.15.6:0/483799169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4d00d2520 con 0x7ff4d00cf380 2024-09-10T20:55:44.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.559+0000 7ff4c7400640 1 -- 172.21.15.6:0/483799169 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff4c00067d0 con 0x7ff4d00cf380 2024-09-10T20:55:44.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.560+0000 7ff4c7400640 1 --2- 172.21.15.6:0/483799169 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ff4b0077f70 0x7ff4b007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:44.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.560+0000 7ff4c7400640 1 -- 172.21.15.6:0/483799169 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff4c0099150 con 0x7ff4d00cf380 2024-09-10T20:55:44.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.560+0000 7ff4cea00640 1 --2- 172.21.15.6:0/483799169 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ff4b0077f70 0x7ff4b007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:44.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.561+0000 7ff4cea00640 1 --2- 172.21.15.6:0/483799169 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ff4b0077f70 0x7ff4b007a430 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0151630 tx=0x7ff4bc00b390 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:44.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.564+0000 7ff4c7400640 1 -- 172.21.15.6:0/483799169 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff4c00615f0 con 0x7ff4d00cf380 2024-09-10T20:55:44.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.757+0000 7ff4d5000640 1 -- 172.21.15.6:0/483799169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff4d015c860 con 0x7ff4d00cf380 2024-09-10T20:55:44.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.759+0000 7ff4c7400640 1 -- 172.21.15.6:0/483799169 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16618 (secure 0 0 0) 0x7ff4c0068020 con 0x7ff4d00cf380 2024-09-10T20:55:44.763 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:55:44.763 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"fsid":"9e04309e-61c3-4c78-82db-9576e465d98a","created":"2024-09-10T20:55:17.972466+0000","modified":"2024-09-10T20:55:43.801838+0000","last_up_change":"2024-09-10T20:55:32.392769+0000","last_in_change":"2024-09-10T20:55:22.232252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:55:33.196464+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:55:41.833420+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T20:55:42.749182+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0918c5c8-a028-4987-bad2-406c412ec3f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6801","nonce":895515615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6803","nonce":895515615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6807","nonce":895515615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6805","nonce":895515615}]},"public_addr":"172.21.15.6:6801/895515615","cluster_addr":"172.21.15.6:6803/895515615","heartbeat_back_addr":"172.21.15.6:6807/895515615","heartbeat_front_addr":"172.21.15.6:6805/895515615","state":["exists","up"]},{"osd":1,"uuid":"415e9c78-c3d9-46d6-b277-348453f42155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6809","nonce":1129113250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6811","nonce":1129113250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6815","nonce":1129113250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6813","nonce":1129113250}]},"public_addr":"172.21.15.6:6809/1129113250","cluster_addr":"172.21.15.6:6811/1129113250","heartbeat_back_addr":"172.21.15.6:6815/1129113250","heartbeat_front_addr":"172.21.15.6:6813/1129113250","state":["exists","up"]},{"osd":2,"uuid":"763c1cf2-a43d-4c10-815d-eaf4a32afc1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6825","nonce":3847470051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6827","nonce":3847470051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6831","nonce":3847470051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6829","nonce":3847470051}]},"public_addr":"172.21.15.6:6825/3847470051","cluster_addr":"172.21.15.6:6827/3847470051","heartbeat_back_addr":"172.21.15.6:6831/3847470051","heartbeat_front_addr":"172.21.15.6:6829/3847470051","state":["exists","up"]},{"osd":3,"uuid":"877b1cc1-2434-4b32-af66-9c2485eac9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6817","nonce":3911674247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6819","nonce":3911674247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6823","nonce":3911674247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6821","nonce":3911674247}]},"public_addr":"172.21.15.6:6817/3911674247","cluster_addr":"172.21.15.6:6819/3911674247","heartbeat_back_addr":"172.21.15.6:6823/3911674247","heartbeat_front_addr":"172.21.15.6:6821/3911674247","state":["exists","up"]},{"osd":4,"uuid":"e0b27501-dfdc-4e7f-b73a-9573c869267a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6827","nonce":2568527750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6829","nonce":2568527750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6833","nonce":2568527750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6831","nonce":2568527750}]},"public_addr":"172.21.15.150:6827/2568527750","cluster_addr":"172.21.15.150:6829/2568527750","heartbeat_back_addr":"172.21.15.150:6833/2568527750","heartbeat_front_addr":"172.21.15.150:6831/2568527750","state":["exists","up"]},{"osd":5,"uuid":"67e48053-4f15-44fd-a30c-c9522f86d169","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6811","nonce":371417736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6813","nonce":371417736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6817","nonce":371417736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6815","nonce":371417736}]},"public_addr":"172.21.15.150:6811/371417736","cluster_addr":"172.21.15.150:6813/371417736","heartbeat_back_addr":"172.21.15.150:6817/371417736","heartbeat_front_addr":"172.21.15.150:6815/371417736","state":["exists","up"]},{"osd":6,"uuid":"1456df2e-ae91-45a4-bc3a-a06c753092af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6819","nonce":2329248366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6821","nonce":2329248366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6825","nonce":2329248366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6823","nonce":2329248366}]},"public_addr":"172.21.15.150:6819/2329248366","cluster_addr":"172.21.15.150:6821/2329248366","heartbeat_back_addr":"172.21.15.150:6825/2329248366","heartbeat_front_addr":"172.21.15.150:6823/2329248366","state":["exists","up"]},{"osd":7,"uuid":"a9daafcb-5ecd-43bd-ab0a-dc4b480cfc2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6803","nonce":527018351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6805","nonce":527018351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6809","nonce":527018351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6807","nonce":527018351}]},"public_addr":"172.21.15.150:6803/527018351","cluster_addr":"172.21.15.150:6805/527018351","heartbeat_back_addr":"172.21.15.150:6809/527018351","heartbeat_front_addr":"172.21.15.150:6807/527018351","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.710061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.024506+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.824320+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.431608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.637032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.054828+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.333290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.358875+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:55:44.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.761+0000 7ff4d5000640 1 -- 172.21.15.6:0/483799169 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ff4b0077f70 msgr2=0x7ff4b007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:44.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.761+0000 7ff4d5000640 1 --2- 172.21.15.6:0/483799169 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ff4b0077f70 0x7ff4b007a430 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0151630 tx=0x7ff4bc00b390 comp rx=0 tx=0).stop 2024-09-10T20:55:44.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.761+0000 7ff4d5000640 1 -- 172.21.15.6:0/483799169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4d00cf380 msgr2=0x7ff4d0160f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:44.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.761+0000 7ff4d5000640 1 --2- 172.21.15.6:0/483799169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4d00cf380 0x7ff4d0160f00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff4c000c370 tx=0x7ff4c000c830 comp rx=0 tx=0).stop 2024-09-10T20:55:44.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.761+0000 7ff4d5000640 1 -- 172.21.15.6:0/483799169 shutdown_connections 2024-09-10T20:55:44.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.761+0000 7ff4d5000640 1 --2- 172.21.15.6:0/483799169 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ff4b0077f70 0x7ff4b007a430 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:44.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.761+0000 7ff4d5000640 1 --2- 172.21.15.6:0/483799169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4d015dc90 0x7ff4d014d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:44.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.761+0000 7ff4d5000640 1 --2- 172.21.15.6:0/483799169 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4d00d2a60 0x7ff4d014d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:44.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.761+0000 7ff4d5000640 1 --2- 172.21.15.6:0/483799169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4d00cf380 0x7ff4d0160f00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:44.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.761+0000 7ff4d5000640 1 -- 172.21.15.6:0/483799169 >> 172.21.15.6:0/483799169 conn(0x7ff4d009d0a0 msgr2=0x7ff4d00b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:44.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.761+0000 7ff4d5000640 1 -- 172.21.15.6:0/483799169 shutdown_connections 2024-09-10T20:55:44.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.761+0000 7ff4d5000640 1 -- 172.21.15.6:0/483799169 wait complete. 2024-09-10T20:55:44.780 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T20:55:44.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.937+0000 7f4efd200640 1 -- 172.21.15.6:0/1524457508 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ef80af060 msgr2=0x7f4ef815f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:44.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.937+0000 7f4efd200640 1 --2- 172.21.15.6:0/1524457508 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ef80af060 0x7f4ef815f230 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0009810 tx=0x7f4ee002a3d0 comp rx=0 tx=0).stop 2024-09-10T20:55:44.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.937+0000 7f4efd200640 1 -- 172.21.15.6:0/1524457508 shutdown_connections 2024-09-10T20:55:44.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.937+0000 7f4efd200640 1 --2- 172.21.15.6:0/1524457508 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ef80af060 0x7f4ef815f230 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:44.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.937+0000 7f4efd200640 1 -- 172.21.15.6:0/1524457508 >> 172.21.15.6:0/1524457508 conn(0x7f4ef80cfa20 msgr2=0x7f4ef80cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:44.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.937+0000 7f4efd200640 1 -- 172.21.15.6:0/1524457508 shutdown_connections 2024-09-10T20:55:44.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.937+0000 7f4efd200640 1 -- 172.21.15.6:0/1524457508 wait complete. 2024-09-10T20:55:44.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.938+0000 7f4efd200640 1 Processor -- start 2024-09-10T20:55:44.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.939+0000 7f4efd200640 1 -- start start 2024-09-10T20:55:44.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.939+0000 7f4efd200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ef806f090 0x7f4ef814e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:44.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.939+0000 7f4efd200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ef80af060 0x7f4ef814d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:44.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.940+0000 7f4efd200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ef80cdc40 0x7f4ef81f5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:44.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.940+0000 7f4efd200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef80caa60 con 0x7f4ef80af060 2024-09-10T20:55:44.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.940+0000 7f4efd200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef806f700 con 0x7f4ef806f090 2024-09-10T20:55:44.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.940+0000 7f4efd200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f4ef80cabe0 con 0x7f4ef80cdc40 2024-09-10T20:55:44.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.940+0000 7f4eed400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ef80af060 0x7f4ef814d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:44.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.940+0000 7f4eed400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ef80af060 0x7f4ef814d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52298/0 (socket says 172.21.15.6:52298) 2024-09-10T20:55:44.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.940+0000 7f4eed400640 1 -- 172.21.15.6:0/4233432261 learned_addr learned my addr 172.21.15.6:0/4233432261 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:44.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.940+0000 7f4ef5e00640 1 --2- 172.21.15.6:0/4233432261 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ef806f090 0x7f4ef814e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:44.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.940+0000 7f4ef6800640 1 --2- 172.21.15.6:0/4233432261 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ef80cdc40 0x7f4ef81f5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:44.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.940+0000 7f4eed400640 1 -- 172.21.15.6:0/4233432261 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ef80cdc40 msgr2=0x7f4ef81f5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:44.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.940+0000 7f4eed400640 1 --2- 172.21.15.6:0/4233432261 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ef80cdc40 0x7f4ef81f5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:44.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.940+0000 7f4eed400640 1 -- 172.21.15.6:0/4233432261 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ef806f090 msgr2=0x7f4ef814e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:44.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.940+0000 7f4eed400640 1 --2- 172.21.15.6:0/4233432261 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ef806f090 0x7f4ef814e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:44.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.940+0000 7f4eed400640 1 -- 172.21.15.6:0/4233432261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ef814ebd0 con 0x7f4ef80af060 2024-09-10T20:55:44.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.940+0000 7f4ef5e00640 1 --2- 172.21.15.6:0/4233432261 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ef806f090 0x7f4ef814e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:55:44.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.940+0000 7f4ef6800640 1 --2- 172.21.15.6:0/4233432261 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ef80cdc40 0x7f4ef81f5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:55:44.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.940+0000 7f4eed400640 1 --2- 172.21.15.6:0/4233432261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ef80af060 0x7f4ef814d1b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4ee002a9c0 tx=0x7f4ee00305f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:44.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.941+0000 7f4eeea00640 1 -- 172.21.15.6:0/4233432261 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee003f030 con 0x7f4ef80af060 2024-09-10T20:55:44.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.941+0000 7f4eeea00640 1 -- 172.21.15.6:0/4233432261 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4ee002acd0 con 0x7f4ef80af060 2024-09-10T20:55:44.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.941+0000 7f4efd200640 1 -- 172.21.15.6:0/4233432261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ef814eeb0 con 0x7f4ef80af060 2024-09-10T20:55:44.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.941+0000 7f4eeea00640 1 -- 172.21.15.6:0/4233432261 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee0037040 con 0x7f4ef80af060 2024-09-10T20:55:44.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.941+0000 7f4efd200640 1 -- 172.21.15.6:0/4233432261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ef814f470 con 0x7f4ef80af060 2024-09-10T20:55:44.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.942+0000 7f4efd200640 1 -- 172.21.15.6:0/4233432261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ef80ca350 con 0x7f4ef80af060 2024-09-10T20:55:44.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.943+0000 7f4eeea00640 1 -- 172.21.15.6:0/4233432261 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4ee003a030 con 0x7f4ef80af060 2024-09-10T20:55:44.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.944+0000 7f4eeea00640 1 --2- 172.21.15.6:0/4233432261 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4ed4077f70 0x7f4ed407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:44.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.945+0000 7f4eeea00640 1 -- 172.21.15.6:0/4233432261 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4ee00b9730 con 0x7f4ef80af060 2024-09-10T20:55:44.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.945+0000 7f4ef5e00640 1 --2- 172.21.15.6:0/4233432261 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4ed4077f70 0x7f4ed407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:44.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.946+0000 7f4ef5e00640 1 --2- 172.21.15.6:0/4233432261 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4ed4077f70 0x7f4ed407a430 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8001890 tx=0x7f4ee8009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:44.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:44.949+0000 7f4eeea00640 1 -- 172.21.15.6:0/4233432261 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4ee0082220 con 0x7f4ef80af060 2024-09-10T20:55:45.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.144+0000 7f4efd200640 1 -- 172.21.15.6:0/4233432261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4ef80c62b0 con 0x7f4ef80af060 2024-09-10T20:55:45.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.145+0000 7f4eeea00640 1 -- 172.21.15.6:0/4233432261 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16618 (secure 0 0 0) 0x7f4ee0081b20 con 0x7f4ef80af060 2024-09-10T20:55:45.149 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:55:45.149 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"fsid":"9e04309e-61c3-4c78-82db-9576e465d98a","created":"2024-09-10T20:55:17.972466+0000","modified":"2024-09-10T20:55:43.801838+0000","last_up_change":"2024-09-10T20:55:32.392769+0000","last_in_change":"2024-09-10T20:55:22.232252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:55:33.196464+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:55:41.833420+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T20:55:42.749182+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0918c5c8-a028-4987-bad2-406c412ec3f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6801","nonce":895515615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6803","nonce":895515615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6807","nonce":895515615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6805","nonce":895515615}]},"public_addr":"172.21.15.6:6801/895515615","cluster_addr":"172.21.15.6:6803/895515615","heartbeat_back_addr":"172.21.15.6:6807/895515615","heartbeat_front_addr":"172.21.15.6:6805/895515615","state":["exists","up"]},{"osd":1,"uuid":"415e9c78-c3d9-46d6-b277-348453f42155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6809","nonce":1129113250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6811","nonce":1129113250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6815","nonce":1129113250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6813","nonce":1129113250}]},"public_addr":"172.21.15.6:6809/1129113250","cluster_addr":"172.21.15.6:6811/1129113250","heartbeat_back_addr":"172.21.15.6:6815/1129113250","heartbeat_front_addr":"172.21.15.6:6813/1129113250","state":["exists","up"]},{"osd":2,"uuid":"763c1cf2-a43d-4c10-815d-eaf4a32afc1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6825","nonce":3847470051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6827","nonce":3847470051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6831","nonce":3847470051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6829","nonce":3847470051}]},"public_addr":"172.21.15.6:6825/3847470051","cluster_addr":"172.21.15.6:6827/3847470051","heartbeat_back_addr":"172.21.15.6:6831/3847470051","heartbeat_front_addr":"172.21.15.6:6829/3847470051","state":["exists","up"]},{"osd":3,"uuid":"877b1cc1-2434-4b32-af66-9c2485eac9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6817","nonce":3911674247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6819","nonce":3911674247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6823","nonce":3911674247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6821","nonce":3911674247}]},"public_addr":"172.21.15.6:6817/3911674247","cluster_addr":"172.21.15.6:6819/3911674247","heartbeat_back_addr":"172.21.15.6:6823/3911674247","heartbeat_front_addr":"172.21.15.6:6821/3911674247","state":["exists","up"]},{"osd":4,"uuid":"e0b27501-dfdc-4e7f-b73a-9573c869267a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6827","nonce":2568527750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6829","nonce":2568527750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6833","nonce":2568527750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6831","nonce":2568527750}]},"public_addr":"172.21.15.150:6827/2568527750","cluster_addr":"172.21.15.150:6829/2568527750","heartbeat_back_addr":"172.21.15.150:6833/2568527750","heartbeat_front_addr":"172.21.15.150:6831/2568527750","state":["exists","up"]},{"osd":5,"uuid":"67e48053-4f15-44fd-a30c-c9522f86d169","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6811","nonce":371417736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6813","nonce":371417736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6817","nonce":371417736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6815","nonce":371417736}]},"public_addr":"172.21.15.150:6811/371417736","cluster_addr":"172.21.15.150:6813/371417736","heartbeat_back_addr":"172.21.15.150:6817/371417736","heartbeat_front_addr":"172.21.15.150:6815/371417736","state":["exists","up"]},{"osd":6,"uuid":"1456df2e-ae91-45a4-bc3a-a06c753092af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6819","nonce":2329248366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6821","nonce":2329248366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6825","nonce":2329248366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6823","nonce":2329248366}]},"public_addr":"172.21.15.150:6819/2329248366","cluster_addr":"172.21.15.150:6821/2329248366","heartbeat_back_addr":"172.21.15.150:6825/2329248366","heartbeat_front_addr":"172.21.15.150:6823/2329248366","state":["exists","up"]},{"osd":7,"uuid":"a9daafcb-5ecd-43bd-ab0a-dc4b480cfc2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6803","nonce":527018351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6805","nonce":527018351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6809","nonce":527018351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6807","nonce":527018351}]},"public_addr":"172.21.15.150:6803/527018351","cluster_addr":"172.21.15.150:6805/527018351","heartbeat_back_addr":"172.21.15.150:6809/527018351","heartbeat_front_addr":"172.21.15.150:6807/527018351","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.710061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.024506+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.824320+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.431608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.637032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.054828+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.333290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.358875+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:55:45.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.148+0000 7f4efd200640 1 -- 172.21.15.6:0/4233432261 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4ed4077f70 msgr2=0x7f4ed407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:45.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.148+0000 7f4efd200640 1 --2- 172.21.15.6:0/4233432261 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4ed4077f70 0x7f4ed407a430 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8001890 tx=0x7f4ee8009040 comp rx=0 tx=0).stop 2024-09-10T20:55:45.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.148+0000 7f4efd200640 1 -- 172.21.15.6:0/4233432261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ef80af060 msgr2=0x7f4ef814d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:45.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.148+0000 7f4efd200640 1 --2- 172.21.15.6:0/4233432261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ef80af060 0x7f4ef814d1b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4ee002a9c0 tx=0x7f4ee00305f0 comp rx=0 tx=0).stop 2024-09-10T20:55:45.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.148+0000 7f4efd200640 1 -- 172.21.15.6:0/4233432261 shutdown_connections 2024-09-10T20:55:45.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.148+0000 7f4efd200640 1 --2- 172.21.15.6:0/4233432261 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4ed4077f70 0x7f4ed407a430 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:45.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.148+0000 7f4efd200640 1 --2- 172.21.15.6:0/4233432261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ef80af060 0x7f4ef814d1b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:45.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.148+0000 7f4efd200640 1 --2- 172.21.15.6:0/4233432261 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ef80cdc40 0x7f4ef81f5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:45.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.148+0000 7f4efd200640 1 --2- 172.21.15.6:0/4233432261 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ef806f090 0x7f4ef814e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:45.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.148+0000 7f4efd200640 1 -- 172.21.15.6:0/4233432261 >> 172.21.15.6:0/4233432261 conn(0x7f4ef80cfa20 msgr2=0x7f4ef80b4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:45.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.148+0000 7f4efd200640 1 -- 172.21.15.6:0/4233432261 shutdown_connections 2024-09-10T20:55:45.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.148+0000 7f4efd200640 1 -- 172.21.15.6:0/4233432261 wait complete. 2024-09-10T20:55:45.167 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T20:55:45.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.327+0000 7f2f59600640 1 -- 172.21.15.6:0/1806346533 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f540af060 msgr2=0x7f2f5415f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:45.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.327+0000 7f2f59600640 1 --2- 172.21.15.6:0/1806346533 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f540af060 0x7f2f5415f060 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2f54070620 tx=0x7f2f3c02a4d0 comp rx=0 tx=0).stop 2024-09-10T20:55:45.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.327+0000 7f2f59600640 1 -- 172.21.15.6:0/1806346533 shutdown_connections 2024-09-10T20:55:45.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.327+0000 7f2f59600640 1 --2- 172.21.15.6:0/1806346533 >> v2:172.21.15.150:3300/0 conn(0x7f2f540cdc40 0x7f2f5415f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:45.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.327+0000 7f2f59600640 1 --2- 172.21.15.6:0/1806346533 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f540af060 0x7f2f5415f060 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:45.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.327+0000 7f2f59600640 1 --2- 172.21.15.6:0/1806346533 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f5406f090 0x7f2f5415eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:45.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.327+0000 7f2f59600640 1 -- 172.21.15.6:0/1806346533 >> 172.21.15.6:0/1806346533 conn(0x7f2f540cfa20 msgr2=0x7f2f540cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:45.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.327+0000 7f2f59600640 1 -- 172.21.15.6:0/1806346533 shutdown_connections 2024-09-10T20:55:45.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.327+0000 7f2f59600640 1 -- 172.21.15.6:0/1806346533 wait complete. 2024-09-10T20:55:45.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.329+0000 7f2f59600640 1 Processor -- start 2024-09-10T20:55:45.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.329+0000 7f2f59600640 1 -- start start 2024-09-10T20:55:45.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.330+0000 7f2f59600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f5406f090 0x7f2f541f8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:45.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.330+0000 7f2f59600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f540af060 0x7f2f540c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:45.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.330+0000 7f2f59600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f540cdc40 0x7f2f540c7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:45.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.330+0000 7f2f59600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2f540ce540 con 0x7f2f540af060 2024-09-10T20:55:45.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.330+0000 7f2f59600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2f540ce3c0 con 0x7f2f540cdc40 2024-09-10T20:55:45.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.330+0000 7f2f59600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f2f540ce6c0 con 0x7f2f5406f090 2024-09-10T20:55:45.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.330+0000 7f2f4a000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f540af060 0x7f2f540c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:45.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.330+0000 7f2f4a000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f540af060 0x7f2f540c6af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52322/0 (socket says 172.21.15.6:52322) 2024-09-10T20:55:45.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.330+0000 7f2f52a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f5406f090 0x7f2f541f8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:45.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.330+0000 7f2f4a000640 1 -- 172.21.15.6:0/3729574465 learned_addr learned my addr 172.21.15.6:0/3729574465 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:45.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.330+0000 7f2f53400640 1 --2- 172.21.15.6:0/3729574465 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f540cdc40 0x7f2f540c7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:45.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.331+0000 7f2f4a000640 1 -- 172.21.15.6:0/3729574465 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f5406f090 msgr2=0x7f2f541f8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:45.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.331+0000 7f2f4a000640 1 --2- 172.21.15.6:0/3729574465 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f5406f090 0x7f2f541f8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:45.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.331+0000 7f2f4a000640 1 -- 172.21.15.6:0/3729574465 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f540cdc40 msgr2=0x7f2f540c7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:45.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.331+0000 7f2f4a000640 1 --2- 172.21.15.6:0/3729574465 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f540cdc40 0x7f2f540c7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:45.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.331+0000 7f2f4a000640 1 -- 172.21.15.6:0/3729574465 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f541f8940 con 0x7f2f540af060 2024-09-10T20:55:45.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.331+0000 7f2f52a00640 1 --2- 172.21.15.6:0/3729574465 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f5406f090 0x7f2f541f8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:55:45.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.331+0000 7f2f4a000640 1 --2- 172.21.15.6:0/3729574465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f540af060 0x7f2f540c6af0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c009850 tx=0x7f2f3c003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:45.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.331+0000 7f2f4b400640 1 -- 172.21.15.6:0/3729574465 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c03f070 con 0x7f2f540af060 2024-09-10T20:55:45.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.331+0000 7f2f4b400640 1 -- 172.21.15.6:0/3729574465 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f3c0047a0 con 0x7f2f540af060 2024-09-10T20:55:45.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.331+0000 7f2f4b400640 1 -- 172.21.15.6:0/3729574465 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c035030 con 0x7f2f540af060 2024-09-10T20:55:45.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.331+0000 7f2f59600640 1 -- 172.21.15.6:0/3729574465 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f540ade40 con 0x7f2f540af060 2024-09-10T20:55:45.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.332+0000 7f2f59600640 1 -- 172.21.15.6:0/3729574465 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f541f7c00 con 0x7f2f540af060 2024-09-10T20:55:45.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.332+0000 7f2f59600640 1 -- 172.21.15.6:0/3729574465 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f540ceb70 con 0x7f2f540af060 2024-09-10T20:55:45.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.334+0000 7f2f4b400640 1 -- 172.21.15.6:0/3729574465 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2f3c004bb0 con 0x7f2f540af060 2024-09-10T20:55:45.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.335+0000 7f2f4b400640 1 --2- 172.21.15.6:0/3729574465 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2f30077f70 0x7f2f3007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:45.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.335+0000 7f2f4b400640 1 -- 172.21.15.6:0/3729574465 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2f3c0bae50 con 0x7f2f540af060 2024-09-10T20:55:45.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.335+0000 7f2f52a00640 1 --2- 172.21.15.6:0/3729574465 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2f30077f70 0x7f2f3007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:45.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.336+0000 7f2f52a00640 1 --2- 172.21.15.6:0/3729574465 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2f30077f70 0x7f2f3007a430 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2f44009f40 tx=0x7f2f44005f90 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:45.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.339+0000 7f2f4b400640 1 -- 172.21.15.6:0/3729574465 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2f3c083260 con 0x7f2f540af060 2024-09-10T20:55:45.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:45.573+0000 7f2f59600640 1 -- 172.21.15.6:0/3729574465 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f2f54069d20 con 0x7f2f540af060 2024-09-10T20:55:46.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.366+0000 7f2f4b400640 1 -- 172.21.15.6:0/3729574465 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f2f3c088e20 con 0x7f2f540af060 2024-09-10T20:55:46.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.369+0000 7f2f59600640 1 -- 172.21.15.6:0/3729574465 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2f30077f70 msgr2=0x7f2f3007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:46.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.369+0000 7f2f59600640 1 --2- 172.21.15.6:0/3729574465 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2f30077f70 0x7f2f3007a430 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2f44009f40 tx=0x7f2f44005f90 comp rx=0 tx=0).stop 2024-09-10T20:55:46.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.369+0000 7f2f59600640 1 -- 172.21.15.6:0/3729574465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f540af060 msgr2=0x7f2f540c6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:46.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.369+0000 7f2f59600640 1 --2- 172.21.15.6:0/3729574465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f540af060 0x7f2f540c6af0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c009850 tx=0x7f2f3c003820 comp rx=0 tx=0).stop 2024-09-10T20:55:46.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.369+0000 7f2f59600640 1 -- 172.21.15.6:0/3729574465 shutdown_connections 2024-09-10T20:55:46.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.369+0000 7f2f59600640 1 --2- 172.21.15.6:0/3729574465 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2f30077f70 0x7f2f3007a430 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:46.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.369+0000 7f2f59600640 1 --2- 172.21.15.6:0/3729574465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f540af060 0x7f2f540c6af0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:46.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.369+0000 7f2f59600640 1 --2- 172.21.15.6:0/3729574465 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f540cdc40 0x7f2f540c7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:46.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.369+0000 7f2f59600640 1 --2- 172.21.15.6:0/3729574465 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f5406f090 0x7f2f541f8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:46.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.369+0000 7f2f59600640 1 -- 172.21.15.6:0/3729574465 >> 172.21.15.6:0/3729574465 conn(0x7f2f540cfa20 msgr2=0x7f2f54156d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:46.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.369+0000 7f2f59600640 1 -- 172.21.15.6:0/3729574465 shutdown_connections 2024-09-10T20:55:46.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.369+0000 7f2f59600640 1 -- 172.21.15.6:0/3729574465 wait complete. 2024-09-10T20:55:46.392 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T20:55:46.392 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T20:55:46.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.556+0000 7f9d2e800640 1 -- 172.21.15.6:0/4177781167 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d10004d40 msgr2=0x7f9d100051a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:46.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.556+0000 7f9d2e800640 1 --2- 172.21.15.6:0/4177781167 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d10004d40 0x7f9d100051a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9d20001dc0 tx=0x7f9d10005830 comp rx=0 tx=0).stop 2024-09-10T20:55:46.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.556+0000 7f9d2de00640 1 -- 172.21.15.6:0/4177781167 reap_dead start 2024-09-10T20:55:46.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.556+0000 7f9d2e800640 1 -- 172.21.15.6:0/4177781167 shutdown_connections 2024-09-10T20:55:46.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.556+0000 7f9d2e800640 1 -- 172.21.15.6:0/4177781167 >> 172.21.15.6:0/4177781167 conn(0x7f9d2809d100 msgr2=0x7f9d280d3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:46.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.556+0000 7f9d2e800640 1 -- 172.21.15.6:0/4177781167 shutdown_connections 2024-09-10T20:55:46.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.556+0000 7f9d2e800640 1 -- 172.21.15.6:0/4177781167 wait complete. 2024-09-10T20:55:46.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.557+0000 7f9d2e800640 1 Processor -- start 2024-09-10T20:55:46.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.558+0000 7f9d2e800640 1 -- start start 2024-09-10T20:55:46.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.558+0000 7f9d2e800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d10004d40 0x7f9d2814abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:46.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.558+0000 7f9d2e800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d28157340 0x7f9d280caec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:46.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.558+0000 7f9d2e800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d28159100 0x7f9d280cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:46.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.558+0000 7f9d2e800640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9d280d1330 con 0x7f9d28159100 2024-09-10T20:55:46.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.558+0000 7f9d2e800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9d280d11b0 con 0x7f9d28157340 2024-09-10T20:55:46.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.558+0000 7f9d2e800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f9d280b6c40 con 0x7f9d10004d40 2024-09-10T20:55:46.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.559+0000 7f9d2de00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d28159100 0x7f9d280cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:46.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.559+0000 7f9d2de00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d28159100 0x7f9d280cc8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52336/0 (socket says 172.21.15.6:52336) 2024-09-10T20:55:46.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.559+0000 7f9d2de00640 1 -- 172.21.15.6:0/3091771674 learned_addr learned my addr 172.21.15.6:0/3091771674 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:46.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.559+0000 7f9d2d400640 1 --2- 172.21.15.6:0/3091771674 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d10004d40 0x7f9d2814abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:46.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.559+0000 7f9d2ca00640 1 --2- 172.21.15.6:0/3091771674 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d28157340 0x7f9d280caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:46.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.559+0000 7f9d2de00640 1 -- 172.21.15.6:0/3091771674 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d10004d40 msgr2=0x7f9d2814abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:46.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.559+0000 7f9d2de00640 1 --2- 172.21.15.6:0/3091771674 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d10004d40 0x7f9d2814abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:46.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.559+0000 7f9d2de00640 1 -- 172.21.15.6:0/3091771674 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d28157340 msgr2=0x7f9d280caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:46.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.559+0000 7f9d2de00640 1 --2- 172.21.15.6:0/3091771674 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d28157340 0x7f9d280caec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:46.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.559+0000 7f9d2de00640 1 -- 172.21.15.6:0/3091771674 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d280cd3e0 con 0x7f9d28159100 2024-09-10T20:55:46.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.559+0000 7f9d2de00640 1 --2- 172.21.15.6:0/3091771674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d28159100 0x7f9d280cc8d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9d20001eb0 tx=0x7f9d20006cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:46.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.560+0000 7f9d25600640 1 -- 172.21.15.6:0/3091771674 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d200039f0 con 0x7f9d28159100 2024-09-10T20:55:46.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.560+0000 7f9d25600640 1 -- 172.21.15.6:0/3091771674 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9d200062b0 con 0x7f9d28159100 2024-09-10T20:55:46.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.560+0000 7f9d25600640 1 -- 172.21.15.6:0/3091771674 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d200066a0 con 0x7f9d28159100 2024-09-10T20:55:46.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.560+0000 7f9d2e800640 1 -- 172.21.15.6:0/3091771674 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d280cb7c0 con 0x7f9d28159100 2024-09-10T20:55:46.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.560+0000 7f9d2e800640 1 -- 172.21.15.6:0/3091771674 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d2814a3d0 con 0x7f9d28159100 2024-09-10T20:55:46.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.561+0000 7f9d2e800640 1 -- 172.21.15.6:0/3091771674 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d281619c0 con 0x7f9d28159100 2024-09-10T20:55:46.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.562+0000 7f9d25600640 1 -- 172.21.15.6:0/3091771674 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f9d20048030 con 0x7f9d28159100 2024-09-10T20:55:46.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.563+0000 7f9d25600640 1 --2- 172.21.15.6:0/3091771674 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f9d08077f70 0x7f9d0807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:46.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.563+0000 7f9d25600640 1 -- 172.21.15.6:0/3091771674 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f9d200b99e0 con 0x7f9d28159100 2024-09-10T20:55:46.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.563+0000 7f9d2d400640 1 --2- 172.21.15.6:0/3091771674 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f9d08077f70 0x7f9d0807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:46.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.564+0000 7f9d2d400640 1 --2- 172.21.15.6:0/3091771674 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f9d08077f70 0x7f9d0807a430 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9d2815b1a0 tx=0x7f9d1c001e20 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:46.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.567+0000 7f9d25600640 1 -- 172.21.15.6:0/3091771674 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f9d200824d0 con 0x7f9d28159100 2024-09-10T20:55:46.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:46.797+0000 7f9d2e800640 1 -- 172.21.15.6:0/3091771674 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f9d28069d10 con 0x7f9d28159100 2024-09-10T20:55:47.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.371+0000 7f9d25600640 1 -- 172.21.15.6:0/3091771674 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f9d20081dd0 con 0x7f9d28159100 2024-09-10T20:55:47.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.374+0000 7f9d2e800640 1 -- 172.21.15.6:0/3091771674 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f9d08077f70 msgr2=0x7f9d0807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:47.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.374+0000 7f9d2e800640 1 --2- 172.21.15.6:0/3091771674 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f9d08077f70 0x7f9d0807a430 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9d2815b1a0 tx=0x7f9d1c001e20 comp rx=0 tx=0).stop 2024-09-10T20:55:47.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.374+0000 7f9d2e800640 1 -- 172.21.15.6:0/3091771674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d28159100 msgr2=0x7f9d280cc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:47.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.374+0000 7f9d2e800640 1 --2- 172.21.15.6:0/3091771674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d28159100 0x7f9d280cc8d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9d20001eb0 tx=0x7f9d20006cc0 comp rx=0 tx=0).stop 2024-09-10T20:55:47.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.374+0000 7f9d2e800640 1 -- 172.21.15.6:0/3091771674 shutdown_connections 2024-09-10T20:55:47.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.374+0000 7f9d2e800640 1 --2- 172.21.15.6:0/3091771674 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f9d08077f70 0x7f9d0807a430 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:47.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.374+0000 7f9d2e800640 1 --2- 172.21.15.6:0/3091771674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d28159100 0x7f9d280cc8d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:47.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.374+0000 7f9d2e800640 1 --2- 172.21.15.6:0/3091771674 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d28157340 0x7f9d280caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:47.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.374+0000 7f9d2e800640 1 --2- 172.21.15.6:0/3091771674 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d10004d40 0x7f9d2814abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:47.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.374+0000 7f9d2e800640 1 -- 172.21.15.6:0/3091771674 >> 172.21.15.6:0/3091771674 conn(0x7f9d2809d100 msgr2=0x7f9d280b79b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:47.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.375+0000 7f9d2e800640 1 -- 172.21.15.6:0/3091771674 shutdown_connections 2024-09-10T20:55:47.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.375+0000 7f9d2e800640 1 -- 172.21.15.6:0/3091771674 wait complete. 2024-09-10T20:55:47.397 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T20:55:47.398 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:55:47.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.557+0000 7fc3daa00640 1 -- 172.21.15.6:0/2269600855 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3d4162130 msgr2=0x7fc3d40ad880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:47.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.557+0000 7fc3daa00640 1 --2- 172.21.15.6:0/2269600855 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3d4162130 0x7fc3d40ad880 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc3d406c490 tx=0x7fc3cc02a8b0 comp rx=0 tx=0).stop 2024-09-10T20:55:47.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.557+0000 7fc3daa00640 1 -- 172.21.15.6:0/2269600855 shutdown_connections 2024-09-10T20:55:47.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.557+0000 7fc3daa00640 1 --2- 172.21.15.6:0/2269600855 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3d4162130 0x7fc3d40ad880 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:47.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.557+0000 7fc3daa00640 1 --2- 172.21.15.6:0/2269600855 >> v2:172.21.15.150:3300/0 conn(0x7fc3d415bb30 0x7fc3d40cf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:47.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.557+0000 7fc3daa00640 1 -- 172.21.15.6:0/2269600855 >> 172.21.15.6:0/2269600855 conn(0x7fc3d40cfa20 msgr2=0x7fc3d40cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:47.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.557+0000 7fc3daa00640 1 -- 172.21.15.6:0/2269600855 shutdown_connections 2024-09-10T20:55:47.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.557+0000 7fc3daa00640 1 -- 172.21.15.6:0/2269600855 wait complete. 2024-09-10T20:55:47.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.558+0000 7fc3daa00640 1 Processor -- start 2024-09-10T20:55:47.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.559+0000 7fc3daa00640 1 -- start start 2024-09-10T20:55:47.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.559+0000 7fc3daa00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3d40caa40 0x7fc3d406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:47.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.559+0000 7fc3daa00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3d415bb30 0x7fc3d415a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:47.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.560+0000 7fc3daa00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3d4162130 0x7fc3d406fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:47.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.560+0000 7fc3daa00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d40ae150 con 0x7fc3d40caa40 2024-09-10T20:55:47.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.560+0000 7fc3daa00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d40adfd0 con 0x7fc3d415bb30 2024-09-10T20:55:47.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.560+0000 7fc3daa00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fc3d40ae2d0 con 0x7fc3d4162130 2024-09-10T20:55:47.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.560+0000 7fc3d3e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3d40caa40 0x7fc3d406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:47.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.560+0000 7fc3d3e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3d40caa40 0x7fc3d406e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52360/0 (socket says 172.21.15.6:52360) 2024-09-10T20:55:47.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.560+0000 7fc3d3e00640 1 -- 172.21.15.6:0/63526705 learned_addr learned my addr 172.21.15.6:0/63526705 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:47.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.560+0000 7fc3cb400640 1 --2- 172.21.15.6:0/63526705 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3d415bb30 0x7fc3d415a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:47.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.560+0000 7fc3d8a00640 1 --2- 172.21.15.6:0/63526705 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3d4162130 0x7fc3d406fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:47.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.560+0000 7fc3d3e00640 1 -- 172.21.15.6:0/63526705 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3d4162130 msgr2=0x7fc3d406fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:47.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.560+0000 7fc3d3e00640 1 --2- 172.21.15.6:0/63526705 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3d4162130 0x7fc3d406fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:47.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.560+0000 7fc3d3e00640 1 -- 172.21.15.6:0/63526705 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3d415bb30 msgr2=0x7fc3d415a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:47.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.560+0000 7fc3d3e00640 1 --2- 172.21.15.6:0/63526705 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3d415bb30 0x7fc3d415a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:47.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.560+0000 7fc3d3e00640 1 -- 172.21.15.6:0/63526705 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3d41f4fa0 con 0x7fc3d40caa40 2024-09-10T20:55:47.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.560+0000 7fc3cb400640 1 --2- 172.21.15.6:0/63526705 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3d415bb30 0x7fc3d415a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:55:47.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.561+0000 7fc3d3e00640 1 --2- 172.21.15.6:0/63526705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3d40caa40 0x7fc3d406e3f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc3c400d950 tx=0x7fc3c400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:47.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.561+0000 7fc3d0c00640 1 -- 172.21.15.6:0/63526705 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c4017070 con 0x7fc3d40caa40 2024-09-10T20:55:47.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.561+0000 7fc3d0c00640 1 -- 172.21.15.6:0/63526705 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc3c4009d20 con 0x7fc3d40caa40 2024-09-10T20:55:47.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.561+0000 7fc3daa00640 1 -- 172.21.15.6:0/63526705 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3d41f5280 con 0x7fc3d40caa40 2024-09-10T20:55:47.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.561+0000 7fc3d0c00640 1 -- 172.21.15.6:0/63526705 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c40106c0 con 0x7fc3d40caa40 2024-09-10T20:55:47.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.561+0000 7fc3daa00640 1 -- 172.21.15.6:0/63526705 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3d415aad0 con 0x7fc3d40caa40 2024-09-10T20:55:47.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.562+0000 7fc3daa00640 1 -- 172.21.15.6:0/63526705 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3d40ae780 con 0x7fc3d40caa40 2024-09-10T20:55:47.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.563+0000 7fc3d0c00640 1 -- 172.21.15.6:0/63526705 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc3c4010860 con 0x7fc3d40caa40 2024-09-10T20:55:47.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.565+0000 7fc3d0c00640 1 --2- 172.21.15.6:0/63526705 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fc3b0077f70 0x7fc3b007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:47.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.565+0000 7fc3d0c00640 1 -- 172.21.15.6:0/63526705 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fc3c409a240 con 0x7fc3d40caa40 2024-09-10T20:55:47.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.565+0000 7fc3cb400640 1 --2- 172.21.15.6:0/63526705 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fc3b0077f70 0x7fc3b007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:47.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.566+0000 7fc3cb400640 1 --2- 172.21.15.6:0/63526705 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fc3b0077f70 0x7fc3b007a430 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc007fd0 tx=0x7fc3bc009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:47.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.569+0000 7fc3d0c00640 1 -- 172.21.15.6:0/63526705 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc3c4062ca0 con 0x7fc3d40caa40 2024-09-10T20:55:47.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.804+0000 7fc3daa00640 1 -- 172.21.15.6:0/63526705 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc3d4069d20 con 0x7fc3d40caa40 2024-09-10T20:55:47.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.804+0000 7fc3d0c00640 1 -- 172.21.15.6:0/63526705 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5211 (secure 0 0 0) 0x7fc3c40625a0 con 0x7fc3d40caa40 2024-09-10T20:55:47.808 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:55:47.808 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"btime":"2024-09-10T20:55:47:367368+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4329,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/77885972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":77885972},{"type":"v1","addr":"172.21.15.6:6834","nonce":77885972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4341,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/1181849476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1181849476},{"type":"v1","addr":"172.21.15.150:6836","nonce":1181849476}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4344,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/3860565837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":3860565837},{"type":"v1","addr":"172.21.15.150:6837","nonce":3860565837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:55:43.801792+0000","modified":"2024-09-10T20:55:46.798409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4375},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4375":{"gid":4375,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/3230367141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3230367141},{"type":"v1","addr":"172.21.15.6:6835","nonce":3230367141}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4375,"qdb_cluster":[4375]},"id":1}]} 2024-09-10T20:55:47.809 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2024-09-10T20:55:47.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.806+0000 7fc3daa00640 1 -- 172.21.15.6:0/63526705 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fc3b0077f70 msgr2=0x7fc3b007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:47.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.806+0000 7fc3daa00640 1 --2- 172.21.15.6:0/63526705 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fc3b0077f70 0x7fc3b007a430 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc007fd0 tx=0x7fc3bc009040 comp rx=0 tx=0).stop 2024-09-10T20:55:47.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.806+0000 7fc3daa00640 1 -- 172.21.15.6:0/63526705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3d40caa40 msgr2=0x7fc3d406e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:47.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.806+0000 7fc3daa00640 1 --2- 172.21.15.6:0/63526705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3d40caa40 0x7fc3d406e3f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc3c400d950 tx=0x7fc3c400de10 comp rx=0 tx=0).stop 2024-09-10T20:55:47.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.806+0000 7fc3daa00640 1 -- 172.21.15.6:0/63526705 shutdown_connections 2024-09-10T20:55:47.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.806+0000 7fc3daa00640 1 --2- 172.21.15.6:0/63526705 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fc3b0077f70 0x7fc3b007a430 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:47.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.806+0000 7fc3daa00640 1 --2- 172.21.15.6:0/63526705 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3d4162130 0x7fc3d406fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:47.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.806+0000 7fc3daa00640 1 --2- 172.21.15.6:0/63526705 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3d415bb30 0x7fc3d415a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:47.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.806+0000 7fc3daa00640 1 --2- 172.21.15.6:0/63526705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3d40caa40 0x7fc3d406e3f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:47.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.807+0000 7fc3daa00640 1 -- 172.21.15.6:0/63526705 >> 172.21.15.6:0/63526705 conn(0x7fc3d40cfa20 msgr2=0x7fc3d4072540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:47.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.807+0000 7fc3daa00640 1 -- 172.21.15.6:0/63526705 shutdown_connections 2024-09-10T20:55:47.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.807+0000 7fc3daa00640 1 -- 172.21.15.6:0/63526705 wait complete. 2024-09-10T20:55:47.826 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T20:55:47.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.983+0000 7efc56600640 1 -- 172.21.15.6:0/3064553136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc5006cde0 msgr2=0x7efc34003a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:47.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.983+0000 7efc56600640 1 --2- 172.21.15.6:0/3064553136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc5006cde0 0x7efc34003a00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7efc40009b80 tx=0x7efc34005830 comp rx=0 tx=0).stop 2024-09-10T20:55:47.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.983+0000 7efc4fe00640 1 -- 172.21.15.6:0/3064553136 reap_dead start 2024-09-10T20:55:47.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.983+0000 7efc56600640 1 -- 172.21.15.6:0/3064553136 shutdown_connections 2024-09-10T20:55:47.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.983+0000 7efc56600640 1 -- 172.21.15.6:0/3064553136 >> 172.21.15.6:0/3064553136 conn(0x7efc500b27c0 msgr2=0x7efc500b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:47.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.983+0000 7efc56600640 1 -- 172.21.15.6:0/3064553136 shutdown_connections 2024-09-10T20:55:47.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.983+0000 7efc56600640 1 -- 172.21.15.6:0/3064553136 wait complete. 2024-09-10T20:55:47.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.985+0000 7efc56600640 1 Processor -- start 2024-09-10T20:55:47.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.985+0000 7efc56600640 1 -- start start 2024-09-10T20:55:47.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.986+0000 7efc56600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc501f6fc0 0x7efc5014e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:47.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.986+0000 7efc56600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc500b4be0 0x7efc500b5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:47.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.986+0000 7efc56600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc5014c480 0x7efc5014c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:47.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.986+0000 7efc56600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7efc501618d0 con 0x7efc500b4be0 2024-09-10T20:55:47.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.986+0000 7efc56600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7efc500b4a10 con 0x7efc5014c480 2024-09-10T20:55:47.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.986+0000 7efc56600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7efc50161a50 con 0x7efc501f6fc0 2024-09-10T20:55:47.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.986+0000 7efc47e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc500b4be0 0x7efc500b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:47.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.986+0000 7efc47e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc500b4be0 0x7efc500b5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50948/0 (socket says 172.21.15.6:50948) 2024-09-10T20:55:47.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.986+0000 7efc47e00640 1 -- 172.21.15.6:0/332916367 learned_addr learned my addr 172.21.15.6:0/332916367 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:47.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.986+0000 7efc4fe00640 1 --2- 172.21.15.6:0/332916367 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc5014c480 0x7efc5014c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:47.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.986+0000 7efc4f400640 1 --2- 172.21.15.6:0/332916367 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc501f6fc0 0x7efc5014e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:47.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.986+0000 7efc47e00640 1 -- 172.21.15.6:0/332916367 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc501f6fc0 msgr2=0x7efc5014e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:47.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.986+0000 7efc47e00640 1 --2- 172.21.15.6:0/332916367 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc501f6fc0 0x7efc5014e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:47.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.986+0000 7efc47e00640 1 -- 172.21.15.6:0/332916367 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc5014c480 msgr2=0x7efc5014c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:47.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.986+0000 7efc47e00640 1 --2- 172.21.15.6:0/332916367 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc5014c480 0x7efc5014c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:47.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.986+0000 7efc47e00640 1 -- 172.21.15.6:0/332916367 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc500b55a0 con 0x7efc500b4be0 2024-09-10T20:55:47.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.986+0000 7efc4fe00640 1 --2- 172.21.15.6:0/332916367 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc5014c480 0x7efc5014c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:55:47.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.987+0000 7efc47e00640 1 --2- 172.21.15.6:0/332916367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc500b4be0 0x7efc500b5060 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efc38011b40 tx=0x7efc3800f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:47.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.987+0000 7efc47400640 1 -- 172.21.15.6:0/332916367 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc3800fe00 con 0x7efc500b4be0 2024-09-10T20:55:47.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.987+0000 7efc47400640 1 -- 172.21.15.6:0/332916367 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efc38004020 con 0x7efc500b4be0 2024-09-10T20:55:47.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.987+0000 7efc47400640 1 -- 172.21.15.6:0/332916367 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc38004450 con 0x7efc500b4be0 2024-09-10T20:55:47.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.987+0000 7efc56600640 1 -- 172.21.15.6:0/332916367 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc501f86e0 con 0x7efc500b4be0 2024-09-10T20:55:47.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.987+0000 7efc56600640 1 -- 172.21.15.6:0/332916367 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc501f7e40 con 0x7efc500b4be0 2024-09-10T20:55:47.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.988+0000 7efc56600640 1 -- 172.21.15.6:0/332916367 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc500718e0 con 0x7efc500b4be0 2024-09-10T20:55:47.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.989+0000 7efc47400640 1 -- 172.21.15.6:0/332916367 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7efc380035f0 con 0x7efc500b4be0 2024-09-10T20:55:47.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.990+0000 7efc47400640 1 --2- 172.21.15.6:0/332916367 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7efc2c077fa0 0x7efc2c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:47.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.990+0000 7efc47400640 1 -- 172.21.15.6:0/332916367 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7efc3809a930 con 0x7efc500b4be0 2024-09-10T20:55:47.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.991+0000 7efc4f400640 1 --2- 172.21.15.6:0/332916367 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7efc2c077fa0 0x7efc2c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:47.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.991+0000 7efc4f400640 1 --2- 172.21.15.6:0/332916367 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7efc2c077fa0 0x7efc2c07a460 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efc40035000 tx=0x7efc400046c0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:47.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:47.995+0000 7efc47400640 1 -- 172.21.15.6:0/332916367 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7efc38063420 con 0x7efc500b4be0 2024-09-10T20:55:48.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.187+0000 7efc56600640 1 -- 172.21.15.6:0/332916367 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efc50069730 con 0x7efc500b4be0 2024-09-10T20:55:48.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.188+0000 7efc47400640 1 -- 172.21.15.6:0/332916367 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16605 (secure 0 0 0) 0x7efc38062d20 con 0x7efc500b4be0 2024-09-10T20:55:48.192 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:55:48.193 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":22,"fsid":"9e04309e-61c3-4c78-82db-9576e465d98a","created":"2024-09-10T20:55:17.972466+0000","modified":"2024-09-10T20:55:45.353614+0000","last_up_change":"2024-09-10T20:55:32.392769+0000","last_in_change":"2024-09-10T20:55:22.232252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:55:33.196464+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:55:41.833420+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T20:55:42.749182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0918c5c8-a028-4987-bad2-406c412ec3f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6801","nonce":895515615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6803","nonce":895515615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6807","nonce":895515615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6805","nonce":895515615}]},"public_addr":"172.21.15.6:6801/895515615","cluster_addr":"172.21.15.6:6803/895515615","heartbeat_back_addr":"172.21.15.6:6807/895515615","heartbeat_front_addr":"172.21.15.6:6805/895515615","state":["exists","up"]},{"osd":1,"uuid":"415e9c78-c3d9-46d6-b277-348453f42155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6809","nonce":1129113250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6811","nonce":1129113250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6815","nonce":1129113250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6813","nonce":1129113250}]},"public_addr":"172.21.15.6:6809/1129113250","cluster_addr":"172.21.15.6:6811/1129113250","heartbeat_back_addr":"172.21.15.6:6815/1129113250","heartbeat_front_addr":"172.21.15.6:6813/1129113250","state":["exists","up"]},{"osd":2,"uuid":"763c1cf2-a43d-4c10-815d-eaf4a32afc1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6825","nonce":3847470051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6827","nonce":3847470051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6831","nonce":3847470051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6829","nonce":3847470051}]},"public_addr":"172.21.15.6:6825/3847470051","cluster_addr":"172.21.15.6:6827/3847470051","heartbeat_back_addr":"172.21.15.6:6831/3847470051","heartbeat_front_addr":"172.21.15.6:6829/3847470051","state":["exists","up"]},{"osd":3,"uuid":"877b1cc1-2434-4b32-af66-9c2485eac9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6817","nonce":3911674247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6819","nonce":3911674247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6823","nonce":3911674247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6821","nonce":3911674247}]},"public_addr":"172.21.15.6:6817/3911674247","cluster_addr":"172.21.15.6:6819/3911674247","heartbeat_back_addr":"172.21.15.6:6823/3911674247","heartbeat_front_addr":"172.21.15.6:6821/3911674247","state":["exists","up"]},{"osd":4,"uuid":"e0b27501-dfdc-4e7f-b73a-9573c869267a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6827","nonce":2568527750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6829","nonce":2568527750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6833","nonce":2568527750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6831","nonce":2568527750}]},"public_addr":"172.21.15.150:6827/2568527750","cluster_addr":"172.21.15.150:6829/2568527750","heartbeat_back_addr":"172.21.15.150:6833/2568527750","heartbeat_front_addr":"172.21.15.150:6831/2568527750","state":["exists","up"]},{"osd":5,"uuid":"67e48053-4f15-44fd-a30c-c9522f86d169","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6811","nonce":371417736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6813","nonce":371417736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6817","nonce":371417736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6815","nonce":371417736}]},"public_addr":"172.21.15.150:6811/371417736","cluster_addr":"172.21.15.150:6813/371417736","heartbeat_back_addr":"172.21.15.150:6817/371417736","heartbeat_front_addr":"172.21.15.150:6815/371417736","state":["exists","up"]},{"osd":6,"uuid":"1456df2e-ae91-45a4-bc3a-a06c753092af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6819","nonce":2329248366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6821","nonce":2329248366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6825","nonce":2329248366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6823","nonce":2329248366}]},"public_addr":"172.21.15.150:6819/2329248366","cluster_addr":"172.21.15.150:6821/2329248366","heartbeat_back_addr":"172.21.15.150:6825/2329248366","heartbeat_front_addr":"172.21.15.150:6823/2329248366","state":["exists","up"]},{"osd":7,"uuid":"a9daafcb-5ecd-43bd-ab0a-dc4b480cfc2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6803","nonce":527018351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6805","nonce":527018351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6809","nonce":527018351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6807","nonce":527018351}]},"public_addr":"172.21.15.150:6803/527018351","cluster_addr":"172.21.15.150:6805/527018351","heartbeat_back_addr":"172.21.15.150:6809/527018351","heartbeat_front_addr":"172.21.15.150:6807/527018351","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.710061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.024506+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.824320+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.431608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.637032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.054828+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.333290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.358875+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:55:48.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.191+0000 7efc56600640 1 -- 172.21.15.6:0/332916367 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7efc2c077fa0 msgr2=0x7efc2c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:48.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.191+0000 7efc56600640 1 --2- 172.21.15.6:0/332916367 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7efc2c077fa0 0x7efc2c07a460 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efc40035000 tx=0x7efc400046c0 comp rx=0 tx=0).stop 2024-09-10T20:55:48.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.191+0000 7efc56600640 1 -- 172.21.15.6:0/332916367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc500b4be0 msgr2=0x7efc500b5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:48.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.191+0000 7efc56600640 1 --2- 172.21.15.6:0/332916367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc500b4be0 0x7efc500b5060 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efc38011b40 tx=0x7efc3800f3c0 comp rx=0 tx=0).stop 2024-09-10T20:55:48.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.191+0000 7efc56600640 1 -- 172.21.15.6:0/332916367 shutdown_connections 2024-09-10T20:55:48.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.191+0000 7efc56600640 1 --2- 172.21.15.6:0/332916367 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7efc2c077fa0 0x7efc2c07a460 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:48.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.191+0000 7efc56600640 1 --2- 172.21.15.6:0/332916367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc500b4be0 0x7efc500b5060 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:48.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.191+0000 7efc56600640 1 --2- 172.21.15.6:0/332916367 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc5014c480 0x7efc5014c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:48.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.191+0000 7efc56600640 1 --2- 172.21.15.6:0/332916367 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc501f6fc0 0x7efc5014e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:48.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.191+0000 7efc56600640 1 -- 172.21.15.6:0/332916367 >> 172.21.15.6:0/332916367 conn(0x7efc500b27c0 msgr2=0x7efc500b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:48.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.191+0000 7efc56600640 1 -- 172.21.15.6:0/332916367 shutdown_connections 2024-09-10T20:55:48.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.191+0000 7efc56600640 1 -- 172.21.15.6:0/332916367 wait complete. 2024-09-10T20:55:48.210 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T20:55:48.210 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T20:55:48.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.366+0000 7f6f4f400640 1 -- 172.21.15.6:0/2956020434 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6f480cf340 msgr2=0x7f6f48161a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:48.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.366+0000 7f6f4f400640 1 --2- 172.21.15.6:0/2956020434 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6f480cf340 0x7f6f48161a20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6f30009860 tx=0x7f6f3002a5a0 comp rx=0 tx=0).stop 2024-09-10T20:55:48.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.366+0000 7f6f4f400640 1 -- 172.21.15.6:0/2956020434 shutdown_connections 2024-09-10T20:55:48.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.367+0000 7f6f4f400640 1 --2- 172.21.15.6:0/2956020434 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6f480cf340 0x7f6f48161a20 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:48.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.367+0000 7f6f4f400640 1 -- 172.21.15.6:0/2956020434 >> 172.21.15.6:0/2956020434 conn(0x7f6f480cfa20 msgr2=0x7f6f480cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:48.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.367+0000 7f6f4f400640 1 -- 172.21.15.6:0/2956020434 shutdown_connections 2024-09-10T20:55:48.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.367+0000 7f6f4f400640 1 -- 172.21.15.6:0/2956020434 wait complete. 2024-09-10T20:55:48.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.368+0000 7f6f4f400640 1 Processor -- start 2024-09-10T20:55:48.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.368+0000 7f6f4f400640 1 -- start start 2024-09-10T20:55:48.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.369+0000 7f6f4f400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f480cf340 0x7f6f48160d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:48.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.369+0000 7f6f4f400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f4815bb30 0x7f6f480b36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:48.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.369+0000 7f6f4f400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6f48161f60 0x7f6f4815d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:48.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.369+0000 7f6f4f400640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6f480ae320 con 0x7f6f480cf340 2024-09-10T20:55:48.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.369+0000 7f6f4f400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6f480ae1a0 con 0x7f6f4815bb30 2024-09-10T20:55:48.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.369+0000 7f6f4f400640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f6f480ae4a0 con 0x7f6f48161f60 2024-09-10T20:55:48.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.369+0000 7f6f4ca00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f480cf340 0x7f6f48160d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:48.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.370+0000 7f6f4ca00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f480cf340 0x7f6f48160d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50958/0 (socket says 172.21.15.6:50958) 2024-09-10T20:55:48.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.370+0000 7f6f4ca00640 1 -- 172.21.15.6:0/1500178107 learned_addr learned my addr 172.21.15.6:0/1500178107 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:48.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.370+0000 7f6f3fe00640 1 --2- 172.21.15.6:0/1500178107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f4815bb30 0x7f6f480b36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:48.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.370+0000 7f6f4d400640 1 --2- 172.21.15.6:0/1500178107 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6f48161f60 0x7f6f4815d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:48.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.370+0000 7f6f4ca00640 1 -- 172.21.15.6:0/1500178107 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6f48161f60 msgr2=0x7f6f4815d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:48.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.370+0000 7f6f4ca00640 1 --2- 172.21.15.6:0/1500178107 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6f48161f60 0x7f6f4815d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:48.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.370+0000 7f6f4ca00640 1 -- 172.21.15.6:0/1500178107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f4815bb30 msgr2=0x7f6f480b36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:48.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.370+0000 7f6f4ca00640 1 --2- 172.21.15.6:0/1500178107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f4815bb30 0x7f6f480b36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:48.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.370+0000 7f6f4ca00640 1 -- 172.21.15.6:0/1500178107 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f481f4f30 con 0x7f6f480cf340 2024-09-10T20:55:48.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.370+0000 7f6f4ca00640 1 --2- 172.21.15.6:0/1500178107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f480cf340 0x7f6f48160d30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6f3800c490 tx=0x7f6f3800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:48.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.371+0000 7f6f45600640 1 -- 172.21.15.6:0/1500178107 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f380052d0 con 0x7f6f480cf340 2024-09-10T20:55:48.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.371+0000 7f6f45600640 1 -- 172.21.15.6:0/1500178107 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f38005490 con 0x7f6f480cf340 2024-09-10T20:55:48.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.371+0000 7f6f45600640 1 -- 172.21.15.6:0/1500178107 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f38012890 con 0x7f6f480cf340 2024-09-10T20:55:48.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.371+0000 7f6f4f400640 1 -- 172.21.15.6:0/1500178107 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f481f5270 con 0x7f6f480cf340 2024-09-10T20:55:48.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.371+0000 7f6f4f400640 1 -- 172.21.15.6:0/1500178107 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f480b31c0 con 0x7f6f480cf340 2024-09-10T20:55:48.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.372+0000 7f6f4f400640 1 -- 172.21.15.6:0/1500178107 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f480ae900 con 0x7f6f480cf340 2024-09-10T20:55:48.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.373+0000 7f6f45600640 1 -- 172.21.15.6:0/1500178107 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6f38012a30 con 0x7f6f480cf340 2024-09-10T20:55:48.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.374+0000 7f6f45600640 1 --2- 172.21.15.6:0/1500178107 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6f24077f70 0x7f6f2407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:48.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.374+0000 7f6f45600640 1 -- 172.21.15.6:0/1500178107 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f6f380997f0 con 0x7f6f480cf340 2024-09-10T20:55:48.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.375+0000 7f6f3fe00640 1 --2- 172.21.15.6:0/1500178107 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6f24077f70 0x7f6f2407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:48.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.375+0000 7f6f3fe00640 1 --2- 172.21.15.6:0/1500178107 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6f24077f70 0x7f6f2407a430 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6f30034000 tx=0x7f6f30004730 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:48.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.380+0000 7f6f45600640 1 -- 172.21.15.6:0/1500178107 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f6f481f5270 con 0x7f6f480cf340 2024-09-10T20:55:48.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.571+0000 7f6f4f400640 1 -- 172.21.15.6:0/1500178107 --> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6f48069d20 con 0x7f6f24077f70 2024-09-10T20:55:48.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.577+0000 7f6f45600640 1 -- 172.21.15.6:0/1500178107 <== mgr.4120 v2:172.21.15.150:6800/1238179351 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241810 (secure 0 0 0) 0x7f6f48069d20 con 0x7f6f24077f70 2024-09-10T20:55:48.583 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:55:48.585 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-10T20:55:48.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.580+0000 7f6f4f400640 1 -- 172.21.15.6:0/1500178107 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6f24077f70 msgr2=0x7f6f2407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:48.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.581+0000 7f6f4f400640 1 --2- 172.21.15.6:0/1500178107 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6f24077f70 0x7f6f2407a430 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6f30034000 tx=0x7f6f30004730 comp rx=0 tx=0).stop 2024-09-10T20:55:48.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.581+0000 7f6f4f400640 1 -- 172.21.15.6:0/1500178107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f480cf340 msgr2=0x7f6f48160d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:48.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.581+0000 7f6f4f400640 1 --2- 172.21.15.6:0/1500178107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f480cf340 0x7f6f48160d30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6f3800c490 tx=0x7f6f3800c950 comp rx=0 tx=0).stop 2024-09-10T20:55:48.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.581+0000 7f6f4f400640 1 -- 172.21.15.6:0/1500178107 shutdown_connections 2024-09-10T20:55:48.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.581+0000 7f6f4f400640 1 --2- 172.21.15.6:0/1500178107 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6f24077f70 0x7f6f2407a430 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:48.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.581+0000 7f6f4f400640 1 --2- 172.21.15.6:0/1500178107 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6f48161f60 0x7f6f4815d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:48.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.581+0000 7f6f4f400640 1 --2- 172.21.15.6:0/1500178107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f4815bb30 0x7f6f480b36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:48.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.581+0000 7f6f4f400640 1 --2- 172.21.15.6:0/1500178107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f480cf340 0x7f6f48160d30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:48.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.581+0000 7f6f4f400640 1 -- 172.21.15.6:0/1500178107 >> 172.21.15.6:0/1500178107 conn(0x7f6f480cfa20 msgr2=0x7f6f48072840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:48.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.581+0000 7f6f4f400640 1 -- 172.21.15.6:0/1500178107 shutdown_connections 2024-09-10T20:55:48.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.581+0000 7f6f4f400640 1 -- 172.21.15.6:0/1500178107 wait complete. 2024-09-10T20:55:48.600 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-10T20:55:47.171906+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":88,"acting":88,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219064,"kb_used_data":2576,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755656,"statfs":{"total":773094113280,"available":772869791744,"internally_reserved":0,"allocated":2637824,"data_stored":1628761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.834359"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.382446+0000","last_change":"2024-09-10T20:55:44.374342+0000","last_active":"2024-09-10T20:55:44.382446+0000","last_peered":"2024-09-10T20:55:44.382446+0000","last_clean":"2024-09-10T20:55:44.382446+0000","last_became_active":"2024-09-10T20:55:44.373477+0000","last_became_peered":"2024-09-10T20:55:44.373477+0000","last_unstale":"2024-09-10T20:55:44.382446+0000","last_undegraded":"2024-09-10T20:55:44.382446+0000","last_fullsized":"2024-09-10T20:55:44.382446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:26:18.554273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.386716+0000","last_change":"2024-09-10T20:55:44.380947+0000","last_active":"2024-09-10T20:55:44.386716+0000","last_peered":"2024-09-10T20:55:44.386716+0000","last_clean":"2024-09-10T20:55:44.386716+0000","last_became_active":"2024-09-10T20:55:44.380246+0000","last_became_peered":"2024-09-10T20:55:44.380246+0000","last_unstale":"2024-09-10T20:55:44.386716+0000","last_undegraded":"2024-09-10T20:55:44.386716+0000","last_fullsized":"2024-09-10T20:55:44.386716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:19:22.962575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.379972+0000","last_change":"2024-09-10T20:55:44.372460+0000","last_active":"2024-09-10T20:55:44.379972+0000","last_peered":"2024-09-10T20:55:44.379972+0000","last_clean":"2024-09-10T20:55:44.379972+0000","last_became_active":"2024-09-10T20:55:44.372166+0000","last_became_peered":"2024-09-10T20:55:44.372166+0000","last_unstale":"2024-09-10T20:55:44.379972+0000","last_undegraded":"2024-09-10T20:55:44.379972+0000","last_fullsized":"2024-09-10T20:55:44.379972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:41.531837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.383114+0000","last_change":"2024-09-10T20:55:44.379140+0000","last_active":"2024-09-10T20:55:44.383114+0000","last_peered":"2024-09-10T20:55:44.383114+0000","last_clean":"2024-09-10T20:55:44.383114+0000","last_became_active":"2024-09-10T20:55:44.378867+0000","last_became_peered":"2024-09-10T20:55:44.378867+0000","last_unstale":"2024-09-10T20:55:44.383114+0000","last_undegraded":"2024-09-10T20:55:44.383114+0000","last_fullsized":"2024-09-10T20:55:44.383114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:15:31.022675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.386702+0000","last_change":"2024-09-10T20:55:44.380864+0000","last_active":"2024-09-10T20:55:44.386702+0000","last_peered":"2024-09-10T20:55:44.386702+0000","last_clean":"2024-09-10T20:55:44.386702+0000","last_became_active":"2024-09-10T20:55:44.380634+0000","last_became_peered":"2024-09-10T20:55:44.380634+0000","last_unstale":"2024-09-10T20:55:44.386702+0000","last_undegraded":"2024-09-10T20:55:44.386702+0000","last_fullsized":"2024-09-10T20:55:44.386702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:58:46.746674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.383609+0000","last_change":"2024-09-10T20:55:43.368822+0000","last_active":"2024-09-10T20:55:44.383609+0000","last_peered":"2024-09-10T20:55:44.383609+0000","last_clean":"2024-09-10T20:55:44.383609+0000","last_became_active":"2024-09-10T20:55:43.368565+0000","last_became_peered":"2024-09-10T20:55:43.368565+0000","last_unstale":"2024-09-10T20:55:44.383609+0000","last_undegraded":"2024-09-10T20:55:44.383609+0000","last_fullsized":"2024-09-10T20:55:44.383609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:23:19.583021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.343373+0000","last_change":"2024-09-10T20:55:42.343373+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.343373+0000","last_undegraded":"2024-09-10T20:55:42.343373+0000","last_fullsized":"2024-09-10T20:55:42.343373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.368340+0000","last_change":"2024-09-10T20:55:43.370997+0000","last_active":"2024-09-10T20:55:44.368340+0000","last_peered":"2024-09-10T20:55:44.368340+0000","last_clean":"2024-09-10T20:55:44.368340+0000","last_became_active":"2024-09-10T20:55:43.370753+0000","last_became_peered":"2024-09-10T20:55:43.370753+0000","last_unstale":"2024-09-10T20:55:44.368340+0000","last_undegraded":"2024-09-10T20:55:44.368340+0000","last_fullsized":"2024-09-10T20:55:44.368340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:04:30.007942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.386755+0000","last_change":"2024-09-10T20:55:44.381520+0000","last_active":"2024-09-10T20:55:44.386755+0000","last_peered":"2024-09-10T20:55:44.386755+0000","last_clean":"2024-09-10T20:55:44.386755+0000","last_became_active":"2024-09-10T20:55:44.381184+0000","last_became_peered":"2024-09-10T20:55:44.381184+0000","last_unstale":"2024-09-10T20:55:44.386755+0000","last_undegraded":"2024-09-10T20:55:44.386755+0000","last_fullsized":"2024-09-10T20:55:44.386755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:10:56.591857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.340154+0000","last_change":"2024-09-10T20:55:42.340154+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.340154+0000","last_undegraded":"2024-09-10T20:55:42.340154+0000","last_fullsized":"2024-09-10T20:55:42.340154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.344157+0000","last_change":"2024-09-10T20:55:42.344157+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.344157+0000","last_undegraded":"2024-09-10T20:55:42.344157+0000","last_fullsized":"2024-09-10T20:55:42.344157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.340400+0000","last_change":"2024-09-10T20:55:42.340400+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.340400+0000","last_undegraded":"2024-09-10T20:55:42.340400+0000","last_fullsized":"2024-09-10T20:55:42.340400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.346457+0000","last_change":"2024-09-10T20:55:42.346457+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.346457+0000","last_undegraded":"2024-09-10T20:55:42.346457+0000","last_fullsized":"2024-09-10T20:55:42.346457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.343356+0000","last_change":"2024-09-10T20:55:42.343356+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.343356+0000","last_undegraded":"2024-09-10T20:55:42.343356+0000","last_fullsized":"2024-09-10T20:55:42.343356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.343047+0000","last_change":"2024-09-10T20:55:42.343047+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.343047+0000","last_undegraded":"2024-09-10T20:55:42.343047+0000","last_fullsized":"2024-09-10T20:55:42.343047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.341093+0000","last_change":"2024-09-10T20:55:42.341093+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.341093+0000","last_undegraded":"2024-09-10T20:55:42.341093+0000","last_fullsized":"2024-09-10T20:55:42.341093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.343360+0000","last_change":"2024-09-10T20:55:42.343360+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.343360+0000","last_undegraded":"2024-09-10T20:55:42.343360+0000","last_fullsized":"2024-09-10T20:55:42.343360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.340123+0000","last_change":"2024-09-10T20:55:42.340123+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.340123+0000","last_undegraded":"2024-09-10T20:55:42.340123+0000","last_fullsized":"2024-09-10T20:55:42.340123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.340462+0000","last_change":"2024-09-10T20:55:42.340462+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.340462+0000","last_undegraded":"2024-09-10T20:55:42.340462+0000","last_fullsized":"2024-09-10T20:55:42.340462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.340019+0000","last_change":"2024-09-10T20:55:42.340019+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.340019+0000","last_undegraded":"2024-09-10T20:55:42.340019+0000","last_fullsized":"2024-09-10T20:55:42.340019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.344228+0000","last_change":"2024-09-10T20:55:42.344228+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.344228+0000","last_undegraded":"2024-09-10T20:55:42.344228+0000","last_fullsized":"2024-09-10T20:55:42.344228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.339945+0000","last_change":"2024-09-10T20:55:42.339945+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.339945+0000","last_undegraded":"2024-09-10T20:55:42.339945+0000","last_fullsized":"2024-09-10T20:55:42.339945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":105,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-10T20:55:42.348989+0000","last_change":"2024-09-10T20:55:34.718784+0000","last_active":"2024-09-10T20:55:42.348989+0000","last_peered":"2024-09-10T20:55:42.348989+0000","last_clean":"2024-09-10T20:55:42.348989+0000","last_became_active":"2024-09-10T20:55:34.717616+0000","last_became_peered":"2024-09-10T20:55:34.717616+0000","last_unstale":"2024-09-10T20:55:42.348989+0000","last_undegraded":"2024-09-10T20:55:42.348989+0000","last_fullsized":"2024-09-10T20:55:42.348989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:33.618098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:33.618098+0000","last_clean_scrub_stamp":"2024-09-10T20:55:33.618098+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:17.442729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.340179+0000","last_change":"2024-09-10T20:55:42.340179+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.340179+0000","last_undegraded":"2024-09-10T20:55:42.340179+0000","last_fullsized":"2024-09-10T20:55:42.340179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.386749+0000","last_change":"2024-09-10T20:55:44.373563+0000","last_active":"2024-09-10T20:55:44.386749+0000","last_peered":"2024-09-10T20:55:44.386749+0000","last_clean":"2024-09-10T20:55:44.386749+0000","last_became_active":"2024-09-10T20:55:44.373244+0000","last_became_peered":"2024-09-10T20:55:44.373244+0000","last_unstale":"2024-09-10T20:55:44.386749+0000","last_undegraded":"2024-09-10T20:55:44.386749+0000","last_fullsized":"2024-09-10T20:55:44.386749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:29:12.552642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.347043+0000","last_change":"2024-09-10T20:55:42.347043+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.347043+0000","last_undegraded":"2024-09-10T20:55:42.347043+0000","last_fullsized":"2024-09-10T20:55:42.347043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.340568+0000","last_change":"2024-09-10T20:55:42.340568+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.340568+0000","last_undegraded":"2024-09-10T20:55:42.340568+0000","last_fullsized":"2024-09-10T20:55:42.340568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.340241+0000","last_change":"2024-09-10T20:55:42.340241+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.340241+0000","last_undegraded":"2024-09-10T20:55:42.340241+0000","last_fullsized":"2024-09-10T20:55:42.340241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.345830+0000","last_change":"2024-09-10T20:55:42.345830+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.345830+0000","last_undegraded":"2024-09-10T20:55:42.345830+0000","last_fullsized":"2024-09-10T20:55:42.345830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.347873+0000","last_change":"2024-09-10T20:55:42.347873+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.347873+0000","last_undegraded":"2024-09-10T20:55:42.347873+0000","last_fullsized":"2024-09-10T20:55:42.347873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.347245+0000","last_change":"2024-09-10T20:55:42.347245+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.347245+0000","last_undegraded":"2024-09-10T20:55:42.347245+0000","last_fullsized":"2024-09-10T20:55:42.347245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.382754+0000","last_change":"2024-09-10T20:55:44.378521+0000","last_active":"2024-09-10T20:55:44.382754+0000","last_peered":"2024-09-10T20:55:44.382754+0000","last_clean":"2024-09-10T20:55:44.382754+0000","last_became_active":"2024-09-10T20:55:44.378187+0000","last_became_peered":"2024-09-10T20:55:44.378187+0000","last_unstale":"2024-09-10T20:55:44.382754+0000","last_undegraded":"2024-09-10T20:55:44.382754+0000","last_fullsized":"2024-09-10T20:55:44.382754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:49:43.068621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.343367+0000","last_change":"2024-09-10T20:55:42.343367+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.343367+0000","last_undegraded":"2024-09-10T20:55:42.343367+0000","last_fullsized":"2024-09-10T20:55:42.343367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.348516+0000","last_change":"2024-09-10T20:55:42.348516+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.348516+0000","last_undegraded":"2024-09-10T20:55:42.348516+0000","last_fullsized":"2024-09-10T20:55:42.348516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.345021+0000","last_change":"2024-09-10T20:55:42.345021+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.345021+0000","last_undegraded":"2024-09-10T20:55:42.345021+0000","last_fullsized":"2024-09-10T20:55:42.345021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.379310+0000","last_change":"2024-09-10T20:55:44.368404+0000","last_active":"2024-09-10T20:55:44.379310+0000","last_peered":"2024-09-10T20:55:44.379310+0000","last_clean":"2024-09-10T20:55:44.379310+0000","last_became_active":"2024-09-10T20:55:44.368024+0000","last_became_peered":"2024-09-10T20:55:44.368024+0000","last_unstale":"2024-09-10T20:55:44.379310+0000","last_undegraded":"2024-09-10T20:55:44.379310+0000","last_fullsized":"2024-09-10T20:55:44.379310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:02:45.844722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.344811+0000","last_change":"2024-09-10T20:55:42.344811+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.344811+0000","last_undegraded":"2024-09-10T20:55:42.344811+0000","last_fullsized":"2024-09-10T20:55:42.344811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.391718+0000","last_change":"2024-09-10T20:55:44.390140+0000","last_active":"2024-09-10T20:55:44.391718+0000","last_peered":"2024-09-10T20:55:44.391718+0000","last_clean":"2024-09-10T20:55:44.391718+0000","last_became_active":"2024-09-10T20:55:44.389852+0000","last_became_peered":"2024-09-10T20:55:44.389852+0000","last_unstale":"2024-09-10T20:55:44.391718+0000","last_undegraded":"2024-09-10T20:55:44.391718+0000","last_fullsized":"2024-09-10T20:55:44.391718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:39:27.469734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.347181+0000","last_change":"2024-09-10T20:55:42.347181+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.347181+0000","last_undegraded":"2024-09-10T20:55:42.347181+0000","last_fullsized":"2024-09-10T20:55:42.347181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.347531+0000","last_change":"2024-09-10T20:55:42.347531+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.347531+0000","last_undegraded":"2024-09-10T20:55:42.347531+0000","last_fullsized":"2024-09-10T20:55:42.347531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.348513+0000","last_change":"2024-09-10T20:55:42.348513+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.348513+0000","last_undegraded":"2024-09-10T20:55:42.348513+0000","last_fullsized":"2024-09-10T20:55:42.348513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.387283+0000","last_change":"2024-09-10T20:55:43.361529+0000","last_active":"2024-09-10T20:55:44.387283+0000","last_peered":"2024-09-10T20:55:44.387283+0000","last_clean":"2024-09-10T20:55:44.387283+0000","last_became_active":"2024-09-10T20:55:43.361270+0000","last_became_peered":"2024-09-10T20:55:43.361270+0000","last_unstale":"2024-09-10T20:55:44.387283+0000","last_undegraded":"2024-09-10T20:55:44.387283+0000","last_fullsized":"2024-09-10T20:55:44.387283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:26:10.795588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.382609+0000","last_change":"2024-09-10T20:55:44.378339+0000","last_active":"2024-09-10T20:55:44.382609+0000","last_peered":"2024-09-10T20:55:44.382609+0000","last_clean":"2024-09-10T20:55:44.382609+0000","last_became_active":"2024-09-10T20:55:44.378051+0000","last_became_peered":"2024-09-10T20:55:44.378051+0000","last_unstale":"2024-09-10T20:55:44.382609+0000","last_undegraded":"2024-09-10T20:55:44.382609+0000","last_fullsized":"2024-09-10T20:55:44.382609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:47.381553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.343047+0000","last_change":"2024-09-10T20:55:42.343047+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.343047+0000","last_undegraded":"2024-09-10T20:55:42.343047+0000","last_fullsized":"2024-09-10T20:55:42.343047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":22,"acting":22,"num_store_stats":1},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":778240,"data_stored":648174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":57806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":172032,"data_stored":51989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":51989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":172032,"data_stored":51989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":51989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509443,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":765952,"data_stored":642357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":72468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T20:55:48.605 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T20:55:48.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.797+0000 7fbc0fe00640 1 -- 172.21.15.6:0/607853126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc10161930 msgr2=0x7fbc10161d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:48.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.797+0000 7fbc0fe00640 1 --2- 172.21.15.6:0/607853126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc10161930 0x7fbc10161d10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbc1008e0b0 tx=0x7fbc0802aac0 comp rx=0 tx=0).stop 2024-09-10T20:55:48.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.797+0000 7fbc0fe00640 1 -- 172.21.15.6:0/607853126 shutdown_connections 2024-09-10T20:55:48.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.797+0000 7fbc0fe00640 1 --2- 172.21.15.6:0/607853126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc10161930 0x7fbc10161d10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:48.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.797+0000 7fbc0fe00640 1 --2- 172.21.15.6:0/607853126 >> v2:172.21.15.150:3300/0 conn(0x7fbc1015dc90 0x7fbc100d46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:48.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.797+0000 7fbc0fe00640 1 -- 172.21.15.6:0/607853126 >> 172.21.15.6:0/607853126 conn(0x7fbc1009d0a0 msgr2=0x7fbc100d3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:48.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.797+0000 7fbc0fe00640 1 -- 172.21.15.6:0/607853126 shutdown_connections 2024-09-10T20:55:48.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.797+0000 7fbc0fe00640 1 -- 172.21.15.6:0/607853126 wait complete. 2024-09-10T20:55:48.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.798+0000 7fbc0fe00640 1 Processor -- start 2024-09-10T20:55:48.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.799+0000 7fbc0fe00640 1 -- start start 2024-09-10T20:55:48.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.799+0000 7fbc0fe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc100cf380 0x7fbc100cd930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:48.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.799+0000 7fbc0fe00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc1015dc90 0x7fbc1015f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:48.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.799+0000 7fbc0fe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc10161930 0x7fbc1015f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:48.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.799+0000 7fbc0fe00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbc100d2d70 con 0x7fbc10161930 2024-09-10T20:55:48.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.799+0000 7fbc0fe00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1015e280 con 0x7fbc100cf380 2024-09-10T20:55:48.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.799+0000 7fbc0fe00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fbc100b3350 con 0x7fbc1015dc90 2024-09-10T20:55:48.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.800+0000 7fbc0f400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc10161930 0x7fbc1015f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:48.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.800+0000 7fbc0f400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc10161930 0x7fbc1015f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50966/0 (socket says 172.21.15.6:50966) 2024-09-10T20:55:48.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.800+0000 7fbc0f400640 1 -- 172.21.15.6:0/3307154073 learned_addr learned my addr 172.21.15.6:0/3307154073 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:48.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.800+0000 7fbc0ea00640 1 --2- 172.21.15.6:0/3307154073 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc100cf380 0x7fbc100cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:48.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.800+0000 7fbc0e000640 1 --2- 172.21.15.6:0/3307154073 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc1015dc90 0x7fbc1015f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:48.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.800+0000 7fbc0f400640 1 -- 172.21.15.6:0/3307154073 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc1015dc90 msgr2=0x7fbc1015f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:48.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.800+0000 7fbc0f400640 1 --2- 172.21.15.6:0/3307154073 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc1015dc90 0x7fbc1015f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:48.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.800+0000 7fbc0f400640 1 -- 172.21.15.6:0/3307154073 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc100cf380 msgr2=0x7fbc100cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:48.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.800+0000 7fbc0f400640 1 --2- 172.21.15.6:0/3307154073 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc100cf380 0x7fbc100cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:48.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.800+0000 7fbc0f400640 1 -- 172.21.15.6:0/3307154073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc100b6f10 con 0x7fbc10161930 2024-09-10T20:55:48.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.800+0000 7fbc0f400640 1 --2- 172.21.15.6:0/3307154073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc10161930 0x7fbc1015f9c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbc08009d60 tx=0x7fbc08003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:48.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.801+0000 7fbc06a00640 1 -- 172.21.15.6:0/3307154073 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc08044070 con 0x7fbc10161930 2024-09-10T20:55:48.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.801+0000 7fbc06a00640 1 -- 172.21.15.6:0/3307154073 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbc08004040 con 0x7fbc10161930 2024-09-10T20:55:48.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.801+0000 7fbc0fe00640 1 -- 172.21.15.6:0/3307154073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc100b71f0 con 0x7fbc10161930 2024-09-10T20:55:48.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.801+0000 7fbc06a00640 1 -- 172.21.15.6:0/3307154073 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc08004470 con 0x7fbc10161930 2024-09-10T20:55:48.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.801+0000 7fbc0fe00640 1 -- 172.21.15.6:0/3307154073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc100cb2b0 con 0x7fbc10161930 2024-09-10T20:55:48.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.802+0000 7fbc0fe00640 1 -- 172.21.15.6:0/3307154073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc10069d10 con 0x7fbc10161930 2024-09-10T20:55:48.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.803+0000 7fbc06a00640 1 -- 172.21.15.6:0/3307154073 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fbc08004610 con 0x7fbc10161930 2024-09-10T20:55:48.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.804+0000 7fbc06a00640 1 --2- 172.21.15.6:0/3307154073 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbbf0077f70 0x7fbbf007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:48.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.804+0000 7fbc06a00640 1 -- 172.21.15.6:0/3307154073 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fbc080ba2a0 con 0x7fbc10161930 2024-09-10T20:55:48.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.804+0000 7fbc0ea00640 1 --2- 172.21.15.6:0/3307154073 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbbf0077f70 0x7fbbf007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:48.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.805+0000 7fbc0ea00640 1 --2- 172.21.15.6:0/3307154073 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbbf0077f70 0x7fbbf007a430 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbc00009b60 tx=0x7fbc00005f90 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:48.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:48.808+0000 7fbc06a00640 1 -- 172.21.15.6:0/3307154073 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fbc08032030 con 0x7fbc10161930 2024-09-10T20:55:49.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.002+0000 7fbc0fe00640 1 -- 172.21.15.6:0/3307154073 --> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbc10161560 con 0x7fbbf0077f70 2024-09-10T20:55:49.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.007+0000 7fbc06a00640 1 -- 172.21.15.6:0/3307154073 <== mgr.4120 v2:172.21.15.150:6800/1238179351 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241810 (secure 0 0 0) 0x7fbc10161560 con 0x7fbbf0077f70 2024-09-10T20:55:49.013 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:55:49.014 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-10T20:55:49.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.011+0000 7fbc0fe00640 1 -- 172.21.15.6:0/3307154073 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbbf0077f70 msgr2=0x7fbbf007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:49.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.011+0000 7fbc0fe00640 1 --2- 172.21.15.6:0/3307154073 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbbf0077f70 0x7fbbf007a430 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbc00009b60 tx=0x7fbc00005f90 comp rx=0 tx=0).stop 2024-09-10T20:55:49.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.011+0000 7fbc0fe00640 1 -- 172.21.15.6:0/3307154073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc10161930 msgr2=0x7fbc1015f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:49.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.011+0000 7fbc0fe00640 1 --2- 172.21.15.6:0/3307154073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc10161930 0x7fbc1015f9c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbc08009d60 tx=0x7fbc08003c10 comp rx=0 tx=0).stop 2024-09-10T20:55:49.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.011+0000 7fbc0fe00640 1 -- 172.21.15.6:0/3307154073 shutdown_connections 2024-09-10T20:55:49.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.011+0000 7fbc0fe00640 1 --2- 172.21.15.6:0/3307154073 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbbf0077f70 0x7fbbf007a430 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:49.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.011+0000 7fbc0fe00640 1 --2- 172.21.15.6:0/3307154073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc10161930 0x7fbc1015f9c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:49.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.011+0000 7fbc0fe00640 1 --2- 172.21.15.6:0/3307154073 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc1015dc90 0x7fbc1015f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:49.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.011+0000 7fbc0fe00640 1 --2- 172.21.15.6:0/3307154073 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc100cf380 0x7fbc100cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:49.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.011+0000 7fbc0fe00640 1 -- 172.21.15.6:0/3307154073 >> 172.21.15.6:0/3307154073 conn(0x7fbc1009d0a0 msgr2=0x7fbc100b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:49.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.011+0000 7fbc0fe00640 1 -- 172.21.15.6:0/3307154073 shutdown_connections 2024-09-10T20:55:49.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.011+0000 7fbc0fe00640 1 -- 172.21.15.6:0/3307154073 wait complete. 2024-09-10T20:55:49.031 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-10T20:55:47.171906+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":88,"acting":88,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219064,"kb_used_data":2576,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755656,"statfs":{"total":773094113280,"available":772869791744,"internally_reserved":0,"allocated":2637824,"data_stored":1628761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.834359"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.382446+0000","last_change":"2024-09-10T20:55:44.374342+0000","last_active":"2024-09-10T20:55:44.382446+0000","last_peered":"2024-09-10T20:55:44.382446+0000","last_clean":"2024-09-10T20:55:44.382446+0000","last_became_active":"2024-09-10T20:55:44.373477+0000","last_became_peered":"2024-09-10T20:55:44.373477+0000","last_unstale":"2024-09-10T20:55:44.382446+0000","last_undegraded":"2024-09-10T20:55:44.382446+0000","last_fullsized":"2024-09-10T20:55:44.382446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:26:18.554273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.386716+0000","last_change":"2024-09-10T20:55:44.380947+0000","last_active":"2024-09-10T20:55:44.386716+0000","last_peered":"2024-09-10T20:55:44.386716+0000","last_clean":"2024-09-10T20:55:44.386716+0000","last_became_active":"2024-09-10T20:55:44.380246+0000","last_became_peered":"2024-09-10T20:55:44.380246+0000","last_unstale":"2024-09-10T20:55:44.386716+0000","last_undegraded":"2024-09-10T20:55:44.386716+0000","last_fullsized":"2024-09-10T20:55:44.386716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:19:22.962575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.379972+0000","last_change":"2024-09-10T20:55:44.372460+0000","last_active":"2024-09-10T20:55:44.379972+0000","last_peered":"2024-09-10T20:55:44.379972+0000","last_clean":"2024-09-10T20:55:44.379972+0000","last_became_active":"2024-09-10T20:55:44.372166+0000","last_became_peered":"2024-09-10T20:55:44.372166+0000","last_unstale":"2024-09-10T20:55:44.379972+0000","last_undegraded":"2024-09-10T20:55:44.379972+0000","last_fullsized":"2024-09-10T20:55:44.379972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:41.531837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.383114+0000","last_change":"2024-09-10T20:55:44.379140+0000","last_active":"2024-09-10T20:55:44.383114+0000","last_peered":"2024-09-10T20:55:44.383114+0000","last_clean":"2024-09-10T20:55:44.383114+0000","last_became_active":"2024-09-10T20:55:44.378867+0000","last_became_peered":"2024-09-10T20:55:44.378867+0000","last_unstale":"2024-09-10T20:55:44.383114+0000","last_undegraded":"2024-09-10T20:55:44.383114+0000","last_fullsized":"2024-09-10T20:55:44.383114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:15:31.022675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.386702+0000","last_change":"2024-09-10T20:55:44.380864+0000","last_active":"2024-09-10T20:55:44.386702+0000","last_peered":"2024-09-10T20:55:44.386702+0000","last_clean":"2024-09-10T20:55:44.386702+0000","last_became_active":"2024-09-10T20:55:44.380634+0000","last_became_peered":"2024-09-10T20:55:44.380634+0000","last_unstale":"2024-09-10T20:55:44.386702+0000","last_undegraded":"2024-09-10T20:55:44.386702+0000","last_fullsized":"2024-09-10T20:55:44.386702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:58:46.746674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.383609+0000","last_change":"2024-09-10T20:55:43.368822+0000","last_active":"2024-09-10T20:55:44.383609+0000","last_peered":"2024-09-10T20:55:44.383609+0000","last_clean":"2024-09-10T20:55:44.383609+0000","last_became_active":"2024-09-10T20:55:43.368565+0000","last_became_peered":"2024-09-10T20:55:43.368565+0000","last_unstale":"2024-09-10T20:55:44.383609+0000","last_undegraded":"2024-09-10T20:55:44.383609+0000","last_fullsized":"2024-09-10T20:55:44.383609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:23:19.583021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.343373+0000","last_change":"2024-09-10T20:55:42.343373+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.343373+0000","last_undegraded":"2024-09-10T20:55:42.343373+0000","last_fullsized":"2024-09-10T20:55:42.343373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.368340+0000","last_change":"2024-09-10T20:55:43.370997+0000","last_active":"2024-09-10T20:55:44.368340+0000","last_peered":"2024-09-10T20:55:44.368340+0000","last_clean":"2024-09-10T20:55:44.368340+0000","last_became_active":"2024-09-10T20:55:43.370753+0000","last_became_peered":"2024-09-10T20:55:43.370753+0000","last_unstale":"2024-09-10T20:55:44.368340+0000","last_undegraded":"2024-09-10T20:55:44.368340+0000","last_fullsized":"2024-09-10T20:55:44.368340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:04:30.007942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.386755+0000","last_change":"2024-09-10T20:55:44.381520+0000","last_active":"2024-09-10T20:55:44.386755+0000","last_peered":"2024-09-10T20:55:44.386755+0000","last_clean":"2024-09-10T20:55:44.386755+0000","last_became_active":"2024-09-10T20:55:44.381184+0000","last_became_peered":"2024-09-10T20:55:44.381184+0000","last_unstale":"2024-09-10T20:55:44.386755+0000","last_undegraded":"2024-09-10T20:55:44.386755+0000","last_fullsized":"2024-09-10T20:55:44.386755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:10:56.591857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.340154+0000","last_change":"2024-09-10T20:55:42.340154+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.340154+0000","last_undegraded":"2024-09-10T20:55:42.340154+0000","last_fullsized":"2024-09-10T20:55:42.340154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.344157+0000","last_change":"2024-09-10T20:55:42.344157+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.344157+0000","last_undegraded":"2024-09-10T20:55:42.344157+0000","last_fullsized":"2024-09-10T20:55:42.344157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.340400+0000","last_change":"2024-09-10T20:55:42.340400+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.340400+0000","last_undegraded":"2024-09-10T20:55:42.340400+0000","last_fullsized":"2024-09-10T20:55:42.340400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.346457+0000","last_change":"2024-09-10T20:55:42.346457+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.346457+0000","last_undegraded":"2024-09-10T20:55:42.346457+0000","last_fullsized":"2024-09-10T20:55:42.346457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.343356+0000","last_change":"2024-09-10T20:55:42.343356+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.343356+0000","last_undegraded":"2024-09-10T20:55:42.343356+0000","last_fullsized":"2024-09-10T20:55:42.343356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.343047+0000","last_change":"2024-09-10T20:55:42.343047+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.343047+0000","last_undegraded":"2024-09-10T20:55:42.343047+0000","last_fullsized":"2024-09-10T20:55:42.343047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.341093+0000","last_change":"2024-09-10T20:55:42.341093+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.341093+0000","last_undegraded":"2024-09-10T20:55:42.341093+0000","last_fullsized":"2024-09-10T20:55:42.341093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.343360+0000","last_change":"2024-09-10T20:55:42.343360+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.343360+0000","last_undegraded":"2024-09-10T20:55:42.343360+0000","last_fullsized":"2024-09-10T20:55:42.343360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.340123+0000","last_change":"2024-09-10T20:55:42.340123+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.340123+0000","last_undegraded":"2024-09-10T20:55:42.340123+0000","last_fullsized":"2024-09-10T20:55:42.340123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.340462+0000","last_change":"2024-09-10T20:55:42.340462+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.340462+0000","last_undegraded":"2024-09-10T20:55:42.340462+0000","last_fullsized":"2024-09-10T20:55:42.340462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.340019+0000","last_change":"2024-09-10T20:55:42.340019+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.340019+0000","last_undegraded":"2024-09-10T20:55:42.340019+0000","last_fullsized":"2024-09-10T20:55:42.340019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.344228+0000","last_change":"2024-09-10T20:55:42.344228+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.344228+0000","last_undegraded":"2024-09-10T20:55:42.344228+0000","last_fullsized":"2024-09-10T20:55:42.344228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.339945+0000","last_change":"2024-09-10T20:55:42.339945+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.339945+0000","last_undegraded":"2024-09-10T20:55:42.339945+0000","last_fullsized":"2024-09-10T20:55:42.339945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":105,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-10T20:55:42.348989+0000","last_change":"2024-09-10T20:55:34.718784+0000","last_active":"2024-09-10T20:55:42.348989+0000","last_peered":"2024-09-10T20:55:42.348989+0000","last_clean":"2024-09-10T20:55:42.348989+0000","last_became_active":"2024-09-10T20:55:34.717616+0000","last_became_peered":"2024-09-10T20:55:34.717616+0000","last_unstale":"2024-09-10T20:55:42.348989+0000","last_undegraded":"2024-09-10T20:55:42.348989+0000","last_fullsized":"2024-09-10T20:55:42.348989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:33.618098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:33.618098+0000","last_clean_scrub_stamp":"2024-09-10T20:55:33.618098+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:17.442729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.340179+0000","last_change":"2024-09-10T20:55:42.340179+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.340179+0000","last_undegraded":"2024-09-10T20:55:42.340179+0000","last_fullsized":"2024-09-10T20:55:42.340179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.386749+0000","last_change":"2024-09-10T20:55:44.373563+0000","last_active":"2024-09-10T20:55:44.386749+0000","last_peered":"2024-09-10T20:55:44.386749+0000","last_clean":"2024-09-10T20:55:44.386749+0000","last_became_active":"2024-09-10T20:55:44.373244+0000","last_became_peered":"2024-09-10T20:55:44.373244+0000","last_unstale":"2024-09-10T20:55:44.386749+0000","last_undegraded":"2024-09-10T20:55:44.386749+0000","last_fullsized":"2024-09-10T20:55:44.386749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:29:12.552642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.347043+0000","last_change":"2024-09-10T20:55:42.347043+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.347043+0000","last_undegraded":"2024-09-10T20:55:42.347043+0000","last_fullsized":"2024-09-10T20:55:42.347043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.340568+0000","last_change":"2024-09-10T20:55:42.340568+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.340568+0000","last_undegraded":"2024-09-10T20:55:42.340568+0000","last_fullsized":"2024-09-10T20:55:42.340568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.340241+0000","last_change":"2024-09-10T20:55:42.340241+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.340241+0000","last_undegraded":"2024-09-10T20:55:42.340241+0000","last_fullsized":"2024-09-10T20:55:42.340241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.345830+0000","last_change":"2024-09-10T20:55:42.345830+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.345830+0000","last_undegraded":"2024-09-10T20:55:42.345830+0000","last_fullsized":"2024-09-10T20:55:42.345830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.347873+0000","last_change":"2024-09-10T20:55:42.347873+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.347873+0000","last_undegraded":"2024-09-10T20:55:42.347873+0000","last_fullsized":"2024-09-10T20:55:42.347873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.347245+0000","last_change":"2024-09-10T20:55:42.347245+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.347245+0000","last_undegraded":"2024-09-10T20:55:42.347245+0000","last_fullsized":"2024-09-10T20:55:42.347245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.382754+0000","last_change":"2024-09-10T20:55:44.378521+0000","last_active":"2024-09-10T20:55:44.382754+0000","last_peered":"2024-09-10T20:55:44.382754+0000","last_clean":"2024-09-10T20:55:44.382754+0000","last_became_active":"2024-09-10T20:55:44.378187+0000","last_became_peered":"2024-09-10T20:55:44.378187+0000","last_unstale":"2024-09-10T20:55:44.382754+0000","last_undegraded":"2024-09-10T20:55:44.382754+0000","last_fullsized":"2024-09-10T20:55:44.382754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:49:43.068621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.343367+0000","last_change":"2024-09-10T20:55:42.343367+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.343367+0000","last_undegraded":"2024-09-10T20:55:42.343367+0000","last_fullsized":"2024-09-10T20:55:42.343367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.348516+0000","last_change":"2024-09-10T20:55:42.348516+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.348516+0000","last_undegraded":"2024-09-10T20:55:42.348516+0000","last_fullsized":"2024-09-10T20:55:42.348516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.345021+0000","last_change":"2024-09-10T20:55:42.345021+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.345021+0000","last_undegraded":"2024-09-10T20:55:42.345021+0000","last_fullsized":"2024-09-10T20:55:42.345021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.379310+0000","last_change":"2024-09-10T20:55:44.368404+0000","last_active":"2024-09-10T20:55:44.379310+0000","last_peered":"2024-09-10T20:55:44.379310+0000","last_clean":"2024-09-10T20:55:44.379310+0000","last_became_active":"2024-09-10T20:55:44.368024+0000","last_became_peered":"2024-09-10T20:55:44.368024+0000","last_unstale":"2024-09-10T20:55:44.379310+0000","last_undegraded":"2024-09-10T20:55:44.379310+0000","last_fullsized":"2024-09-10T20:55:44.379310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:02:45.844722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.344811+0000","last_change":"2024-09-10T20:55:42.344811+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.344811+0000","last_undegraded":"2024-09-10T20:55:42.344811+0000","last_fullsized":"2024-09-10T20:55:42.344811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.391718+0000","last_change":"2024-09-10T20:55:44.390140+0000","last_active":"2024-09-10T20:55:44.391718+0000","last_peered":"2024-09-10T20:55:44.391718+0000","last_clean":"2024-09-10T20:55:44.391718+0000","last_became_active":"2024-09-10T20:55:44.389852+0000","last_became_peered":"2024-09-10T20:55:44.389852+0000","last_unstale":"2024-09-10T20:55:44.391718+0000","last_undegraded":"2024-09-10T20:55:44.391718+0000","last_fullsized":"2024-09-10T20:55:44.391718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:39:27.469734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.347181+0000","last_change":"2024-09-10T20:55:42.347181+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.347181+0000","last_undegraded":"2024-09-10T20:55:42.347181+0000","last_fullsized":"2024-09-10T20:55:42.347181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.347531+0000","last_change":"2024-09-10T20:55:42.347531+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.347531+0000","last_undegraded":"2024-09-10T20:55:42.347531+0000","last_fullsized":"2024-09-10T20:55:42.347531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.348513+0000","last_change":"2024-09-10T20:55:42.348513+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.348513+0000","last_undegraded":"2024-09-10T20:55:42.348513+0000","last_fullsized":"2024-09-10T20:55:42.348513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:55:43.336062+0000","last_change":"2024-09-10T20:55:43.336062+0000","last_active":"2024-09-10T20:55:43.336062+0000","last_peered":"2024-09-10T20:55:43.336062+0000","last_clean":"2024-09-10T20:55:43.336062+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:43.336062+0000","last_undegraded":"2024-09-10T20:55:43.336062+0000","last_fullsized":"2024-09-10T20:55:43.336062+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.387283+0000","last_change":"2024-09-10T20:55:43.361529+0000","last_active":"2024-09-10T20:55:44.387283+0000","last_peered":"2024-09-10T20:55:44.387283+0000","last_clean":"2024-09-10T20:55:44.387283+0000","last_became_active":"2024-09-10T20:55:43.361270+0000","last_became_peered":"2024-09-10T20:55:43.361270+0000","last_unstale":"2024-09-10T20:55:44.387283+0000","last_undegraded":"2024-09-10T20:55:44.387283+0000","last_fullsized":"2024-09-10T20:55:44.387283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:26:10.795588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.382609+0000","last_change":"2024-09-10T20:55:44.378339+0000","last_active":"2024-09-10T20:55:44.382609+0000","last_peered":"2024-09-10T20:55:44.382609+0000","last_clean":"2024-09-10T20:55:44.382609+0000","last_became_active":"2024-09-10T20:55:44.378051+0000","last_became_peered":"2024-09-10T20:55:44.378051+0000","last_unstale":"2024-09-10T20:55:44.382609+0000","last_undegraded":"2024-09-10T20:55:44.382609+0000","last_fullsized":"2024-09-10T20:55:44.382609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:47.381553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-10T20:55:42.343047+0000","last_change":"2024-09-10T20:55:42.343047+0000","last_active":"2024-09-10T20:55:42.328981+0000","last_peered":"2024-09-10T20:55:42.328981+0000","last_clean":"2024-09-10T20:55:42.328981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:55:42.343047+0000","last_undegraded":"2024-09-10T20:55:42.343047+0000","last_fullsized":"2024-09-10T20:55:42.343047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":22,"acting":22,"num_store_stats":1},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":778240,"data_stored":648174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":57806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":172032,"data_stored":51989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":51989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":172032,"data_stored":51989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":51989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509443,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":765952,"data_stored":642357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":72468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T20:55:49.035 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T20:55:49.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.227+0000 7f3ffb600640 1 -- 172.21.15.6:0/4277357011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ff40af5a0 msgr2=0x7f3ff40aee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:49.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.227+0000 7f3ffb600640 1 --2- 172.21.15.6:0/4277357011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ff40af5a0 0x7f3ff40aee70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0005fd0 tx=0x7f3fe002a4a0 comp rx=0 tx=0).stop 2024-09-10T20:55:49.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.227+0000 7f3ffb600640 1 -- 172.21.15.6:0/4277357011 shutdown_connections 2024-09-10T20:55:49.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.227+0000 7f3ffb600640 1 --2- 172.21.15.6:0/4277357011 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ff40adb40 0x7f3ff40b2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:49.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.227+0000 7f3ffb600640 1 --2- 172.21.15.6:0/4277357011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ff40af5a0 0x7f3ff40aee70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:49.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.227+0000 7f3ffb600640 1 -- 172.21.15.6:0/4277357011 >> 172.21.15.6:0/4277357011 conn(0x7f3ff40cfe90 msgr2=0x7f3ff40d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:49.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.227+0000 7f3ffb600640 1 -- 172.21.15.6:0/4277357011 shutdown_connections 2024-09-10T20:55:49.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.227+0000 7f3ffb600640 1 -- 172.21.15.6:0/4277357011 wait complete. 2024-09-10T20:55:49.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.229+0000 7f3ffb600640 1 Processor -- start 2024-09-10T20:55:49.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.229+0000 7f3ffb600640 1 -- start start 2024-09-10T20:55:49.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.229+0000 7f3ffb600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ff40adb40 0x7f3ff414b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:49.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.230+0000 7f3ffb600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ff40af5a0 0x7f3ff40c9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:49.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.230+0000 7f3ffb600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ff415ad70 0x7f3ff415d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:49.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.230+0000 7f3ffb600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff40b3980 con 0x7f3ff415ad70 2024-09-10T20:55:49.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.230+0000 7f3ffb600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff40b3800 con 0x7f3ff40adb40 2024-09-10T20:55:49.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.230+0000 7f3ffb600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3ff40b3b00 con 0x7f3ff40af5a0 2024-09-10T20:55:49.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.230+0000 7f3ff9600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ff415ad70 0x7f3ff415d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:49.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.230+0000 7f3ff9600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ff415ad70 0x7f3ff415d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50986/0 (socket says 172.21.15.6:50986) 2024-09-10T20:55:49.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.230+0000 7f3ff9600640 1 -- 172.21.15.6:0/2470899046 learned_addr learned my addr 172.21.15.6:0/2470899046 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:49.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.230+0000 7f3ff3e00640 1 --2- 172.21.15.6:0/2470899046 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ff40af5a0 0x7f3ff40c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:49.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.230+0000 7f3ff8c00640 1 --2- 172.21.15.6:0/2470899046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ff40adb40 0x7f3ff414b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:49.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.230+0000 7f3ff9600640 1 -- 172.21.15.6:0/2470899046 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ff40af5a0 msgr2=0x7f3ff40c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:49.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.230+0000 7f3ff9600640 1 --2- 172.21.15.6:0/2470899046 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ff40af5a0 0x7f3ff40c9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:49.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.230+0000 7f3ff9600640 1 -- 172.21.15.6:0/2470899046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ff40adb40 msgr2=0x7f3ff414b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:49.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.230+0000 7f3ff9600640 1 --2- 172.21.15.6:0/2470899046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ff40adb40 0x7f3ff414b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:49.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.230+0000 7f3ff9600640 1 -- 172.21.15.6:0/2470899046 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ff41f5270 con 0x7f3ff415ad70 2024-09-10T20:55:49.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.230+0000 7f3ff8c00640 1 --2- 172.21.15.6:0/2470899046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ff40adb40 0x7f3ff414b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:55:49.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.231+0000 7f3ff9600640 1 --2- 172.21.15.6:0/2470899046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ff415ad70 0x7f3ff415d460 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3fec00cce0 tx=0x7f3fec00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:49.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.231+0000 7f3ff0c00640 1 -- 172.21.15.6:0/2470899046 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fec00f450 con 0x7f3ff415ad70 2024-09-10T20:55:49.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.231+0000 7f3ff0c00640 1 -- 172.21.15.6:0/2470899046 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3fec00f700 con 0x7f3ff415ad70 2024-09-10T20:55:49.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.231+0000 7f3ffb600640 1 -- 172.21.15.6:0/2470899046 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ff41f4660 con 0x7f3ff415ad70 2024-09-10T20:55:49.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.231+0000 7f3ff0c00640 1 -- 172.21.15.6:0/2470899046 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fec00fb50 con 0x7f3ff415ad70 2024-09-10T20:55:49.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.231+0000 7f3ffb600640 1 -- 172.21.15.6:0/2470899046 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ff41f4f00 con 0x7f3ff415ad70 2024-09-10T20:55:49.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.232+0000 7f3ffb600640 1 -- 172.21.15.6:0/2470899046 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ff40b4020 con 0x7f3ff415ad70 2024-09-10T20:55:49.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.233+0000 7f3ff0c00640 1 -- 172.21.15.6:0/2470899046 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3fec0213f0 con 0x7f3ff415ad70 2024-09-10T20:55:49.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.234+0000 7f3ff0c00640 1 --2- 172.21.15.6:0/2470899046 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3fd4077f70 0x7f3fd407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:49.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.234+0000 7f3ff0c00640 1 -- 172.21.15.6:0/2470899046 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f3fec09a910 con 0x7f3ff415ad70 2024-09-10T20:55:49.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.234+0000 7f3ff8c00640 1 --2- 172.21.15.6:0/2470899046 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3fd4077f70 0x7f3fd407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:49.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.235+0000 7f3ff8c00640 1 --2- 172.21.15.6:0/2470899046 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3fd4077f70 0x7f3fd407a430 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8006fd0 tx=0x7f3fe8008040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:49.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.238+0000 7f3ff0c00640 1 -- 172.21.15.6:0/2470899046 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f3fec014030 con 0x7f3ff415ad70 2024-09-10T20:55:49.332 INFO:tasks.ceph.mds.c.smithi006.stderr:2024-09-10T20:55:49.328+0000 7ff70f200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T20:55:49.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.430+0000 7f3ffb600640 1 -- 172.21.15.6:0/2470899046 --> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3ff40d0da0 con 0x7f3fd4077f70 2024-09-10T20:55:49.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.435+0000 7f3ff0c00640 1 -- 172.21.15.6:0/2470899046 <== mgr.4120 v2:172.21.15.150:6800/1238179351 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251936 (secure 0 0 0) 0x7f3ff40d0da0 con 0x7f3fd4077f70 2024-09-10T20:55:49.442 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:55:49.443 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-10T20:55:49.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.439+0000 7f3ffb600640 1 -- 172.21.15.6:0/2470899046 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3fd4077f70 msgr2=0x7f3fd407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:49.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.439+0000 7f3ffb600640 1 --2- 172.21.15.6:0/2470899046 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3fd4077f70 0x7f3fd407a430 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8006fd0 tx=0x7f3fe8008040 comp rx=0 tx=0).stop 2024-09-10T20:55:49.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.439+0000 7f3ffb600640 1 -- 172.21.15.6:0/2470899046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ff415ad70 msgr2=0x7f3ff415d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:49.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.439+0000 7f3ffb600640 1 --2- 172.21.15.6:0/2470899046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ff415ad70 0x7f3ff415d460 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3fec00cce0 tx=0x7f3fec00a620 comp rx=0 tx=0).stop 2024-09-10T20:55:49.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.439+0000 7f3ffb600640 1 -- 172.21.15.6:0/2470899046 shutdown_connections 2024-09-10T20:55:49.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.439+0000 7f3ffb600640 1 --2- 172.21.15.6:0/2470899046 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3fd4077f70 0x7f3fd407a430 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:49.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.439+0000 7f3ffb600640 1 --2- 172.21.15.6:0/2470899046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ff415ad70 0x7f3ff415d460 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:49.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.439+0000 7f3ffb600640 1 --2- 172.21.15.6:0/2470899046 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ff40af5a0 0x7f3ff40c9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:49.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.439+0000 7f3ffb600640 1 --2- 172.21.15.6:0/2470899046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ff40adb40 0x7f3ff414b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:49.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.439+0000 7f3ffb600640 1 -- 172.21.15.6:0/2470899046 >> 172.21.15.6:0/2470899046 conn(0x7f3ff40cfe90 msgr2=0x7f3ff406cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:49.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.439+0000 7f3ffb600640 1 -- 172.21.15.6:0/2470899046 shutdown_connections 2024-09-10T20:55:49.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.439+0000 7f3ffb600640 1 -- 172.21.15.6:0/2470899046 wait complete. 2024-09-10T20:55:49.458 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-10T20:55:49.172494+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":160,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219184,"kb_used_data":2928,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755536,"statfs":{"total":773094113280,"available":772869668864,"internally_reserved":0,"allocated":2998272,"data_stored":1790204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001561"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364560+0000","last_change":"2024-09-10T20:55:44.378371+0000","last_active":"2024-09-10T20:55:45.364560+0000","last_peered":"2024-09-10T20:55:45.364560+0000","last_clean":"2024-09-10T20:55:45.364560+0000","last_became_active":"2024-09-10T20:55:44.375917+0000","last_became_peered":"2024-09-10T20:55:44.375917+0000","last_unstale":"2024-09-10T20:55:45.364560+0000","last_undegraded":"2024-09-10T20:55:45.364560+0000","last_fullsized":"2024-09-10T20:55:45.364560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:55:42.603736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361499+0000","last_change":"2024-09-10T20:55:44.378072+0000","last_active":"2024-09-10T20:55:45.361499+0000","last_peered":"2024-09-10T20:55:45.361499+0000","last_clean":"2024-09-10T20:55:45.361499+0000","last_became_active":"2024-09-10T20:55:44.377702+0000","last_became_peered":"2024-09-10T20:55:44.377702+0000","last_unstale":"2024-09-10T20:55:45.361499+0000","last_undegraded":"2024-09-10T20:55:45.361499+0000","last_fullsized":"2024-09-10T20:55:45.361499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:19.756412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.386531+0000","last_change":"2024-09-10T20:55:44.373164+0000","last_active":"2024-09-10T20:55:44.386531+0000","last_peered":"2024-09-10T20:55:44.386531+0000","last_clean":"2024-09-10T20:55:44.386531+0000","last_became_active":"2024-09-10T20:55:44.370647+0000","last_became_peered":"2024-09-10T20:55:44.370647+0000","last_unstale":"2024-09-10T20:55:44.386531+0000","last_undegraded":"2024-09-10T20:55:44.386531+0000","last_fullsized":"2024-09-10T20:55:44.386531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:33.526797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364549+0000","last_change":"2024-09-10T20:55:44.383084+0000","last_active":"2024-09-10T20:55:45.364549+0000","last_peered":"2024-09-10T20:55:45.364549+0000","last_clean":"2024-09-10T20:55:45.364549+0000","last_became_active":"2024-09-10T20:55:44.382543+0000","last_became_peered":"2024-09-10T20:55:44.382543+0000","last_unstale":"2024-09-10T20:55:45.364549+0000","last_undegraded":"2024-09-10T20:55:45.364549+0000","last_fullsized":"2024-09-10T20:55:45.364549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:56.566092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362995+0000","last_change":"2024-09-10T20:55:44.373531+0000","last_active":"2024-09-10T20:55:45.362995+0000","last_peered":"2024-09-10T20:55:45.362995+0000","last_clean":"2024-09-10T20:55:45.362995+0000","last_became_active":"2024-09-10T20:55:44.373234+0000","last_became_peered":"2024-09-10T20:55:44.373234+0000","last_unstale":"2024-09-10T20:55:45.362995+0000","last_undegraded":"2024-09-10T20:55:45.362995+0000","last_fullsized":"2024-09-10T20:55:45.362995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:18:22.966502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362646+0000","last_change":"2024-09-10T20:55:44.375328+0000","last_active":"2024-09-10T20:55:45.362646+0000","last_peered":"2024-09-10T20:55:45.362646+0000","last_clean":"2024-09-10T20:55:45.362646+0000","last_became_active":"2024-09-10T20:55:44.375024+0000","last_became_peered":"2024-09-10T20:55:44.375024+0000","last_unstale":"2024-09-10T20:55:45.362646+0000","last_undegraded":"2024-09-10T20:55:45.362646+0000","last_fullsized":"2024-09-10T20:55:45.362646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:32:54.439682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362477+0000","last_change":"2024-09-10T20:55:44.385176+0000","last_active":"2024-09-10T20:55:45.362477+0000","last_peered":"2024-09-10T20:55:45.362477+0000","last_clean":"2024-09-10T20:55:45.362477+0000","last_became_active":"2024-09-10T20:55:44.384916+0000","last_became_peered":"2024-09-10T20:55:44.384916+0000","last_unstale":"2024-09-10T20:55:45.362477+0000","last_undegraded":"2024-09-10T20:55:45.362477+0000","last_fullsized":"2024-09-10T20:55:45.362477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:51:21.066719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.382446+0000","last_change":"2024-09-10T20:55:44.374342+0000","last_active":"2024-09-10T20:55:44.382446+0000","last_peered":"2024-09-10T20:55:44.382446+0000","last_clean":"2024-09-10T20:55:44.382446+0000","last_became_active":"2024-09-10T20:55:44.373477+0000","last_became_peered":"2024-09-10T20:55:44.373477+0000","last_unstale":"2024-09-10T20:55:44.382446+0000","last_undegraded":"2024-09-10T20:55:44.382446+0000","last_fullsized":"2024-09-10T20:55:44.382446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:26:18.554273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364578+0000","last_change":"2024-09-10T20:55:44.379912+0000","last_active":"2024-09-10T20:55:45.364578+0000","last_peered":"2024-09-10T20:55:45.364578+0000","last_clean":"2024-09-10T20:55:45.364578+0000","last_became_active":"2024-09-10T20:55:44.379632+0000","last_became_peered":"2024-09-10T20:55:44.379632+0000","last_unstale":"2024-09-10T20:55:45.364578+0000","last_undegraded":"2024-09-10T20:55:45.364578+0000","last_fullsized":"2024-09-10T20:55:45.364578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:31:58.187489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.356250+0000","last_change":"2024-09-10T20:55:44.379776+0000","last_active":"2024-09-10T20:55:46.356250+0000","last_peered":"2024-09-10T20:55:46.356250+0000","last_clean":"2024-09-10T20:55:46.356250+0000","last_became_active":"2024-09-10T20:55:44.379512+0000","last_became_peered":"2024-09-10T20:55:44.379512+0000","last_unstale":"2024-09-10T20:55:46.356250+0000","last_undegraded":"2024-09-10T20:55:46.356250+0000","last_fullsized":"2024-09-10T20:55:46.356250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:08.229059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.356236+0000","last_change":"2024-09-10T20:55:44.372935+0000","last_active":"2024-09-10T20:55:46.356236+0000","last_peered":"2024-09-10T20:55:46.356236+0000","last_clean":"2024-09-10T20:55:46.356236+0000","last_became_active":"2024-09-10T20:55:44.372660+0000","last_became_peered":"2024-09-10T20:55:44.372660+0000","last_unstale":"2024-09-10T20:55:46.356236+0000","last_undegraded":"2024-09-10T20:55:46.356236+0000","last_fullsized":"2024-09-10T20:55:46.356236+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:16:49.875268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.627691+0000","last_change":"2024-09-10T20:55:44.381853+0000","last_active":"2024-09-10T20:55:46.627691+0000","last_peered":"2024-09-10T20:55:46.627691+0000","last_clean":"2024-09-10T20:55:46.627691+0000","last_became_active":"2024-09-10T20:55:44.381283+0000","last_became_peered":"2024-09-10T20:55:44.381283+0000","last_unstale":"2024-09-10T20:55:46.627691+0000","last_undegraded":"2024-09-10T20:55:46.627691+0000","last_fullsized":"2024-09-10T20:55:46.627691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:01:41.450845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.386716+0000","last_change":"2024-09-10T20:55:44.380947+0000","last_active":"2024-09-10T20:55:44.386716+0000","last_peered":"2024-09-10T20:55:44.386716+0000","last_clean":"2024-09-10T20:55:44.386716+0000","last_became_active":"2024-09-10T20:55:44.380246+0000","last_became_peered":"2024-09-10T20:55:44.380246+0000","last_unstale":"2024-09-10T20:55:44.386716+0000","last_undegraded":"2024-09-10T20:55:44.386716+0000","last_fullsized":"2024-09-10T20:55:44.386716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:19:22.962575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.386628+0000","last_change":"2024-09-10T20:55:44.380329+0000","last_active":"2024-09-10T20:55:44.386628+0000","last_peered":"2024-09-10T20:55:44.386628+0000","last_clean":"2024-09-10T20:55:44.386628+0000","last_became_active":"2024-09-10T20:55:44.379878+0000","last_became_peered":"2024-09-10T20:55:44.379878+0000","last_unstale":"2024-09-10T20:55:44.386628+0000","last_undegraded":"2024-09-10T20:55:44.386628+0000","last_fullsized":"2024-09-10T20:55:44.386628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:47:16.684070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361378+0000","last_change":"2024-09-10T20:55:44.369874+0000","last_active":"2024-09-10T20:55:45.361378+0000","last_peered":"2024-09-10T20:55:45.361378+0000","last_clean":"2024-09-10T20:55:45.361378+0000","last_became_active":"2024-09-10T20:55:44.369125+0000","last_became_peered":"2024-09-10T20:55:44.369125+0000","last_unstale":"2024-09-10T20:55:45.361378+0000","last_undegraded":"2024-09-10T20:55:45.361378+0000","last_fullsized":"2024-09-10T20:55:45.361378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:48:52.277148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362575+0000","last_change":"2024-09-10T20:55:44.377717+0000","last_active":"2024-09-10T20:55:45.362575+0000","last_peered":"2024-09-10T20:55:45.362575+0000","last_clean":"2024-09-10T20:55:45.362575+0000","last_became_active":"2024-09-10T20:55:44.376176+0000","last_became_peered":"2024-09-10T20:55:44.376176+0000","last_unstale":"2024-09-10T20:55:45.362575+0000","last_undegraded":"2024-09-10T20:55:45.362575+0000","last_fullsized":"2024-09-10T20:55:45.362575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:19.756412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363854+0000","last_change":"2024-09-10T20:55:44.371382+0000","last_active":"2024-09-10T20:55:45.363854+0000","last_peered":"2024-09-10T20:55:45.363854+0000","last_clean":"2024-09-10T20:55:45.363854+0000","last_became_active":"2024-09-10T20:55:44.371044+0000","last_became_peered":"2024-09-10T20:55:44.371044+0000","last_unstale":"2024-09-10T20:55:45.363854+0000","last_undegraded":"2024-09-10T20:55:45.363854+0000","last_fullsized":"2024-09-10T20:55:45.363854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:31:48.282296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.918190+0000","last_change":"2024-09-10T20:55:44.375032+0000","last_active":"2024-09-10T20:55:45.918190+0000","last_peered":"2024-09-10T20:55:45.918190+0000","last_clean":"2024-09-10T20:55:45.918190+0000","last_became_active":"2024-09-10T20:55:44.374735+0000","last_became_peered":"2024-09-10T20:55:44.374735+0000","last_unstale":"2024-09-10T20:55:45.918190+0000","last_undegraded":"2024-09-10T20:55:45.918190+0000","last_fullsized":"2024-09-10T20:55:45.918190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:30.365247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364255+0000","last_change":"2024-09-10T20:55:44.379134+0000","last_active":"2024-09-10T20:55:45.364255+0000","last_peered":"2024-09-10T20:55:45.364255+0000","last_clean":"2024-09-10T20:55:45.364255+0000","last_became_active":"2024-09-10T20:55:44.378814+0000","last_became_peered":"2024-09-10T20:55:44.378814+0000","last_unstale":"2024-09-10T20:55:45.364255+0000","last_undegraded":"2024-09-10T20:55:45.364255+0000","last_fullsized":"2024-09-10T20:55:45.364255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:45:07.152884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.356325+0000","last_change":"2024-09-10T20:55:44.381800+0000","last_active":"2024-09-10T20:55:46.356325+0000","last_peered":"2024-09-10T20:55:46.356325+0000","last_clean":"2024-09-10T20:55:46.356325+0000","last_became_active":"2024-09-10T20:55:44.380382+0000","last_became_peered":"2024-09-10T20:55:44.380382+0000","last_unstale":"2024-09-10T20:55:46.356325+0000","last_undegraded":"2024-09-10T20:55:46.356325+0000","last_fullsized":"2024-09-10T20:55:46.356325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:58.419795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.390713+0000","last_change":"2024-09-10T20:55:44.385859+0000","last_active":"2024-09-10T20:55:44.390713+0000","last_peered":"2024-09-10T20:55:44.390713+0000","last_clean":"2024-09-10T20:55:44.390713+0000","last_became_active":"2024-09-10T20:55:44.383049+0000","last_became_peered":"2024-09-10T20:55:44.383049+0000","last_unstale":"2024-09-10T20:55:44.390713+0000","last_undegraded":"2024-09-10T20:55:44.390713+0000","last_fullsized":"2024-09-10T20:55:44.390713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:32:06.996501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362652+0000","last_change":"2024-09-10T20:55:44.373313+0000","last_active":"2024-09-10T20:55:45.362652+0000","last_peered":"2024-09-10T20:55:45.362652+0000","last_clean":"2024-09-10T20:55:45.362652+0000","last_became_active":"2024-09-10T20:55:44.372975+0000","last_became_peered":"2024-09-10T20:55:44.372975+0000","last_unstale":"2024-09-10T20:55:45.362652+0000","last_undegraded":"2024-09-10T20:55:45.362652+0000","last_fullsized":"2024-09-10T20:55:45.362652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:49:46.518440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.379972+0000","last_change":"2024-09-10T20:55:44.372460+0000","last_active":"2024-09-10T20:55:44.379972+0000","last_peered":"2024-09-10T20:55:44.379972+0000","last_clean":"2024-09-10T20:55:44.379972+0000","last_became_active":"2024-09-10T20:55:44.372166+0000","last_became_peered":"2024-09-10T20:55:44.372166+0000","last_unstale":"2024-09-10T20:55:44.379972+0000","last_undegraded":"2024-09-10T20:55:44.379972+0000","last_fullsized":"2024-09-10T20:55:44.379972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:41.531837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362773+0000","last_change":"2024-09-10T20:55:44.382439+0000","last_active":"2024-09-10T20:55:45.362773+0000","last_peered":"2024-09-10T20:55:45.362773+0000","last_clean":"2024-09-10T20:55:45.362773+0000","last_became_active":"2024-09-10T20:55:44.382157+0000","last_became_peered":"2024-09-10T20:55:44.382157+0000","last_unstale":"2024-09-10T20:55:45.362773+0000","last_undegraded":"2024-09-10T20:55:45.362773+0000","last_fullsized":"2024-09-10T20:55:45.362773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:51:21.066719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.383114+0000","last_change":"2024-09-10T20:55:44.379140+0000","last_active":"2024-09-10T20:55:44.383114+0000","last_peered":"2024-09-10T20:55:44.383114+0000","last_clean":"2024-09-10T20:55:44.383114+0000","last_became_active":"2024-09-10T20:55:44.378867+0000","last_became_peered":"2024-09-10T20:55:44.378867+0000","last_unstale":"2024-09-10T20:55:44.383114+0000","last_undegraded":"2024-09-10T20:55:44.383114+0000","last_fullsized":"2024-09-10T20:55:44.383114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:15:31.022675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.356316+0000","last_change":"2024-09-10T20:55:44.374130+0000","last_active":"2024-09-10T20:55:46.356316+0000","last_peered":"2024-09-10T20:55:46.356316+0000","last_clean":"2024-09-10T20:55:46.356316+0000","last_became_active":"2024-09-10T20:55:44.373755+0000","last_became_peered":"2024-09-10T20:55:44.373755+0000","last_unstale":"2024-09-10T20:55:46.356316+0000","last_undegraded":"2024-09-10T20:55:46.356316+0000","last_fullsized":"2024-09-10T20:55:46.356316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:19.756412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361498+0000","last_change":"2024-09-10T20:55:44.380940+0000","last_active":"2024-09-10T20:55:45.361498+0000","last_peered":"2024-09-10T20:55:45.361498+0000","last_clean":"2024-09-10T20:55:45.361498+0000","last_became_active":"2024-09-10T20:55:44.380667+0000","last_became_peered":"2024-09-10T20:55:44.380667+0000","last_unstale":"2024-09-10T20:55:45.361498+0000","last_undegraded":"2024-09-10T20:55:45.361498+0000","last_fullsized":"2024-09-10T20:55:45.361498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:08.229059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.386702+0000","last_change":"2024-09-10T20:55:44.380864+0000","last_active":"2024-09-10T20:55:44.386702+0000","last_peered":"2024-09-10T20:55:44.386702+0000","last_clean":"2024-09-10T20:55:44.386702+0000","last_became_active":"2024-09-10T20:55:44.380634+0000","last_became_peered":"2024-09-10T20:55:44.380634+0000","last_unstale":"2024-09-10T20:55:44.386702+0000","last_undegraded":"2024-09-10T20:55:44.386702+0000","last_fullsized":"2024-09-10T20:55:44.386702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:58:46.746674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.393149+0000","last_change":"2024-09-10T20:55:44.388198+0000","last_active":"2024-09-10T20:55:44.393149+0000","last_peered":"2024-09-10T20:55:44.393149+0000","last_clean":"2024-09-10T20:55:44.393149+0000","last_became_active":"2024-09-10T20:55:44.387343+0000","last_became_peered":"2024-09-10T20:55:44.387343+0000","last_unstale":"2024-09-10T20:55:44.393149+0000","last_undegraded":"2024-09-10T20:55:44.393149+0000","last_fullsized":"2024-09-10T20:55:44.393149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:09:08.651876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364492+0000","last_change":"2024-09-10T20:55:44.380482+0000","last_active":"2024-09-10T20:55:45.364492+0000","last_peered":"2024-09-10T20:55:45.364492+0000","last_clean":"2024-09-10T20:55:45.364492+0000","last_became_active":"2024-09-10T20:55:44.379945+0000","last_became_peered":"2024-09-10T20:55:44.379945+0000","last_unstale":"2024-09-10T20:55:45.364492+0000","last_undegraded":"2024-09-10T20:55:45.364492+0000","last_fullsized":"2024-09-10T20:55:45.364492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:15:59.746371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.918084+0000","last_change":"2024-09-10T20:55:44.369574+0000","last_active":"2024-09-10T20:55:45.918084+0000","last_peered":"2024-09-10T20:55:45.918084+0000","last_clean":"2024-09-10T20:55:45.918084+0000","last_became_active":"2024-09-10T20:55:44.365888+0000","last_became_peered":"2024-09-10T20:55:44.365888+0000","last_unstale":"2024-09-10T20:55:45.918084+0000","last_undegraded":"2024-09-10T20:55:45.918084+0000","last_fullsized":"2024-09-10T20:55:45.918084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:41:12.114462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.355892+0000","last_change":"2024-09-10T20:55:44.387588+0000","last_active":"2024-09-10T20:55:46.355892+0000","last_peered":"2024-09-10T20:55:46.355892+0000","last_clean":"2024-09-10T20:55:46.355892+0000","last_became_active":"2024-09-10T20:55:44.387293+0000","last_became_peered":"2024-09-10T20:55:44.387293+0000","last_unstale":"2024-09-10T20:55:46.355892+0000","last_undegraded":"2024-09-10T20:55:46.355892+0000","last_fullsized":"2024-09-10T20:55:46.355892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:26:35.929548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.627619+0000","last_change":"2024-09-10T20:55:44.364063+0000","last_active":"2024-09-10T20:55:46.627619+0000","last_peered":"2024-09-10T20:55:46.627619+0000","last_clean":"2024-09-10T20:55:46.627619+0000","last_became_active":"2024-09-10T20:55:44.363460+0000","last_became_peered":"2024-09-10T20:55:44.363460+0000","last_unstale":"2024-09-10T20:55:46.627619+0000","last_undegraded":"2024-09-10T20:55:46.627619+0000","last_fullsized":"2024-09-10T20:55:46.627619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:49.994707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.383609+0000","last_change":"2024-09-10T20:55:43.368822+0000","last_active":"2024-09-10T20:55:44.383609+0000","last_peered":"2024-09-10T20:55:44.383609+0000","last_clean":"2024-09-10T20:55:44.383609+0000","last_became_active":"2024-09-10T20:55:43.368565+0000","last_became_peered":"2024-09-10T20:55:43.368565+0000","last_unstale":"2024-09-10T20:55:44.383609+0000","last_undegraded":"2024-09-10T20:55:44.383609+0000","last_fullsized":"2024-09-10T20:55:44.383609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:23:19.583021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.388414+0000","last_change":"2024-09-10T20:55:44.372807+0000","last_active":"2024-09-10T20:55:44.388414+0000","last_peered":"2024-09-10T20:55:44.388414+0000","last_clean":"2024-09-10T20:55:44.388414+0000","last_became_active":"2024-09-10T20:55:44.372476+0000","last_became_peered":"2024-09-10T20:55:44.372476+0000","last_unstale":"2024-09-10T20:55:44.388414+0000","last_undegraded":"2024-09-10T20:55:44.388414+0000","last_fullsized":"2024-09-10T20:55:44.388414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:26:00.655943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.355691+0000","last_change":"2024-09-10T20:55:43.372918+0000","last_active":"2024-09-10T20:55:46.355691+0000","last_peered":"2024-09-10T20:55:46.355691+0000","last_clean":"2024-09-10T20:55:46.355691+0000","last_became_active":"2024-09-10T20:55:43.369953+0000","last_became_peered":"2024-09-10T20:55:43.369953+0000","last_unstale":"2024-09-10T20:55:46.355691+0000","last_undegraded":"2024-09-10T20:55:46.355691+0000","last_fullsized":"2024-09-10T20:55:46.355691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:51:58.280912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.368340+0000","last_change":"2024-09-10T20:55:43.370997+0000","last_active":"2024-09-10T20:55:44.368340+0000","last_peered":"2024-09-10T20:55:44.368340+0000","last_clean":"2024-09-10T20:55:44.368340+0000","last_became_active":"2024-09-10T20:55:43.370753+0000","last_became_peered":"2024-09-10T20:55:43.370753+0000","last_unstale":"2024-09-10T20:55:44.368340+0000","last_undegraded":"2024-09-10T20:55:44.368340+0000","last_fullsized":"2024-09-10T20:55:44.368340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:04:30.007942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.386755+0000","last_change":"2024-09-10T20:55:44.381520+0000","last_active":"2024-09-10T20:55:44.386755+0000","last_peered":"2024-09-10T20:55:44.386755+0000","last_clean":"2024-09-10T20:55:44.386755+0000","last_became_active":"2024-09-10T20:55:44.381184+0000","last_became_peered":"2024-09-10T20:55:44.381184+0000","last_unstale":"2024-09-10T20:55:44.386755+0000","last_undegraded":"2024-09-10T20:55:44.386755+0000","last_fullsized":"2024-09-10T20:55:44.386755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:10:56.591857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362827+0000","last_change":"2024-09-10T20:55:43.363749+0000","last_active":"2024-09-10T20:55:45.362827+0000","last_peered":"2024-09-10T20:55:45.362827+0000","last_clean":"2024-09-10T20:55:45.362827+0000","last_became_active":"2024-09-10T20:55:43.363070+0000","last_became_peered":"2024-09-10T20:55:43.363070+0000","last_unstale":"2024-09-10T20:55:45.362827+0000","last_undegraded":"2024-09-10T20:55:45.362827+0000","last_fullsized":"2024-09-10T20:55:45.362827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:44.779833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361364+0000","last_change":"2024-09-10T20:55:44.377537+0000","last_active":"2024-09-10T20:55:45.361364+0000","last_peered":"2024-09-10T20:55:45.361364+0000","last_clean":"2024-09-10T20:55:45.361364+0000","last_became_active":"2024-09-10T20:55:44.377261+0000","last_became_peered":"2024-09-10T20:55:44.377261+0000","last_unstale":"2024-09-10T20:55:45.361364+0000","last_undegraded":"2024-09-10T20:55:45.361364+0000","last_fullsized":"2024-09-10T20:55:45.361364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:21:11.284661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.356082+0000","last_change":"2024-09-10T20:55:43.371067+0000","last_active":"2024-09-10T20:55:46.356082+0000","last_peered":"2024-09-10T20:55:46.356082+0000","last_clean":"2024-09-10T20:55:46.356082+0000","last_became_active":"2024-09-10T20:55:43.370788+0000","last_became_peered":"2024-09-10T20:55:43.370788+0000","last_unstale":"2024-09-10T20:55:46.356082+0000","last_undegraded":"2024-09-10T20:55:46.356082+0000","last_fullsized":"2024-09-10T20:55:46.356082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:41:29.573514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363411+0000","last_change":"2024-09-10T20:55:44.378830+0000","last_active":"2024-09-10T20:55:45.363411+0000","last_peered":"2024-09-10T20:55:45.363411+0000","last_clean":"2024-09-10T20:55:45.363411+0000","last_became_active":"2024-09-10T20:55:44.378020+0000","last_became_peered":"2024-09-10T20:55:44.378020+0000","last_unstale":"2024-09-10T20:55:45.363411+0000","last_undegraded":"2024-09-10T20:55:45.363411+0000","last_fullsized":"2024-09-10T20:55:45.363411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:23:32.772228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363472+0000","last_change":"2024-09-10T20:55:43.372861+0000","last_active":"2024-09-10T20:55:45.363472+0000","last_peered":"2024-09-10T20:55:45.363472+0000","last_clean":"2024-09-10T20:55:45.363472+0000","last_became_active":"2024-09-10T20:55:43.372596+0000","last_became_peered":"2024-09-10T20:55:43.372596+0000","last_unstale":"2024-09-10T20:55:45.363472+0000","last_undegraded":"2024-09-10T20:55:45.363472+0000","last_fullsized":"2024-09-10T20:55:45.363472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:51:58.280912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.384926+0000","last_change":"2024-09-10T20:55:44.368307+0000","last_active":"2024-09-10T20:55:44.384926+0000","last_peered":"2024-09-10T20:55:44.384926+0000","last_clean":"2024-09-10T20:55:44.384926+0000","last_became_active":"2024-09-10T20:55:44.365395+0000","last_became_peered":"2024-09-10T20:55:44.365395+0000","last_unstale":"2024-09-10T20:55:44.384926+0000","last_undegraded":"2024-09-10T20:55:44.384926+0000","last_fullsized":"2024-09-10T20:55:44.384926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:24.328528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361560+0000","last_change":"2024-09-10T20:55:43.366971+0000","last_active":"2024-09-10T20:55:45.361560+0000","last_peered":"2024-09-10T20:55:45.361560+0000","last_clean":"2024-09-10T20:55:45.361560+0000","last_became_active":"2024-09-10T20:55:43.366692+0000","last_became_peered":"2024-09-10T20:55:43.366692+0000","last_unstale":"2024-09-10T20:55:45.361560+0000","last_undegraded":"2024-09-10T20:55:45.361560+0000","last_fullsized":"2024-09-10T20:55:45.361560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:04.606474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.627783+0000","last_change":"2024-09-10T20:55:44.368208+0000","last_active":"2024-09-10T20:55:46.627783+0000","last_peered":"2024-09-10T20:55:46.627783+0000","last_clean":"2024-09-10T20:55:46.627783+0000","last_became_active":"2024-09-10T20:55:44.367944+0000","last_became_peered":"2024-09-10T20:55:44.367944+0000","last_unstale":"2024-09-10T20:55:46.627783+0000","last_undegraded":"2024-09-10T20:55:46.627783+0000","last_fullsized":"2024-09-10T20:55:46.627783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:37:32.042518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.356052+0000","last_change":"2024-09-10T20:55:43.370938+0000","last_active":"2024-09-10T20:55:46.356052+0000","last_peered":"2024-09-10T20:55:46.356052+0000","last_clean":"2024-09-10T20:55:46.356052+0000","last_became_active":"2024-09-10T20:55:43.370674+0000","last_became_peered":"2024-09-10T20:55:43.370674+0000","last_unstale":"2024-09-10T20:55:46.356052+0000","last_undegraded":"2024-09-10T20:55:46.356052+0000","last_fullsized":"2024-09-10T20:55:46.356052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:52.212240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363966+0000","last_change":"2024-09-10T20:55:44.383665+0000","last_active":"2024-09-10T20:55:45.363966+0000","last_peered":"2024-09-10T20:55:45.363966+0000","last_clean":"2024-09-10T20:55:45.363966+0000","last_became_active":"2024-09-10T20:55:44.382473+0000","last_became_peered":"2024-09-10T20:55:44.382473+0000","last_unstale":"2024-09-10T20:55:45.363966+0000","last_undegraded":"2024-09-10T20:55:45.363966+0000","last_fullsized":"2024-09-10T20:55:45.363966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:04:31.815506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.388672+0000","last_change":"2024-09-10T20:55:43.365123+0000","last_active":"2024-09-10T20:55:44.388672+0000","last_peered":"2024-09-10T20:55:44.388672+0000","last_clean":"2024-09-10T20:55:44.388672+0000","last_became_active":"2024-09-10T20:55:43.364866+0000","last_became_peered":"2024-09-10T20:55:43.364866+0000","last_unstale":"2024-09-10T20:55:44.388672+0000","last_undegraded":"2024-09-10T20:55:44.388672+0000","last_fullsized":"2024-09-10T20:55:44.388672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:07:11.228176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.388518+0000","last_change":"2024-09-10T20:55:44.384522+0000","last_active":"2024-09-10T20:55:44.388518+0000","last_peered":"2024-09-10T20:55:44.388518+0000","last_clean":"2024-09-10T20:55:44.388518+0000","last_became_active":"2024-09-10T20:55:44.373788+0000","last_became_peered":"2024-09-10T20:55:44.373788+0000","last_unstale":"2024-09-10T20:55:44.388518+0000","last_undegraded":"2024-09-10T20:55:44.388518+0000","last_fullsized":"2024-09-10T20:55:44.388518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:55.041551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364231+0000","last_change":"2024-09-10T20:55:43.367632+0000","last_active":"2024-09-10T20:55:45.364231+0000","last_peered":"2024-09-10T20:55:45.364231+0000","last_clean":"2024-09-10T20:55:45.364231+0000","last_became_active":"2024-09-10T20:55:43.366886+0000","last_became_peered":"2024-09-10T20:55:43.366886+0000","last_unstale":"2024-09-10T20:55:45.364231+0000","last_undegraded":"2024-09-10T20:55:45.364231+0000","last_fullsized":"2024-09-10T20:55:45.364231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:52.212240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363214+0000","last_change":"2024-09-10T20:55:44.378167+0000","last_active":"2024-09-10T20:55:45.363214+0000","last_peered":"2024-09-10T20:55:45.363214+0000","last_clean":"2024-09-10T20:55:45.363214+0000","last_became_active":"2024-09-10T20:55:44.377891+0000","last_became_peered":"2024-09-10T20:55:44.377891+0000","last_unstale":"2024-09-10T20:55:45.363214+0000","last_undegraded":"2024-09-10T20:55:45.363214+0000","last_fullsized":"2024-09-10T20:55:45.363214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:03:40.884856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.355694+0000","last_change":"2024-09-10T20:55:43.374275+0000","last_active":"2024-09-10T20:55:46.355694+0000","last_peered":"2024-09-10T20:55:46.355694+0000","last_clean":"2024-09-10T20:55:46.355694+0000","last_became_active":"2024-09-10T20:55:43.373744+0000","last_became_peered":"2024-09-10T20:55:43.373744+0000","last_unstale":"2024-09-10T20:55:46.355694+0000","last_undegraded":"2024-09-10T20:55:46.355694+0000","last_fullsized":"2024-09-10T20:55:46.355694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:44.779833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.356079+0000","last_change":"2024-09-10T20:55:44.387669+0000","last_active":"2024-09-10T20:55:46.356079+0000","last_peered":"2024-09-10T20:55:46.356079+0000","last_clean":"2024-09-10T20:55:46.356079+0000","last_became_active":"2024-09-10T20:55:44.387385+0000","last_became_peered":"2024-09-10T20:55:44.387385+0000","last_unstale":"2024-09-10T20:55:46.356079+0000","last_undegraded":"2024-09-10T20:55:46.356079+0000","last_fullsized":"2024-09-10T20:55:46.356079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:55:40.289116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.918034+0000","last_change":"2024-09-10T20:55:43.364230+0000","last_active":"2024-09-10T20:55:45.918034+0000","last_peered":"2024-09-10T20:55:45.918034+0000","last_clean":"2024-09-10T20:55:45.918034+0000","last_became_active":"2024-09-10T20:55:43.363855+0000","last_became_peered":"2024-09-10T20:55:43.363855+0000","last_unstale":"2024-09-10T20:55:45.918034+0000","last_undegraded":"2024-09-10T20:55:45.918034+0000","last_fullsized":"2024-09-10T20:55:45.918034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:47:38.695432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362684+0000","last_change":"2024-09-10T20:55:44.377758+0000","last_active":"2024-09-10T20:55:45.362684+0000","last_peered":"2024-09-10T20:55:45.362684+0000","last_clean":"2024-09-10T20:55:45.362684+0000","last_became_active":"2024-09-10T20:55:44.376900+0000","last_became_peered":"2024-09-10T20:55:44.376900+0000","last_unstale":"2024-09-10T20:55:45.362684+0000","last_undegraded":"2024-09-10T20:55:45.362684+0000","last_fullsized":"2024-09-10T20:55:45.362684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:56.566092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.627648+0000","last_change":"2024-09-10T20:55:43.366524+0000","last_active":"2024-09-10T20:55:46.627648+0000","last_peered":"2024-09-10T20:55:46.627648+0000","last_clean":"2024-09-10T20:55:46.627648+0000","last_became_active":"2024-09-10T20:55:43.365064+0000","last_became_peered":"2024-09-10T20:55:43.365064+0000","last_unstale":"2024-09-10T20:55:46.627648+0000","last_undegraded":"2024-09-10T20:55:46.627648+0000","last_fullsized":"2024-09-10T20:55:46.627648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:35.578339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364979+0000","last_change":"2024-09-10T20:55:44.380007+0000","last_active":"2024-09-10T20:55:45.364979+0000","last_peered":"2024-09-10T20:55:45.364979+0000","last_clean":"2024-09-10T20:55:45.364979+0000","last_became_active":"2024-09-10T20:55:44.379509+0000","last_became_peered":"2024-09-10T20:55:44.379509+0000","last_unstale":"2024-09-10T20:55:45.364979+0000","last_undegraded":"2024-09-10T20:55:45.364979+0000","last_fullsized":"2024-09-10T20:55:45.364979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:19.493422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.918101+0000","last_change":"2024-09-10T20:55:43.367328+0000","last_active":"2024-09-10T20:55:45.918101+0000","last_peered":"2024-09-10T20:55:45.918101+0000","last_clean":"2024-09-10T20:55:45.918101+0000","last_became_active":"2024-09-10T20:55:43.366880+0000","last_became_peered":"2024-09-10T20:55:43.366880+0000","last_unstale":"2024-09-10T20:55:45.918101+0000","last_undegraded":"2024-09-10T20:55:45.918101+0000","last_fullsized":"2024-09-10T20:55:45.918101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:52.212240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364733+0000","last_change":"2024-09-10T20:55:44.387017+0000","last_active":"2024-09-10T20:55:45.364733+0000","last_peered":"2024-09-10T20:55:45.364733+0000","last_clean":"2024-09-10T20:55:45.364733+0000","last_became_active":"2024-09-10T20:55:44.386824+0000","last_became_peered":"2024-09-10T20:55:44.386824+0000","last_unstale":"2024-09-10T20:55:45.364733+0000","last_undegraded":"2024-09-10T20:55:45.364733+0000","last_fullsized":"2024-09-10T20:55:45.364733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:03.834745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361597+0000","last_change":"2024-09-10T20:55:43.363564+0000","last_active":"2024-09-10T20:55:45.361597+0000","last_peered":"2024-09-10T20:55:45.361597+0000","last_clean":"2024-09-10T20:55:45.361597+0000","last_became_active":"2024-09-10T20:55:43.363247+0000","last_became_peered":"2024-09-10T20:55:43.363247+0000","last_unstale":"2024-09-10T20:55:45.361597+0000","last_undegraded":"2024-09-10T20:55:45.361597+0000","last_fullsized":"2024-09-10T20:55:45.361597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:16.877259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363896+0000","last_change":"2024-09-10T20:55:44.382801+0000","last_active":"2024-09-10T20:55:45.363896+0000","last_peered":"2024-09-10T20:55:45.363896+0000","last_clean":"2024-09-10T20:55:45.363896+0000","last_became_active":"2024-09-10T20:55:44.382172+0000","last_became_peered":"2024-09-10T20:55:44.382172+0000","last_unstale":"2024-09-10T20:55:45.363896+0000","last_undegraded":"2024-09-10T20:55:45.363896+0000","last_fullsized":"2024-09-10T20:55:45.363896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:37:10.807087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.918024+0000","last_change":"2024-09-10T20:55:43.365372+0000","last_active":"2024-09-10T20:55:45.918024+0000","last_peered":"2024-09-10T20:55:45.918024+0000","last_clean":"2024-09-10T20:55:45.918024+0000","last_became_active":"2024-09-10T20:55:43.362283+0000","last_became_peered":"2024-09-10T20:55:43.362283+0000","last_unstale":"2024-09-10T20:55:45.918024+0000","last_undegraded":"2024-09-10T20:55:45.918024+0000","last_fullsized":"2024-09-10T20:55:45.918024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:51:58.280912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363976+0000","last_change":"2024-09-10T20:55:44.379042+0000","last_active":"2024-09-10T20:55:45.363976+0000","last_peered":"2024-09-10T20:55:45.363976+0000","last_clean":"2024-09-10T20:55:45.363976+0000","last_became_active":"2024-09-10T20:55:44.378742+0000","last_became_peered":"2024-09-10T20:55:44.378742+0000","last_unstale":"2024-09-10T20:55:45.363976+0000","last_undegraded":"2024-09-10T20:55:45.363976+0000","last_fullsized":"2024-09-10T20:55:45.363976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:27:25.913460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362265+0000","last_change":"2024-09-10T20:55:34.718784+0000","last_active":"2024-09-10T20:55:45.362265+0000","last_peered":"2024-09-10T20:55:45.362265+0000","last_clean":"2024-09-10T20:55:45.362265+0000","last_became_active":"2024-09-10T20:55:34.717616+0000","last_became_peered":"2024-09-10T20:55:34.717616+0000","last_unstale":"2024-09-10T20:55:45.362265+0000","last_undegraded":"2024-09-10T20:55:45.362265+0000","last_fullsized":"2024-09-10T20:55:45.362265+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:33.618098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:33.618098+0000","last_clean_scrub_stamp":"2024-09-10T20:55:33.618098+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:17.442729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362978+0000","last_change":"2024-09-10T20:55:43.364591+0000","last_active":"2024-09-10T20:55:45.362978+0000","last_peered":"2024-09-10T20:55:45.362978+0000","last_clean":"2024-09-10T20:55:45.362978+0000","last_became_active":"2024-09-10T20:55:43.363372+0000","last_became_peered":"2024-09-10T20:55:43.363372+0000","last_unstale":"2024-09-10T20:55:45.362978+0000","last_undegraded":"2024-09-10T20:55:45.362978+0000","last_fullsized":"2024-09-10T20:55:45.362978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:04.606474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.386749+0000","last_change":"2024-09-10T20:55:44.373563+0000","last_active":"2024-09-10T20:55:44.386749+0000","last_peered":"2024-09-10T20:55:44.386749+0000","last_clean":"2024-09-10T20:55:44.386749+0000","last_became_active":"2024-09-10T20:55:44.373244+0000","last_became_peered":"2024-09-10T20:55:44.373244+0000","last_unstale":"2024-09-10T20:55:44.386749+0000","last_undegraded":"2024-09-10T20:55:44.386749+0000","last_fullsized":"2024-09-10T20:55:44.386749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:29:12.552642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362107+0000","last_change":"2024-09-10T20:55:43.376868+0000","last_active":"2024-09-10T20:55:45.362107+0000","last_peered":"2024-09-10T20:55:45.362107+0000","last_clean":"2024-09-10T20:55:45.362107+0000","last_became_active":"2024-09-10T20:55:43.376616+0000","last_became_peered":"2024-09-10T20:55:43.376616+0000","last_unstale":"2024-09-10T20:55:45.362107+0000","last_undegraded":"2024-09-10T20:55:45.362107+0000","last_fullsized":"2024-09-10T20:55:45.362107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:04.606474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.386518+0000","last_change":"2024-09-10T20:55:44.370871+0000","last_active":"2024-09-10T20:55:44.386518+0000","last_peered":"2024-09-10T20:55:44.386518+0000","last_clean":"2024-09-10T20:55:44.386518+0000","last_became_active":"2024-09-10T20:55:44.370595+0000","last_became_peered":"2024-09-10T20:55:44.370595+0000","last_unstale":"2024-09-10T20:55:44.386518+0000","last_undegraded":"2024-09-10T20:55:44.386518+0000","last_fullsized":"2024-09-10T20:55:44.386518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:00:12.920099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.917992+0000","last_change":"2024-09-10T20:55:43.367129+0000","last_active":"2024-09-10T20:55:45.917992+0000","last_peered":"2024-09-10T20:55:45.917992+0000","last_clean":"2024-09-10T20:55:45.917992+0000","last_became_active":"2024-09-10T20:55:43.366825+0000","last_became_peered":"2024-09-10T20:55:43.366825+0000","last_unstale":"2024-09-10T20:55:45.917992+0000","last_undegraded":"2024-09-10T20:55:45.917992+0000","last_fullsized":"2024-09-10T20:55:45.917992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:44.779833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361375+0000","last_change":"2024-09-10T20:55:44.362975+0000","last_active":"2024-09-10T20:55:45.361375+0000","last_peered":"2024-09-10T20:55:45.361375+0000","last_clean":"2024-09-10T20:55:45.361375+0000","last_became_active":"2024-09-10T20:55:44.362495+0000","last_became_peered":"2024-09-10T20:55:44.362495+0000","last_unstale":"2024-09-10T20:55:45.361375+0000","last_undegraded":"2024-09-10T20:55:45.361375+0000","last_fullsized":"2024-09-10T20:55:45.361375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:01:47.424436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364336+0000","last_change":"2024-09-10T20:55:43.364574+0000","last_active":"2024-09-10T20:55:45.364336+0000","last_peered":"2024-09-10T20:55:45.364336+0000","last_clean":"2024-09-10T20:55:45.364336+0000","last_became_active":"2024-09-10T20:55:43.363895+0000","last_became_peered":"2024-09-10T20:55:43.363895+0000","last_unstale":"2024-09-10T20:55:45.364336+0000","last_undegraded":"2024-09-10T20:55:45.364336+0000","last_fullsized":"2024-09-10T20:55:45.364336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:41:29.573514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.627706+0000","last_change":"2024-09-10T20:55:44.377780+0000","last_active":"2024-09-10T20:55:46.627706+0000","last_peered":"2024-09-10T20:55:46.627706+0000","last_clean":"2024-09-10T20:55:46.627706+0000","last_became_active":"2024-09-10T20:55:44.377120+0000","last_became_peered":"2024-09-10T20:55:44.377120+0000","last_unstale":"2024-09-10T20:55:46.627706+0000","last_undegraded":"2024-09-10T20:55:46.627706+0000","last_fullsized":"2024-09-10T20:55:46.627706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:29.923800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361762+0000","last_change":"2024-09-10T20:55:43.374091+0000","last_active":"2024-09-10T20:55:45.361762+0000","last_peered":"2024-09-10T20:55:45.361762+0000","last_clean":"2024-09-10T20:55:45.361762+0000","last_became_active":"2024-09-10T20:55:43.373736+0000","last_became_peered":"2024-09-10T20:55:43.373736+0000","last_unstale":"2024-09-10T20:55:45.361762+0000","last_undegraded":"2024-09-10T20:55:45.361762+0000","last_fullsized":"2024-09-10T20:55:45.361762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:41:11.107382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364317+0000","last_change":"2024-09-10T20:55:44.382414+0000","last_active":"2024-09-10T20:55:45.364317+0000","last_peered":"2024-09-10T20:55:45.364317+0000","last_clean":"2024-09-10T20:55:45.364317+0000","last_became_active":"2024-09-10T20:55:44.382087+0000","last_became_peered":"2024-09-10T20:55:44.382087+0000","last_unstale":"2024-09-10T20:55:45.364317+0000","last_undegraded":"2024-09-10T20:55:45.364317+0000","last_fullsized":"2024-09-10T20:55:45.364317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:57.600887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364206+0000","last_change":"2024-09-10T20:55:43.380057+0000","last_active":"2024-09-10T20:55:45.364206+0000","last_peered":"2024-09-10T20:55:45.364206+0000","last_clean":"2024-09-10T20:55:45.364206+0000","last_became_active":"2024-09-10T20:55:43.379881+0000","last_became_peered":"2024-09-10T20:55:43.379881+0000","last_unstale":"2024-09-10T20:55:45.364206+0000","last_undegraded":"2024-09-10T20:55:45.364206+0000","last_fullsized":"2024-09-10T20:55:45.364206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:35:50.441609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361728+0000","last_change":"2024-09-10T20:55:44.362979+0000","last_active":"2024-09-10T20:55:45.361728+0000","last_peered":"2024-09-10T20:55:45.361728+0000","last_clean":"2024-09-10T20:55:45.361728+0000","last_became_active":"2024-09-10T20:55:44.362472+0000","last_became_peered":"2024-09-10T20:55:44.362472+0000","last_unstale":"2024-09-10T20:55:45.361728+0000","last_undegraded":"2024-09-10T20:55:45.361728+0000","last_fullsized":"2024-09-10T20:55:45.361728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:32:54.439682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361567+0000","last_change":"2024-09-10T20:55:43.372848+0000","last_active":"2024-09-10T20:55:45.361567+0000","last_peered":"2024-09-10T20:55:45.361567+0000","last_clean":"2024-09-10T20:55:45.361567+0000","last_became_active":"2024-09-10T20:55:43.372619+0000","last_became_peered":"2024-09-10T20:55:43.372619+0000","last_unstale":"2024-09-10T20:55:45.361567+0000","last_undegraded":"2024-09-10T20:55:45.361567+0000","last_fullsized":"2024-09-10T20:55:45.361567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:32.519717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.382754+0000","last_change":"2024-09-10T20:55:44.378521+0000","last_active":"2024-09-10T20:55:44.382754+0000","last_peered":"2024-09-10T20:55:44.382754+0000","last_clean":"2024-09-10T20:55:44.382754+0000","last_became_active":"2024-09-10T20:55:44.378187+0000","last_became_peered":"2024-09-10T20:55:44.378187+0000","last_unstale":"2024-09-10T20:55:44.382754+0000","last_undegraded":"2024-09-10T20:55:44.382754+0000","last_fullsized":"2024-09-10T20:55:44.382754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:49:43.068621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.356149+0000","last_change":"2024-09-10T20:55:43.374477+0000","last_active":"2024-09-10T20:55:46.356149+0000","last_peered":"2024-09-10T20:55:46.356149+0000","last_clean":"2024-09-10T20:55:46.356149+0000","last_became_active":"2024-09-10T20:55:43.373960+0000","last_became_peered":"2024-09-10T20:55:43.373960+0000","last_unstale":"2024-09-10T20:55:46.356149+0000","last_undegraded":"2024-09-10T20:55:46.356149+0000","last_fullsized":"2024-09-10T20:55:46.356149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:04.606474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.386682+0000","last_change":"2024-09-10T20:55:44.377264+0000","last_active":"2024-09-10T20:55:44.386682+0000","last_peered":"2024-09-10T20:55:44.386682+0000","last_clean":"2024-09-10T20:55:44.386682+0000","last_became_active":"2024-09-10T20:55:44.376997+0000","last_became_peered":"2024-09-10T20:55:44.376997+0000","last_unstale":"2024-09-10T20:55:44.386682+0000","last_undegraded":"2024-09-10T20:55:44.386682+0000","last_fullsized":"2024-09-10T20:55:44.386682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:35:10.098109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362099+0000","last_change":"2024-09-10T20:55:43.376292+0000","last_active":"2024-09-10T20:55:45.362099+0000","last_peered":"2024-09-10T20:55:45.362099+0000","last_clean":"2024-09-10T20:55:45.362099+0000","last_became_active":"2024-09-10T20:55:43.375988+0000","last_became_peered":"2024-09-10T20:55:43.375988+0000","last_unstale":"2024-09-10T20:55:45.362099+0000","last_undegraded":"2024-09-10T20:55:45.362099+0000","last_fullsized":"2024-09-10T20:55:45.362099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:41:29.573514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.627612+0000","last_change":"2024-09-10T20:55:44.372839+0000","last_active":"2024-09-10T20:55:46.627612+0000","last_peered":"2024-09-10T20:55:46.627612+0000","last_clean":"2024-09-10T20:55:46.627612+0000","last_became_active":"2024-09-10T20:55:44.372410+0000","last_became_peered":"2024-09-10T20:55:44.372410+0000","last_unstale":"2024-09-10T20:55:46.627612+0000","last_undegraded":"2024-09-10T20:55:46.627612+0000","last_fullsized":"2024-09-10T20:55:46.627612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:27:56.155122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361430+0000","last_change":"2024-09-10T20:55:43.376634+0000","last_active":"2024-09-10T20:55:45.361430+0000","last_peered":"2024-09-10T20:55:45.361430+0000","last_clean":"2024-09-10T20:55:45.361430+0000","last_became_active":"2024-09-10T20:55:43.376322+0000","last_became_peered":"2024-09-10T20:55:43.376322+0000","last_unstale":"2024-09-10T20:55:45.361430+0000","last_undegraded":"2024-09-10T20:55:45.361430+0000","last_fullsized":"2024-09-10T20:55:45.361430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:51:58.280912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.379310+0000","last_change":"2024-09-10T20:55:44.368404+0000","last_active":"2024-09-10T20:55:44.379310+0000","last_peered":"2024-09-10T20:55:44.379310+0000","last_clean":"2024-09-10T20:55:44.379310+0000","last_became_active":"2024-09-10T20:55:44.368024+0000","last_became_peered":"2024-09-10T20:55:44.368024+0000","last_unstale":"2024-09-10T20:55:44.379310+0000","last_undegraded":"2024-09-10T20:55:44.379310+0000","last_fullsized":"2024-09-10T20:55:44.379310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:02:45.844722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361426+0000","last_change":"2024-09-10T20:55:43.362895+0000","last_active":"2024-09-10T20:55:45.361426+0000","last_peered":"2024-09-10T20:55:45.361426+0000","last_clean":"2024-09-10T20:55:45.361426+0000","last_became_active":"2024-09-10T20:55:43.362589+0000","last_became_peered":"2024-09-10T20:55:43.362589+0000","last_unstale":"2024-09-10T20:55:45.361426+0000","last_undegraded":"2024-09-10T20:55:45.361426+0000","last_fullsized":"2024-09-10T20:55:45.361426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:52.212240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.391718+0000","last_change":"2024-09-10T20:55:44.390140+0000","last_active":"2024-09-10T20:55:44.391718+0000","last_peered":"2024-09-10T20:55:44.391718+0000","last_clean":"2024-09-10T20:55:44.391718+0000","last_became_active":"2024-09-10T20:55:44.389852+0000","last_became_peered":"2024-09-10T20:55:44.389852+0000","last_unstale":"2024-09-10T20:55:44.391718+0000","last_undegraded":"2024-09-10T20:55:44.391718+0000","last_fullsized":"2024-09-10T20:55:44.391718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:39:27.469734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363357+0000","last_change":"2024-09-10T20:55:43.376815+0000","last_active":"2024-09-10T20:55:45.363357+0000","last_peered":"2024-09-10T20:55:45.363357+0000","last_clean":"2024-09-10T20:55:45.363357+0000","last_became_active":"2024-09-10T20:55:43.376465+0000","last_became_peered":"2024-09-10T20:55:43.376465+0000","last_unstale":"2024-09-10T20:55:45.363357+0000","last_undegraded":"2024-09-10T20:55:45.363357+0000","last_fullsized":"2024-09-10T20:55:45.363357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:29.358166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.355895+0000","last_change":"2024-09-10T20:55:44.372811+0000","last_active":"2024-09-10T20:55:46.355895+0000","last_peered":"2024-09-10T20:55:46.355895+0000","last_clean":"2024-09-10T20:55:46.355895+0000","last_became_active":"2024-09-10T20:55:44.372498+0000","last_became_peered":"2024-09-10T20:55:44.372498+0000","last_unstale":"2024-09-10T20:55:46.355895+0000","last_undegraded":"2024-09-10T20:55:46.355895+0000","last_fullsized":"2024-09-10T20:55:46.355895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:03:43.922684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364096+0000","last_change":"2024-09-10T20:55:44.356261+0000","last_active":"2024-09-10T20:55:45.364096+0000","last_peered":"2024-09-10T20:55:45.364096+0000","last_clean":"2024-09-10T20:55:45.364096+0000","last_became_active":"2024-09-10T20:55:44.355918+0000","last_became_peered":"2024-09-10T20:55:44.355918+0000","last_unstale":"2024-09-10T20:55:45.364096+0000","last_undegraded":"2024-09-10T20:55:45.364096+0000","last_fullsized":"2024-09-10T20:55:45.364096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:57:27.229133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363650+0000","last_change":"2024-09-10T20:55:43.379354+0000","last_active":"2024-09-10T20:55:45.363650+0000","last_peered":"2024-09-10T20:55:45.363650+0000","last_clean":"2024-09-10T20:55:45.363650+0000","last_became_active":"2024-09-10T20:55:43.378912+0000","last_became_peered":"2024-09-10T20:55:43.378912+0000","last_unstale":"2024-09-10T20:55:45.363650+0000","last_undegraded":"2024-09-10T20:55:45.363650+0000","last_fullsized":"2024-09-10T20:55:45.363650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:16.877259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363676+0000","last_change":"2024-09-10T20:55:44.355826+0000","last_active":"2024-09-10T20:55:45.363676+0000","last_peered":"2024-09-10T20:55:45.363676+0000","last_clean":"2024-09-10T20:55:45.363676+0000","last_became_active":"2024-09-10T20:55:44.355502+0000","last_became_peered":"2024-09-10T20:55:44.355502+0000","last_unstale":"2024-09-10T20:55:45.363676+0000","last_undegraded":"2024-09-10T20:55:45.363676+0000","last_fullsized":"2024-09-10T20:55:45.363676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:46:20.226511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364080+0000","last_change":"2024-09-10T20:55:43.379688+0000","last_active":"2024-09-10T20:55:45.364080+0000","last_peered":"2024-09-10T20:55:45.364080+0000","last_clean":"2024-09-10T20:55:45.364080+0000","last_became_active":"2024-09-10T20:55:43.379480+0000","last_became_peered":"2024-09-10T20:55:43.379480+0000","last_unstale":"2024-09-10T20:55:45.364080+0000","last_undegraded":"2024-09-10T20:55:45.364080+0000","last_fullsized":"2024-09-10T20:55:45.364080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:41:11.107382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.387953+0000","last_change":"2024-09-10T20:55:44.381645+0000","last_active":"2024-09-10T20:55:44.387953+0000","last_peered":"2024-09-10T20:55:44.387953+0000","last_clean":"2024-09-10T20:55:44.387953+0000","last_became_active":"2024-09-10T20:55:44.376799+0000","last_became_peered":"2024-09-10T20:55:44.376799+0000","last_unstale":"2024-09-10T20:55:44.387953+0000","last_undegraded":"2024-09-10T20:55:44.387953+0000","last_fullsized":"2024-09-10T20:55:44.387953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:58.576130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.387283+0000","last_change":"2024-09-10T20:55:43.361529+0000","last_active":"2024-09-10T20:55:44.387283+0000","last_peered":"2024-09-10T20:55:44.387283+0000","last_clean":"2024-09-10T20:55:44.387283+0000","last_became_active":"2024-09-10T20:55:43.361270+0000","last_became_peered":"2024-09-10T20:55:43.361270+0000","last_unstale":"2024-09-10T20:55:44.387283+0000","last_undegraded":"2024-09-10T20:55:44.387283+0000","last_fullsized":"2024-09-10T20:55:44.387283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:26:10.795588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.382609+0000","last_change":"2024-09-10T20:55:44.378339+0000","last_active":"2024-09-10T20:55:44.382609+0000","last_peered":"2024-09-10T20:55:44.382609+0000","last_clean":"2024-09-10T20:55:44.382609+0000","last_became_active":"2024-09-10T20:55:44.378051+0000","last_became_peered":"2024-09-10T20:55:44.378051+0000","last_unstale":"2024-09-10T20:55:44.382609+0000","last_undegraded":"2024-09-10T20:55:44.382609+0000","last_fullsized":"2024-09-10T20:55:44.382609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:47.381553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.384857+0000","last_change":"2024-09-10T20:55:43.370516+0000","last_active":"2024-09-10T20:55:44.384857+0000","last_peered":"2024-09-10T20:55:44.384857+0000","last_clean":"2024-09-10T20:55:44.384857+0000","last_became_active":"2024-09-10T20:55:43.370211+0000","last_became_peered":"2024-09-10T20:55:43.370211+0000","last_unstale":"2024-09-10T20:55:44.384857+0000","last_undegraded":"2024-09-10T20:55:44.384857+0000","last_fullsized":"2024-09-10T20:55:44.384857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:53.823889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":819200,"data_stored":668106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":78768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":77246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":233472,"data_stored":77282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":77156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":77316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":815104,"data_stored":661862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":72468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T20:55:49.462 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T20:55:49.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.654+0000 7ff18f600640 1 -- 172.21.15.6:0/2936239161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff18815c170 msgr2=0x7ff1880cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:49.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.654+0000 7ff18f600640 1 --2- 172.21.15.6:0/2936239161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff18815c170 0x7ff1880cd920 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff188051860 tx=0x7ff17002a4a0 comp rx=0 tx=0).stop 2024-09-10T20:55:49.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.654+0000 7ff18f600640 1 -- 172.21.15.6:0/2936239161 shutdown_connections 2024-09-10T20:55:49.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.654+0000 7ff18f600640 1 --2- 172.21.15.6:0/2936239161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff18815c170 0x7ff1880cd920 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:49.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.654+0000 7ff18f600640 1 --2- 172.21.15.6:0/2936239161 >> v2:172.21.15.150:3300/0 conn(0x7ff188159670 0x7ff1880743b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:49.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.654+0000 7ff18f600640 1 -- 172.21.15.6:0/2936239161 >> 172.21.15.6:0/2936239161 conn(0x7ff1880cfa20 msgr2=0x7ff1880cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:49.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.654+0000 7ff18f600640 1 -- 172.21.15.6:0/2936239161 shutdown_connections 2024-09-10T20:55:49.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.654+0000 7ff18f600640 1 -- 172.21.15.6:0/2936239161 wait complete. 2024-09-10T20:55:49.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.656+0000 7ff18f600640 1 Processor -- start 2024-09-10T20:55:49.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.656+0000 7ff18f600640 1 -- start start 2024-09-10T20:55:49.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.657+0000 7ff18f600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff18806fd40 0x7ff1880cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:49.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.657+0000 7ff18f600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff188159670 0x7ff18815b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:49.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.657+0000 7ff18f600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff18815c170 0x7ff1881f4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:49.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.657+0000 7ff18f600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff1880b4a90 con 0x7ff188159670 2024-09-10T20:55:49.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.657+0000 7ff18f600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff1880b4910 con 0x7ff18806fd40 2024-09-10T20:55:49.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.657+0000 7ff18f600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ff1880b4c10 con 0x7ff18815c170 2024-09-10T20:55:49.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.657+0000 7ff17fe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff188159670 0x7ff18815b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:49.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.657+0000 7ff17fe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff188159670 0x7ff18815b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51010/0 (socket says 172.21.15.6:51010) 2024-09-10T20:55:49.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.657+0000 7ff17fe00640 1 -- 172.21.15.6:0/1670459669 learned_addr learned my addr 172.21.15.6:0/1670459669 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:49.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.657+0000 7ff18cc00640 1 --2- 172.21.15.6:0/1670459669 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff18806fd40 0x7ff1880cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:49.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.657+0000 7ff18d600640 1 --2- 172.21.15.6:0/1670459669 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff18815c170 0x7ff1881f4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:49.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.658+0000 7ff17fe00640 1 -- 172.21.15.6:0/1670459669 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff18815c170 msgr2=0x7ff1881f4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:49.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.658+0000 7ff17fe00640 1 --2- 172.21.15.6:0/1670459669 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff18815c170 0x7ff1881f4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:49.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.658+0000 7ff17fe00640 1 -- 172.21.15.6:0/1670459669 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff18806fd40 msgr2=0x7ff1880cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:49.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.658+0000 7ff17fe00640 1 --2- 172.21.15.6:0/1670459669 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff18806fd40 0x7ff1880cbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:49.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.658+0000 7ff17fe00640 1 -- 172.21.15.6:0/1670459669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff188159ec0 con 0x7ff188159670 2024-09-10T20:55:49.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.658+0000 7ff17fe00640 1 --2- 172.21.15.6:0/1670459669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff188159670 0x7ff18815b9b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff170009920 tx=0x7ff170032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:49.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.658+0000 7ff185600640 1 -- 172.21.15.6:0/1670459669 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff170040070 con 0x7ff188159670 2024-09-10T20:55:49.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.658+0000 7ff185600640 1 -- 172.21.15.6:0/1670459669 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff170005310 con 0x7ff188159670 2024-09-10T20:55:49.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.658+0000 7ff185600640 1 -- 172.21.15.6:0/1670459669 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1700047a0 con 0x7ff188159670 2024-09-10T20:55:49.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.658+0000 7ff18f600640 1 -- 172.21.15.6:0/1670459669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff18815a1a0 con 0x7ff188159670 2024-09-10T20:55:49.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.659+0000 7ff18f600640 1 -- 172.21.15.6:0/1670459669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff18815a760 con 0x7ff188159670 2024-09-10T20:55:49.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.660+0000 7ff18f600640 1 -- 172.21.15.6:0/1670459669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1880b5100 con 0x7ff188159670 2024-09-10T20:55:49.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.661+0000 7ff185600640 1 -- 172.21.15.6:0/1670459669 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff17004c030 con 0x7ff188159670 2024-09-10T20:55:49.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.661+0000 7ff185600640 1 --2- 172.21.15.6:0/1670459669 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ff164077f70 0x7ff16407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:49.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.662+0000 7ff185600640 1 -- 172.21.15.6:0/1670459669 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ff1700bb0d0 con 0x7ff188159670 2024-09-10T20:55:49.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.662+0000 7ff18cc00640 1 --2- 172.21.15.6:0/1670459669 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ff164077f70 0x7ff16407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:49.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.663+0000 7ff18cc00640 1 --2- 172.21.15.6:0/1670459669 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ff164077f70 0x7ff16407a430 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff178009990 tx=0x7ff178009110 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:49.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.666+0000 7ff185600640 1 -- 172.21.15.6:0/1670459669 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff170083bc0 con 0x7ff188159670 2024-09-10T20:55:49.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.933+0000 7ff18f600640 1 -- 172.21.15.6:0/1670459669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7ff188069d20 con 0x7ff188159670 2024-09-10T20:55:49.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.933+0000 7ff185600640 1 -- 172.21.15.6:0/1670459669 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1053 (secure 0 0 0) 0x7ff1700834c0 con 0x7ff188159670 2024-09-10T20:55:49.938 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:55:49.938 INFO:teuthology.orchestra.run.smithi006.stdout:{"fsid":"9e04309e-61c3-4c78-82db-9576e465d98a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":31,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":22,"num_osds":8,"num_up_osds":8,"osd_up_since":1726001732,"num_in_osds":8,"osd_in_since":1726001722,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":224444416,"bytes_avail":772869668864,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":8,"btime":"2024-09-10T20:55:47:367368+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"c","status":"up:active","gid":4375}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-10T20:55:17.974582+0000","services":{}},"progress_events":{}} 2024-09-10T20:55:49.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.936+0000 7ff18f600640 1 -- 172.21.15.6:0/1670459669 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ff164077f70 msgr2=0x7ff16407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:49.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.936+0000 7ff18f600640 1 --2- 172.21.15.6:0/1670459669 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ff164077f70 0x7ff16407a430 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff178009990 tx=0x7ff178009110 comp rx=0 tx=0).stop 2024-09-10T20:55:49.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.936+0000 7ff18f600640 1 -- 172.21.15.6:0/1670459669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff188159670 msgr2=0x7ff18815b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:49.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.936+0000 7ff18f600640 1 --2- 172.21.15.6:0/1670459669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff188159670 0x7ff18815b9b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff170009920 tx=0x7ff170032c10 comp rx=0 tx=0).stop 2024-09-10T20:55:49.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.936+0000 7ff18f600640 1 -- 172.21.15.6:0/1670459669 shutdown_connections 2024-09-10T20:55:49.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.936+0000 7ff18f600640 1 --2- 172.21.15.6:0/1670459669 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ff164077f70 0x7ff16407a430 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:49.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.936+0000 7ff18f600640 1 --2- 172.21.15.6:0/1670459669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff188159670 0x7ff18815b9b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:49.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.936+0000 7ff18f600640 1 --2- 172.21.15.6:0/1670459669 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff18815c170 0x7ff1881f4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:49.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.936+0000 7ff18f600640 1 --2- 172.21.15.6:0/1670459669 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff18806fd40 0x7ff1880cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:49.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.936+0000 7ff18f600640 1 -- 172.21.15.6:0/1670459669 >> 172.21.15.6:0/1670459669 conn(0x7ff1880cfa20 msgr2=0x7ff1880b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:49.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.936+0000 7ff18f600640 1 -- 172.21.15.6:0/1670459669 shutdown_connections 2024-09-10T20:55:49.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:49.936+0000 7ff18f600640 1 -- 172.21.15.6:0/1670459669 wait complete. 2024-09-10T20:55:49.955 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-10T20:55:49.956 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T20:55:50.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.111+0000 7f51afe00640 1 -- 172.21.15.6:0/172913845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51a8159670 msgr2=0x7f51a80743b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:50.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.111+0000 7f51afe00640 1 --2- 172.21.15.6:0/172913845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51a8159670 0x7f51a80743b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f51a80cf5a0 tx=0x7f519c02a580 comp rx=0 tx=0).stop 2024-09-10T20:55:50.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.111+0000 7f51afe00640 1 -- 172.21.15.6:0/172913845 shutdown_connections 2024-09-10T20:55:50.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.111+0000 7f51afe00640 1 --2- 172.21.15.6:0/172913845 >> v2:172.21.15.150:3300/0 conn(0x7f51a8070450 0x7f51a80cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:50.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.111+0000 7f51afe00640 1 --2- 172.21.15.6:0/172913845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51a8159670 0x7f51a80743b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:50.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.111+0000 7f51afe00640 1 -- 172.21.15.6:0/172913845 >> 172.21.15.6:0/172913845 conn(0x7f51a80cfa20 msgr2=0x7f51a80cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:50.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.111+0000 7f51afe00640 1 -- 172.21.15.6:0/172913845 shutdown_connections 2024-09-10T20:55:50.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.111+0000 7f51afe00640 1 -- 172.21.15.6:0/172913845 wait complete. 2024-09-10T20:55:50.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.113+0000 7f51afe00640 1 Processor -- start 2024-09-10T20:55:50.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.113+0000 7f51afe00640 1 -- start start 2024-09-10T20:55:50.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.114+0000 7f51afe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51a8070450 0x7f51a81f5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:50.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.114+0000 7f51afe00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51a8159670 0x7f51a815d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:50.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.114+0000 7f51afe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51a815c170 0x7f51a80c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:50.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.114+0000 7f51afe00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f51a80b4a90 con 0x7f51a815c170 2024-09-10T20:55:50.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.114+0000 7f51afe00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f51a80b4910 con 0x7f51a8070450 2024-09-10T20:55:50.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.114+0000 7f51afe00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f51a80b4c10 con 0x7f51a8159670 2024-09-10T20:55:50.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.114+0000 7f51ade00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51a815c170 0x7f51a80c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:50.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.114+0000 7f51ade00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51a815c170 0x7f51a80c73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51026/0 (socket says 172.21.15.6:51026) 2024-09-10T20:55:50.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.114+0000 7f51ad400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51a8070450 0x7f51a81f5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:50.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.114+0000 7f51ade00640 1 -- 172.21.15.6:0/921595883 learned_addr learned my addr 172.21.15.6:0/921595883 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:50.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.114+0000 7f51aca00640 1 --2- 172.21.15.6:0/921595883 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51a8159670 0x7f51a815d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:50.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.114+0000 7f51ade00640 1 -- 172.21.15.6:0/921595883 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51a8159670 msgr2=0x7f51a815d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:50.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.114+0000 7f51ade00640 1 --2- 172.21.15.6:0/921595883 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51a8159670 0x7f51a815d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:50.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.114+0000 7f51ade00640 1 -- 172.21.15.6:0/921595883 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51a8070450 msgr2=0x7f51a81f5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:50.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.114+0000 7f51ade00640 1 --2- 172.21.15.6:0/921595883 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51a8070450 0x7f51a81f5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:50.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.114+0000 7f51ade00640 1 -- 172.21.15.6:0/921595883 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51a814aab0 con 0x7f51a815c170 2024-09-10T20:55:50.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.115+0000 7f51ade00640 1 --2- 172.21.15.6:0/921595883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51a815c170 0x7f51a80c73f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f51a000e960 tx=0x7f51a000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:50.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.115+0000 7f51a5600640 1 -- 172.21.15.6:0/921595883 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a0004d20 con 0x7f51a815c170 2024-09-10T20:55:50.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.115+0000 7f51a5600640 1 -- 172.21.15.6:0/921595883 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51a000cb20 con 0x7f51a815c170 2024-09-10T20:55:50.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.115+0000 7f51a5600640 1 -- 172.21.15.6:0/921595883 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a0005020 con 0x7f51a815c170 2024-09-10T20:55:50.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.115+0000 7f51afe00640 1 -- 172.21.15.6:0/921595883 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51a814ad90 con 0x7f51a815c170 2024-09-10T20:55:50.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.115+0000 7f51afe00640 1 -- 172.21.15.6:0/921595883 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51a814b350 con 0x7f51a815c170 2024-09-10T20:55:50.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.116+0000 7f51afe00640 1 -- 172.21.15.6:0/921595883 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51a80b50c0 con 0x7f51a815c170 2024-09-10T20:55:50.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.117+0000 7f51a5600640 1 -- 172.21.15.6:0/921595883 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f51a000f040 con 0x7f51a815c170 2024-09-10T20:55:50.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.118+0000 7f51a5600640 1 --2- 172.21.15.6:0/921595883 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5188077f70 0x7f518807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:50.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.118+0000 7f51a5600640 1 -- 172.21.15.6:0/921595883 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f51a009a2b0 con 0x7f51a815c170 2024-09-10T20:55:50.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.118+0000 7f51ad400640 1 --2- 172.21.15.6:0/921595883 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5188077f70 0x7f518807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:50.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.119+0000 7f51ad400640 1 --2- 172.21.15.6:0/921595883 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5188077f70 0x7f518807a430 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f519c033000 tx=0x7f519c004730 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:50.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.122+0000 7f51a5600640 1 -- 172.21.15.6:0/921595883 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f51a0016030 con 0x7f51a815c170 2024-09-10T20:55:50.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.314+0000 7f51afe00640 1 -- 172.21.15.6:0/921595883 --> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f51a8069d20 con 0x7f5188077f70 2024-09-10T20:55:50.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.319+0000 7f51a5600640 1 -- 172.21.15.6:0/921595883 <== mgr.4120 v2:172.21.15.150:6800/1238179351 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251936 (secure 0 0 0) 0x7f51a8069d20 con 0x7f5188077f70 2024-09-10T20:55:50.326 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:55:50.328 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-10T20:55:50.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.323+0000 7f51afe00640 1 -- 172.21.15.6:0/921595883 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5188077f70 msgr2=0x7f518807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:50.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.323+0000 7f51afe00640 1 --2- 172.21.15.6:0/921595883 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5188077f70 0x7f518807a430 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f519c033000 tx=0x7f519c004730 comp rx=0 tx=0).stop 2024-09-10T20:55:50.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.323+0000 7f51afe00640 1 -- 172.21.15.6:0/921595883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51a815c170 msgr2=0x7f51a80c73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:50.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.323+0000 7f51afe00640 1 --2- 172.21.15.6:0/921595883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51a815c170 0x7f51a80c73f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f51a000e960 tx=0x7f51a000ee20 comp rx=0 tx=0).stop 2024-09-10T20:55:50.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.324+0000 7f51afe00640 1 -- 172.21.15.6:0/921595883 shutdown_connections 2024-09-10T20:55:50.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.324+0000 7f51afe00640 1 --2- 172.21.15.6:0/921595883 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5188077f70 0x7f518807a430 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:50.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.324+0000 7f51afe00640 1 --2- 172.21.15.6:0/921595883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51a815c170 0x7f51a80c73f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:50.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.324+0000 7f51afe00640 1 --2- 172.21.15.6:0/921595883 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51a8159670 0x7f51a815d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:50.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.324+0000 7f51afe00640 1 --2- 172.21.15.6:0/921595883 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51a8070450 0x7f51a81f5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:50.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.324+0000 7f51afe00640 1 -- 172.21.15.6:0/921595883 >> 172.21.15.6:0/921595883 conn(0x7f51a80cfa20 msgr2=0x7f51a80734f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:50.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.324+0000 7f51afe00640 1 -- 172.21.15.6:0/921595883 shutdown_connections 2024-09-10T20:55:50.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:50.324+0000 7f51afe00640 1 -- 172.21.15.6:0/921595883 wait complete. 2024-09-10T20:55:50.343 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-10T20:55:49.172494+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":160,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219184,"kb_used_data":2928,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755536,"statfs":{"total":773094113280,"available":772869668864,"internally_reserved":0,"allocated":2998272,"data_stored":1790204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001561"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364560+0000","last_change":"2024-09-10T20:55:44.378371+0000","last_active":"2024-09-10T20:55:45.364560+0000","last_peered":"2024-09-10T20:55:45.364560+0000","last_clean":"2024-09-10T20:55:45.364560+0000","last_became_active":"2024-09-10T20:55:44.375917+0000","last_became_peered":"2024-09-10T20:55:44.375917+0000","last_unstale":"2024-09-10T20:55:45.364560+0000","last_undegraded":"2024-09-10T20:55:45.364560+0000","last_fullsized":"2024-09-10T20:55:45.364560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:55:42.603736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361499+0000","last_change":"2024-09-10T20:55:44.378072+0000","last_active":"2024-09-10T20:55:45.361499+0000","last_peered":"2024-09-10T20:55:45.361499+0000","last_clean":"2024-09-10T20:55:45.361499+0000","last_became_active":"2024-09-10T20:55:44.377702+0000","last_became_peered":"2024-09-10T20:55:44.377702+0000","last_unstale":"2024-09-10T20:55:45.361499+0000","last_undegraded":"2024-09-10T20:55:45.361499+0000","last_fullsized":"2024-09-10T20:55:45.361499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:19.756412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.386531+0000","last_change":"2024-09-10T20:55:44.373164+0000","last_active":"2024-09-10T20:55:44.386531+0000","last_peered":"2024-09-10T20:55:44.386531+0000","last_clean":"2024-09-10T20:55:44.386531+0000","last_became_active":"2024-09-10T20:55:44.370647+0000","last_became_peered":"2024-09-10T20:55:44.370647+0000","last_unstale":"2024-09-10T20:55:44.386531+0000","last_undegraded":"2024-09-10T20:55:44.386531+0000","last_fullsized":"2024-09-10T20:55:44.386531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:33.526797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364549+0000","last_change":"2024-09-10T20:55:44.383084+0000","last_active":"2024-09-10T20:55:45.364549+0000","last_peered":"2024-09-10T20:55:45.364549+0000","last_clean":"2024-09-10T20:55:45.364549+0000","last_became_active":"2024-09-10T20:55:44.382543+0000","last_became_peered":"2024-09-10T20:55:44.382543+0000","last_unstale":"2024-09-10T20:55:45.364549+0000","last_undegraded":"2024-09-10T20:55:45.364549+0000","last_fullsized":"2024-09-10T20:55:45.364549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:56.566092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362995+0000","last_change":"2024-09-10T20:55:44.373531+0000","last_active":"2024-09-10T20:55:45.362995+0000","last_peered":"2024-09-10T20:55:45.362995+0000","last_clean":"2024-09-10T20:55:45.362995+0000","last_became_active":"2024-09-10T20:55:44.373234+0000","last_became_peered":"2024-09-10T20:55:44.373234+0000","last_unstale":"2024-09-10T20:55:45.362995+0000","last_undegraded":"2024-09-10T20:55:45.362995+0000","last_fullsized":"2024-09-10T20:55:45.362995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:18:22.966502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362646+0000","last_change":"2024-09-10T20:55:44.375328+0000","last_active":"2024-09-10T20:55:45.362646+0000","last_peered":"2024-09-10T20:55:45.362646+0000","last_clean":"2024-09-10T20:55:45.362646+0000","last_became_active":"2024-09-10T20:55:44.375024+0000","last_became_peered":"2024-09-10T20:55:44.375024+0000","last_unstale":"2024-09-10T20:55:45.362646+0000","last_undegraded":"2024-09-10T20:55:45.362646+0000","last_fullsized":"2024-09-10T20:55:45.362646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:32:54.439682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362477+0000","last_change":"2024-09-10T20:55:44.385176+0000","last_active":"2024-09-10T20:55:45.362477+0000","last_peered":"2024-09-10T20:55:45.362477+0000","last_clean":"2024-09-10T20:55:45.362477+0000","last_became_active":"2024-09-10T20:55:44.384916+0000","last_became_peered":"2024-09-10T20:55:44.384916+0000","last_unstale":"2024-09-10T20:55:45.362477+0000","last_undegraded":"2024-09-10T20:55:45.362477+0000","last_fullsized":"2024-09-10T20:55:45.362477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:51:21.066719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.382446+0000","last_change":"2024-09-10T20:55:44.374342+0000","last_active":"2024-09-10T20:55:44.382446+0000","last_peered":"2024-09-10T20:55:44.382446+0000","last_clean":"2024-09-10T20:55:44.382446+0000","last_became_active":"2024-09-10T20:55:44.373477+0000","last_became_peered":"2024-09-10T20:55:44.373477+0000","last_unstale":"2024-09-10T20:55:44.382446+0000","last_undegraded":"2024-09-10T20:55:44.382446+0000","last_fullsized":"2024-09-10T20:55:44.382446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:26:18.554273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364578+0000","last_change":"2024-09-10T20:55:44.379912+0000","last_active":"2024-09-10T20:55:45.364578+0000","last_peered":"2024-09-10T20:55:45.364578+0000","last_clean":"2024-09-10T20:55:45.364578+0000","last_became_active":"2024-09-10T20:55:44.379632+0000","last_became_peered":"2024-09-10T20:55:44.379632+0000","last_unstale":"2024-09-10T20:55:45.364578+0000","last_undegraded":"2024-09-10T20:55:45.364578+0000","last_fullsized":"2024-09-10T20:55:45.364578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:31:58.187489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.356250+0000","last_change":"2024-09-10T20:55:44.379776+0000","last_active":"2024-09-10T20:55:46.356250+0000","last_peered":"2024-09-10T20:55:46.356250+0000","last_clean":"2024-09-10T20:55:46.356250+0000","last_became_active":"2024-09-10T20:55:44.379512+0000","last_became_peered":"2024-09-10T20:55:44.379512+0000","last_unstale":"2024-09-10T20:55:46.356250+0000","last_undegraded":"2024-09-10T20:55:46.356250+0000","last_fullsized":"2024-09-10T20:55:46.356250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:08.229059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.356236+0000","last_change":"2024-09-10T20:55:44.372935+0000","last_active":"2024-09-10T20:55:46.356236+0000","last_peered":"2024-09-10T20:55:46.356236+0000","last_clean":"2024-09-10T20:55:46.356236+0000","last_became_active":"2024-09-10T20:55:44.372660+0000","last_became_peered":"2024-09-10T20:55:44.372660+0000","last_unstale":"2024-09-10T20:55:46.356236+0000","last_undegraded":"2024-09-10T20:55:46.356236+0000","last_fullsized":"2024-09-10T20:55:46.356236+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:16:49.875268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.627691+0000","last_change":"2024-09-10T20:55:44.381853+0000","last_active":"2024-09-10T20:55:46.627691+0000","last_peered":"2024-09-10T20:55:46.627691+0000","last_clean":"2024-09-10T20:55:46.627691+0000","last_became_active":"2024-09-10T20:55:44.381283+0000","last_became_peered":"2024-09-10T20:55:44.381283+0000","last_unstale":"2024-09-10T20:55:46.627691+0000","last_undegraded":"2024-09-10T20:55:46.627691+0000","last_fullsized":"2024-09-10T20:55:46.627691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:01:41.450845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.386716+0000","last_change":"2024-09-10T20:55:44.380947+0000","last_active":"2024-09-10T20:55:44.386716+0000","last_peered":"2024-09-10T20:55:44.386716+0000","last_clean":"2024-09-10T20:55:44.386716+0000","last_became_active":"2024-09-10T20:55:44.380246+0000","last_became_peered":"2024-09-10T20:55:44.380246+0000","last_unstale":"2024-09-10T20:55:44.386716+0000","last_undegraded":"2024-09-10T20:55:44.386716+0000","last_fullsized":"2024-09-10T20:55:44.386716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:19:22.962575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.386628+0000","last_change":"2024-09-10T20:55:44.380329+0000","last_active":"2024-09-10T20:55:44.386628+0000","last_peered":"2024-09-10T20:55:44.386628+0000","last_clean":"2024-09-10T20:55:44.386628+0000","last_became_active":"2024-09-10T20:55:44.379878+0000","last_became_peered":"2024-09-10T20:55:44.379878+0000","last_unstale":"2024-09-10T20:55:44.386628+0000","last_undegraded":"2024-09-10T20:55:44.386628+0000","last_fullsized":"2024-09-10T20:55:44.386628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:47:16.684070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361378+0000","last_change":"2024-09-10T20:55:44.369874+0000","last_active":"2024-09-10T20:55:45.361378+0000","last_peered":"2024-09-10T20:55:45.361378+0000","last_clean":"2024-09-10T20:55:45.361378+0000","last_became_active":"2024-09-10T20:55:44.369125+0000","last_became_peered":"2024-09-10T20:55:44.369125+0000","last_unstale":"2024-09-10T20:55:45.361378+0000","last_undegraded":"2024-09-10T20:55:45.361378+0000","last_fullsized":"2024-09-10T20:55:45.361378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:48:52.277148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362575+0000","last_change":"2024-09-10T20:55:44.377717+0000","last_active":"2024-09-10T20:55:45.362575+0000","last_peered":"2024-09-10T20:55:45.362575+0000","last_clean":"2024-09-10T20:55:45.362575+0000","last_became_active":"2024-09-10T20:55:44.376176+0000","last_became_peered":"2024-09-10T20:55:44.376176+0000","last_unstale":"2024-09-10T20:55:45.362575+0000","last_undegraded":"2024-09-10T20:55:45.362575+0000","last_fullsized":"2024-09-10T20:55:45.362575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:19.756412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363854+0000","last_change":"2024-09-10T20:55:44.371382+0000","last_active":"2024-09-10T20:55:45.363854+0000","last_peered":"2024-09-10T20:55:45.363854+0000","last_clean":"2024-09-10T20:55:45.363854+0000","last_became_active":"2024-09-10T20:55:44.371044+0000","last_became_peered":"2024-09-10T20:55:44.371044+0000","last_unstale":"2024-09-10T20:55:45.363854+0000","last_undegraded":"2024-09-10T20:55:45.363854+0000","last_fullsized":"2024-09-10T20:55:45.363854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:31:48.282296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.918190+0000","last_change":"2024-09-10T20:55:44.375032+0000","last_active":"2024-09-10T20:55:45.918190+0000","last_peered":"2024-09-10T20:55:45.918190+0000","last_clean":"2024-09-10T20:55:45.918190+0000","last_became_active":"2024-09-10T20:55:44.374735+0000","last_became_peered":"2024-09-10T20:55:44.374735+0000","last_unstale":"2024-09-10T20:55:45.918190+0000","last_undegraded":"2024-09-10T20:55:45.918190+0000","last_fullsized":"2024-09-10T20:55:45.918190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:30.365247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364255+0000","last_change":"2024-09-10T20:55:44.379134+0000","last_active":"2024-09-10T20:55:45.364255+0000","last_peered":"2024-09-10T20:55:45.364255+0000","last_clean":"2024-09-10T20:55:45.364255+0000","last_became_active":"2024-09-10T20:55:44.378814+0000","last_became_peered":"2024-09-10T20:55:44.378814+0000","last_unstale":"2024-09-10T20:55:45.364255+0000","last_undegraded":"2024-09-10T20:55:45.364255+0000","last_fullsized":"2024-09-10T20:55:45.364255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:45:07.152884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.356325+0000","last_change":"2024-09-10T20:55:44.381800+0000","last_active":"2024-09-10T20:55:46.356325+0000","last_peered":"2024-09-10T20:55:46.356325+0000","last_clean":"2024-09-10T20:55:46.356325+0000","last_became_active":"2024-09-10T20:55:44.380382+0000","last_became_peered":"2024-09-10T20:55:44.380382+0000","last_unstale":"2024-09-10T20:55:46.356325+0000","last_undegraded":"2024-09-10T20:55:46.356325+0000","last_fullsized":"2024-09-10T20:55:46.356325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:58.419795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.390713+0000","last_change":"2024-09-10T20:55:44.385859+0000","last_active":"2024-09-10T20:55:44.390713+0000","last_peered":"2024-09-10T20:55:44.390713+0000","last_clean":"2024-09-10T20:55:44.390713+0000","last_became_active":"2024-09-10T20:55:44.383049+0000","last_became_peered":"2024-09-10T20:55:44.383049+0000","last_unstale":"2024-09-10T20:55:44.390713+0000","last_undegraded":"2024-09-10T20:55:44.390713+0000","last_fullsized":"2024-09-10T20:55:44.390713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:32:06.996501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362652+0000","last_change":"2024-09-10T20:55:44.373313+0000","last_active":"2024-09-10T20:55:45.362652+0000","last_peered":"2024-09-10T20:55:45.362652+0000","last_clean":"2024-09-10T20:55:45.362652+0000","last_became_active":"2024-09-10T20:55:44.372975+0000","last_became_peered":"2024-09-10T20:55:44.372975+0000","last_unstale":"2024-09-10T20:55:45.362652+0000","last_undegraded":"2024-09-10T20:55:45.362652+0000","last_fullsized":"2024-09-10T20:55:45.362652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:49:46.518440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.379972+0000","last_change":"2024-09-10T20:55:44.372460+0000","last_active":"2024-09-10T20:55:44.379972+0000","last_peered":"2024-09-10T20:55:44.379972+0000","last_clean":"2024-09-10T20:55:44.379972+0000","last_became_active":"2024-09-10T20:55:44.372166+0000","last_became_peered":"2024-09-10T20:55:44.372166+0000","last_unstale":"2024-09-10T20:55:44.379972+0000","last_undegraded":"2024-09-10T20:55:44.379972+0000","last_fullsized":"2024-09-10T20:55:44.379972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:41.531837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362773+0000","last_change":"2024-09-10T20:55:44.382439+0000","last_active":"2024-09-10T20:55:45.362773+0000","last_peered":"2024-09-10T20:55:45.362773+0000","last_clean":"2024-09-10T20:55:45.362773+0000","last_became_active":"2024-09-10T20:55:44.382157+0000","last_became_peered":"2024-09-10T20:55:44.382157+0000","last_unstale":"2024-09-10T20:55:45.362773+0000","last_undegraded":"2024-09-10T20:55:45.362773+0000","last_fullsized":"2024-09-10T20:55:45.362773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:51:21.066719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.383114+0000","last_change":"2024-09-10T20:55:44.379140+0000","last_active":"2024-09-10T20:55:44.383114+0000","last_peered":"2024-09-10T20:55:44.383114+0000","last_clean":"2024-09-10T20:55:44.383114+0000","last_became_active":"2024-09-10T20:55:44.378867+0000","last_became_peered":"2024-09-10T20:55:44.378867+0000","last_unstale":"2024-09-10T20:55:44.383114+0000","last_undegraded":"2024-09-10T20:55:44.383114+0000","last_fullsized":"2024-09-10T20:55:44.383114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:15:31.022675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.356316+0000","last_change":"2024-09-10T20:55:44.374130+0000","last_active":"2024-09-10T20:55:46.356316+0000","last_peered":"2024-09-10T20:55:46.356316+0000","last_clean":"2024-09-10T20:55:46.356316+0000","last_became_active":"2024-09-10T20:55:44.373755+0000","last_became_peered":"2024-09-10T20:55:44.373755+0000","last_unstale":"2024-09-10T20:55:46.356316+0000","last_undegraded":"2024-09-10T20:55:46.356316+0000","last_fullsized":"2024-09-10T20:55:46.356316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:19.756412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361498+0000","last_change":"2024-09-10T20:55:44.380940+0000","last_active":"2024-09-10T20:55:45.361498+0000","last_peered":"2024-09-10T20:55:45.361498+0000","last_clean":"2024-09-10T20:55:45.361498+0000","last_became_active":"2024-09-10T20:55:44.380667+0000","last_became_peered":"2024-09-10T20:55:44.380667+0000","last_unstale":"2024-09-10T20:55:45.361498+0000","last_undegraded":"2024-09-10T20:55:45.361498+0000","last_fullsized":"2024-09-10T20:55:45.361498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:08.229059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.386702+0000","last_change":"2024-09-10T20:55:44.380864+0000","last_active":"2024-09-10T20:55:44.386702+0000","last_peered":"2024-09-10T20:55:44.386702+0000","last_clean":"2024-09-10T20:55:44.386702+0000","last_became_active":"2024-09-10T20:55:44.380634+0000","last_became_peered":"2024-09-10T20:55:44.380634+0000","last_unstale":"2024-09-10T20:55:44.386702+0000","last_undegraded":"2024-09-10T20:55:44.386702+0000","last_fullsized":"2024-09-10T20:55:44.386702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:58:46.746674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.393149+0000","last_change":"2024-09-10T20:55:44.388198+0000","last_active":"2024-09-10T20:55:44.393149+0000","last_peered":"2024-09-10T20:55:44.393149+0000","last_clean":"2024-09-10T20:55:44.393149+0000","last_became_active":"2024-09-10T20:55:44.387343+0000","last_became_peered":"2024-09-10T20:55:44.387343+0000","last_unstale":"2024-09-10T20:55:44.393149+0000","last_undegraded":"2024-09-10T20:55:44.393149+0000","last_fullsized":"2024-09-10T20:55:44.393149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:09:08.651876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364492+0000","last_change":"2024-09-10T20:55:44.380482+0000","last_active":"2024-09-10T20:55:45.364492+0000","last_peered":"2024-09-10T20:55:45.364492+0000","last_clean":"2024-09-10T20:55:45.364492+0000","last_became_active":"2024-09-10T20:55:44.379945+0000","last_became_peered":"2024-09-10T20:55:44.379945+0000","last_unstale":"2024-09-10T20:55:45.364492+0000","last_undegraded":"2024-09-10T20:55:45.364492+0000","last_fullsized":"2024-09-10T20:55:45.364492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:15:59.746371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.918084+0000","last_change":"2024-09-10T20:55:44.369574+0000","last_active":"2024-09-10T20:55:45.918084+0000","last_peered":"2024-09-10T20:55:45.918084+0000","last_clean":"2024-09-10T20:55:45.918084+0000","last_became_active":"2024-09-10T20:55:44.365888+0000","last_became_peered":"2024-09-10T20:55:44.365888+0000","last_unstale":"2024-09-10T20:55:45.918084+0000","last_undegraded":"2024-09-10T20:55:45.918084+0000","last_fullsized":"2024-09-10T20:55:45.918084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:41:12.114462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.355892+0000","last_change":"2024-09-10T20:55:44.387588+0000","last_active":"2024-09-10T20:55:46.355892+0000","last_peered":"2024-09-10T20:55:46.355892+0000","last_clean":"2024-09-10T20:55:46.355892+0000","last_became_active":"2024-09-10T20:55:44.387293+0000","last_became_peered":"2024-09-10T20:55:44.387293+0000","last_unstale":"2024-09-10T20:55:46.355892+0000","last_undegraded":"2024-09-10T20:55:46.355892+0000","last_fullsized":"2024-09-10T20:55:46.355892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:26:35.929548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.627619+0000","last_change":"2024-09-10T20:55:44.364063+0000","last_active":"2024-09-10T20:55:46.627619+0000","last_peered":"2024-09-10T20:55:46.627619+0000","last_clean":"2024-09-10T20:55:46.627619+0000","last_became_active":"2024-09-10T20:55:44.363460+0000","last_became_peered":"2024-09-10T20:55:44.363460+0000","last_unstale":"2024-09-10T20:55:46.627619+0000","last_undegraded":"2024-09-10T20:55:46.627619+0000","last_fullsized":"2024-09-10T20:55:46.627619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:49.994707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.383609+0000","last_change":"2024-09-10T20:55:43.368822+0000","last_active":"2024-09-10T20:55:44.383609+0000","last_peered":"2024-09-10T20:55:44.383609+0000","last_clean":"2024-09-10T20:55:44.383609+0000","last_became_active":"2024-09-10T20:55:43.368565+0000","last_became_peered":"2024-09-10T20:55:43.368565+0000","last_unstale":"2024-09-10T20:55:44.383609+0000","last_undegraded":"2024-09-10T20:55:44.383609+0000","last_fullsized":"2024-09-10T20:55:44.383609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:23:19.583021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.388414+0000","last_change":"2024-09-10T20:55:44.372807+0000","last_active":"2024-09-10T20:55:44.388414+0000","last_peered":"2024-09-10T20:55:44.388414+0000","last_clean":"2024-09-10T20:55:44.388414+0000","last_became_active":"2024-09-10T20:55:44.372476+0000","last_became_peered":"2024-09-10T20:55:44.372476+0000","last_unstale":"2024-09-10T20:55:44.388414+0000","last_undegraded":"2024-09-10T20:55:44.388414+0000","last_fullsized":"2024-09-10T20:55:44.388414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:26:00.655943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.355691+0000","last_change":"2024-09-10T20:55:43.372918+0000","last_active":"2024-09-10T20:55:46.355691+0000","last_peered":"2024-09-10T20:55:46.355691+0000","last_clean":"2024-09-10T20:55:46.355691+0000","last_became_active":"2024-09-10T20:55:43.369953+0000","last_became_peered":"2024-09-10T20:55:43.369953+0000","last_unstale":"2024-09-10T20:55:46.355691+0000","last_undegraded":"2024-09-10T20:55:46.355691+0000","last_fullsized":"2024-09-10T20:55:46.355691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:51:58.280912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.368340+0000","last_change":"2024-09-10T20:55:43.370997+0000","last_active":"2024-09-10T20:55:44.368340+0000","last_peered":"2024-09-10T20:55:44.368340+0000","last_clean":"2024-09-10T20:55:44.368340+0000","last_became_active":"2024-09-10T20:55:43.370753+0000","last_became_peered":"2024-09-10T20:55:43.370753+0000","last_unstale":"2024-09-10T20:55:44.368340+0000","last_undegraded":"2024-09-10T20:55:44.368340+0000","last_fullsized":"2024-09-10T20:55:44.368340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:04:30.007942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.386755+0000","last_change":"2024-09-10T20:55:44.381520+0000","last_active":"2024-09-10T20:55:44.386755+0000","last_peered":"2024-09-10T20:55:44.386755+0000","last_clean":"2024-09-10T20:55:44.386755+0000","last_became_active":"2024-09-10T20:55:44.381184+0000","last_became_peered":"2024-09-10T20:55:44.381184+0000","last_unstale":"2024-09-10T20:55:44.386755+0000","last_undegraded":"2024-09-10T20:55:44.386755+0000","last_fullsized":"2024-09-10T20:55:44.386755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:10:56.591857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362827+0000","last_change":"2024-09-10T20:55:43.363749+0000","last_active":"2024-09-10T20:55:45.362827+0000","last_peered":"2024-09-10T20:55:45.362827+0000","last_clean":"2024-09-10T20:55:45.362827+0000","last_became_active":"2024-09-10T20:55:43.363070+0000","last_became_peered":"2024-09-10T20:55:43.363070+0000","last_unstale":"2024-09-10T20:55:45.362827+0000","last_undegraded":"2024-09-10T20:55:45.362827+0000","last_fullsized":"2024-09-10T20:55:45.362827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:44.779833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361364+0000","last_change":"2024-09-10T20:55:44.377537+0000","last_active":"2024-09-10T20:55:45.361364+0000","last_peered":"2024-09-10T20:55:45.361364+0000","last_clean":"2024-09-10T20:55:45.361364+0000","last_became_active":"2024-09-10T20:55:44.377261+0000","last_became_peered":"2024-09-10T20:55:44.377261+0000","last_unstale":"2024-09-10T20:55:45.361364+0000","last_undegraded":"2024-09-10T20:55:45.361364+0000","last_fullsized":"2024-09-10T20:55:45.361364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:21:11.284661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.356082+0000","last_change":"2024-09-10T20:55:43.371067+0000","last_active":"2024-09-10T20:55:46.356082+0000","last_peered":"2024-09-10T20:55:46.356082+0000","last_clean":"2024-09-10T20:55:46.356082+0000","last_became_active":"2024-09-10T20:55:43.370788+0000","last_became_peered":"2024-09-10T20:55:43.370788+0000","last_unstale":"2024-09-10T20:55:46.356082+0000","last_undegraded":"2024-09-10T20:55:46.356082+0000","last_fullsized":"2024-09-10T20:55:46.356082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:41:29.573514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363411+0000","last_change":"2024-09-10T20:55:44.378830+0000","last_active":"2024-09-10T20:55:45.363411+0000","last_peered":"2024-09-10T20:55:45.363411+0000","last_clean":"2024-09-10T20:55:45.363411+0000","last_became_active":"2024-09-10T20:55:44.378020+0000","last_became_peered":"2024-09-10T20:55:44.378020+0000","last_unstale":"2024-09-10T20:55:45.363411+0000","last_undegraded":"2024-09-10T20:55:45.363411+0000","last_fullsized":"2024-09-10T20:55:45.363411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:23:32.772228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363472+0000","last_change":"2024-09-10T20:55:43.372861+0000","last_active":"2024-09-10T20:55:45.363472+0000","last_peered":"2024-09-10T20:55:45.363472+0000","last_clean":"2024-09-10T20:55:45.363472+0000","last_became_active":"2024-09-10T20:55:43.372596+0000","last_became_peered":"2024-09-10T20:55:43.372596+0000","last_unstale":"2024-09-10T20:55:45.363472+0000","last_undegraded":"2024-09-10T20:55:45.363472+0000","last_fullsized":"2024-09-10T20:55:45.363472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:51:58.280912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.384926+0000","last_change":"2024-09-10T20:55:44.368307+0000","last_active":"2024-09-10T20:55:44.384926+0000","last_peered":"2024-09-10T20:55:44.384926+0000","last_clean":"2024-09-10T20:55:44.384926+0000","last_became_active":"2024-09-10T20:55:44.365395+0000","last_became_peered":"2024-09-10T20:55:44.365395+0000","last_unstale":"2024-09-10T20:55:44.384926+0000","last_undegraded":"2024-09-10T20:55:44.384926+0000","last_fullsized":"2024-09-10T20:55:44.384926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:24.328528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361560+0000","last_change":"2024-09-10T20:55:43.366971+0000","last_active":"2024-09-10T20:55:45.361560+0000","last_peered":"2024-09-10T20:55:45.361560+0000","last_clean":"2024-09-10T20:55:45.361560+0000","last_became_active":"2024-09-10T20:55:43.366692+0000","last_became_peered":"2024-09-10T20:55:43.366692+0000","last_unstale":"2024-09-10T20:55:45.361560+0000","last_undegraded":"2024-09-10T20:55:45.361560+0000","last_fullsized":"2024-09-10T20:55:45.361560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:04.606474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.627783+0000","last_change":"2024-09-10T20:55:44.368208+0000","last_active":"2024-09-10T20:55:46.627783+0000","last_peered":"2024-09-10T20:55:46.627783+0000","last_clean":"2024-09-10T20:55:46.627783+0000","last_became_active":"2024-09-10T20:55:44.367944+0000","last_became_peered":"2024-09-10T20:55:44.367944+0000","last_unstale":"2024-09-10T20:55:46.627783+0000","last_undegraded":"2024-09-10T20:55:46.627783+0000","last_fullsized":"2024-09-10T20:55:46.627783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:37:32.042518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.356052+0000","last_change":"2024-09-10T20:55:43.370938+0000","last_active":"2024-09-10T20:55:46.356052+0000","last_peered":"2024-09-10T20:55:46.356052+0000","last_clean":"2024-09-10T20:55:46.356052+0000","last_became_active":"2024-09-10T20:55:43.370674+0000","last_became_peered":"2024-09-10T20:55:43.370674+0000","last_unstale":"2024-09-10T20:55:46.356052+0000","last_undegraded":"2024-09-10T20:55:46.356052+0000","last_fullsized":"2024-09-10T20:55:46.356052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:52.212240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363966+0000","last_change":"2024-09-10T20:55:44.383665+0000","last_active":"2024-09-10T20:55:45.363966+0000","last_peered":"2024-09-10T20:55:45.363966+0000","last_clean":"2024-09-10T20:55:45.363966+0000","last_became_active":"2024-09-10T20:55:44.382473+0000","last_became_peered":"2024-09-10T20:55:44.382473+0000","last_unstale":"2024-09-10T20:55:45.363966+0000","last_undegraded":"2024-09-10T20:55:45.363966+0000","last_fullsized":"2024-09-10T20:55:45.363966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:04:31.815506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.388672+0000","last_change":"2024-09-10T20:55:43.365123+0000","last_active":"2024-09-10T20:55:44.388672+0000","last_peered":"2024-09-10T20:55:44.388672+0000","last_clean":"2024-09-10T20:55:44.388672+0000","last_became_active":"2024-09-10T20:55:43.364866+0000","last_became_peered":"2024-09-10T20:55:43.364866+0000","last_unstale":"2024-09-10T20:55:44.388672+0000","last_undegraded":"2024-09-10T20:55:44.388672+0000","last_fullsized":"2024-09-10T20:55:44.388672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:07:11.228176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.388518+0000","last_change":"2024-09-10T20:55:44.384522+0000","last_active":"2024-09-10T20:55:44.388518+0000","last_peered":"2024-09-10T20:55:44.388518+0000","last_clean":"2024-09-10T20:55:44.388518+0000","last_became_active":"2024-09-10T20:55:44.373788+0000","last_became_peered":"2024-09-10T20:55:44.373788+0000","last_unstale":"2024-09-10T20:55:44.388518+0000","last_undegraded":"2024-09-10T20:55:44.388518+0000","last_fullsized":"2024-09-10T20:55:44.388518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:55.041551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364231+0000","last_change":"2024-09-10T20:55:43.367632+0000","last_active":"2024-09-10T20:55:45.364231+0000","last_peered":"2024-09-10T20:55:45.364231+0000","last_clean":"2024-09-10T20:55:45.364231+0000","last_became_active":"2024-09-10T20:55:43.366886+0000","last_became_peered":"2024-09-10T20:55:43.366886+0000","last_unstale":"2024-09-10T20:55:45.364231+0000","last_undegraded":"2024-09-10T20:55:45.364231+0000","last_fullsized":"2024-09-10T20:55:45.364231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:52.212240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363214+0000","last_change":"2024-09-10T20:55:44.378167+0000","last_active":"2024-09-10T20:55:45.363214+0000","last_peered":"2024-09-10T20:55:45.363214+0000","last_clean":"2024-09-10T20:55:45.363214+0000","last_became_active":"2024-09-10T20:55:44.377891+0000","last_became_peered":"2024-09-10T20:55:44.377891+0000","last_unstale":"2024-09-10T20:55:45.363214+0000","last_undegraded":"2024-09-10T20:55:45.363214+0000","last_fullsized":"2024-09-10T20:55:45.363214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:03:40.884856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.355694+0000","last_change":"2024-09-10T20:55:43.374275+0000","last_active":"2024-09-10T20:55:46.355694+0000","last_peered":"2024-09-10T20:55:46.355694+0000","last_clean":"2024-09-10T20:55:46.355694+0000","last_became_active":"2024-09-10T20:55:43.373744+0000","last_became_peered":"2024-09-10T20:55:43.373744+0000","last_unstale":"2024-09-10T20:55:46.355694+0000","last_undegraded":"2024-09-10T20:55:46.355694+0000","last_fullsized":"2024-09-10T20:55:46.355694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:44.779833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.356079+0000","last_change":"2024-09-10T20:55:44.387669+0000","last_active":"2024-09-10T20:55:46.356079+0000","last_peered":"2024-09-10T20:55:46.356079+0000","last_clean":"2024-09-10T20:55:46.356079+0000","last_became_active":"2024-09-10T20:55:44.387385+0000","last_became_peered":"2024-09-10T20:55:44.387385+0000","last_unstale":"2024-09-10T20:55:46.356079+0000","last_undegraded":"2024-09-10T20:55:46.356079+0000","last_fullsized":"2024-09-10T20:55:46.356079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:55:40.289116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.918034+0000","last_change":"2024-09-10T20:55:43.364230+0000","last_active":"2024-09-10T20:55:45.918034+0000","last_peered":"2024-09-10T20:55:45.918034+0000","last_clean":"2024-09-10T20:55:45.918034+0000","last_became_active":"2024-09-10T20:55:43.363855+0000","last_became_peered":"2024-09-10T20:55:43.363855+0000","last_unstale":"2024-09-10T20:55:45.918034+0000","last_undegraded":"2024-09-10T20:55:45.918034+0000","last_fullsized":"2024-09-10T20:55:45.918034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:47:38.695432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362684+0000","last_change":"2024-09-10T20:55:44.377758+0000","last_active":"2024-09-10T20:55:45.362684+0000","last_peered":"2024-09-10T20:55:45.362684+0000","last_clean":"2024-09-10T20:55:45.362684+0000","last_became_active":"2024-09-10T20:55:44.376900+0000","last_became_peered":"2024-09-10T20:55:44.376900+0000","last_unstale":"2024-09-10T20:55:45.362684+0000","last_undegraded":"2024-09-10T20:55:45.362684+0000","last_fullsized":"2024-09-10T20:55:45.362684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:56.566092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.627648+0000","last_change":"2024-09-10T20:55:43.366524+0000","last_active":"2024-09-10T20:55:46.627648+0000","last_peered":"2024-09-10T20:55:46.627648+0000","last_clean":"2024-09-10T20:55:46.627648+0000","last_became_active":"2024-09-10T20:55:43.365064+0000","last_became_peered":"2024-09-10T20:55:43.365064+0000","last_unstale":"2024-09-10T20:55:46.627648+0000","last_undegraded":"2024-09-10T20:55:46.627648+0000","last_fullsized":"2024-09-10T20:55:46.627648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:35.578339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364979+0000","last_change":"2024-09-10T20:55:44.380007+0000","last_active":"2024-09-10T20:55:45.364979+0000","last_peered":"2024-09-10T20:55:45.364979+0000","last_clean":"2024-09-10T20:55:45.364979+0000","last_became_active":"2024-09-10T20:55:44.379509+0000","last_became_peered":"2024-09-10T20:55:44.379509+0000","last_unstale":"2024-09-10T20:55:45.364979+0000","last_undegraded":"2024-09-10T20:55:45.364979+0000","last_fullsized":"2024-09-10T20:55:45.364979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:19.493422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.918101+0000","last_change":"2024-09-10T20:55:43.367328+0000","last_active":"2024-09-10T20:55:45.918101+0000","last_peered":"2024-09-10T20:55:45.918101+0000","last_clean":"2024-09-10T20:55:45.918101+0000","last_became_active":"2024-09-10T20:55:43.366880+0000","last_became_peered":"2024-09-10T20:55:43.366880+0000","last_unstale":"2024-09-10T20:55:45.918101+0000","last_undegraded":"2024-09-10T20:55:45.918101+0000","last_fullsized":"2024-09-10T20:55:45.918101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:52.212240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364733+0000","last_change":"2024-09-10T20:55:44.387017+0000","last_active":"2024-09-10T20:55:45.364733+0000","last_peered":"2024-09-10T20:55:45.364733+0000","last_clean":"2024-09-10T20:55:45.364733+0000","last_became_active":"2024-09-10T20:55:44.386824+0000","last_became_peered":"2024-09-10T20:55:44.386824+0000","last_unstale":"2024-09-10T20:55:45.364733+0000","last_undegraded":"2024-09-10T20:55:45.364733+0000","last_fullsized":"2024-09-10T20:55:45.364733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:03.834745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361597+0000","last_change":"2024-09-10T20:55:43.363564+0000","last_active":"2024-09-10T20:55:45.361597+0000","last_peered":"2024-09-10T20:55:45.361597+0000","last_clean":"2024-09-10T20:55:45.361597+0000","last_became_active":"2024-09-10T20:55:43.363247+0000","last_became_peered":"2024-09-10T20:55:43.363247+0000","last_unstale":"2024-09-10T20:55:45.361597+0000","last_undegraded":"2024-09-10T20:55:45.361597+0000","last_fullsized":"2024-09-10T20:55:45.361597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:16.877259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363896+0000","last_change":"2024-09-10T20:55:44.382801+0000","last_active":"2024-09-10T20:55:45.363896+0000","last_peered":"2024-09-10T20:55:45.363896+0000","last_clean":"2024-09-10T20:55:45.363896+0000","last_became_active":"2024-09-10T20:55:44.382172+0000","last_became_peered":"2024-09-10T20:55:44.382172+0000","last_unstale":"2024-09-10T20:55:45.363896+0000","last_undegraded":"2024-09-10T20:55:45.363896+0000","last_fullsized":"2024-09-10T20:55:45.363896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:37:10.807087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.918024+0000","last_change":"2024-09-10T20:55:43.365372+0000","last_active":"2024-09-10T20:55:45.918024+0000","last_peered":"2024-09-10T20:55:45.918024+0000","last_clean":"2024-09-10T20:55:45.918024+0000","last_became_active":"2024-09-10T20:55:43.362283+0000","last_became_peered":"2024-09-10T20:55:43.362283+0000","last_unstale":"2024-09-10T20:55:45.918024+0000","last_undegraded":"2024-09-10T20:55:45.918024+0000","last_fullsized":"2024-09-10T20:55:45.918024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:51:58.280912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363976+0000","last_change":"2024-09-10T20:55:44.379042+0000","last_active":"2024-09-10T20:55:45.363976+0000","last_peered":"2024-09-10T20:55:45.363976+0000","last_clean":"2024-09-10T20:55:45.363976+0000","last_became_active":"2024-09-10T20:55:44.378742+0000","last_became_peered":"2024-09-10T20:55:44.378742+0000","last_unstale":"2024-09-10T20:55:45.363976+0000","last_undegraded":"2024-09-10T20:55:45.363976+0000","last_fullsized":"2024-09-10T20:55:45.363976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:27:25.913460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362265+0000","last_change":"2024-09-10T20:55:34.718784+0000","last_active":"2024-09-10T20:55:45.362265+0000","last_peered":"2024-09-10T20:55:45.362265+0000","last_clean":"2024-09-10T20:55:45.362265+0000","last_became_active":"2024-09-10T20:55:34.717616+0000","last_became_peered":"2024-09-10T20:55:34.717616+0000","last_unstale":"2024-09-10T20:55:45.362265+0000","last_undegraded":"2024-09-10T20:55:45.362265+0000","last_fullsized":"2024-09-10T20:55:45.362265+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:33.618098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:33.618098+0000","last_clean_scrub_stamp":"2024-09-10T20:55:33.618098+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:17.442729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362978+0000","last_change":"2024-09-10T20:55:43.364591+0000","last_active":"2024-09-10T20:55:45.362978+0000","last_peered":"2024-09-10T20:55:45.362978+0000","last_clean":"2024-09-10T20:55:45.362978+0000","last_became_active":"2024-09-10T20:55:43.363372+0000","last_became_peered":"2024-09-10T20:55:43.363372+0000","last_unstale":"2024-09-10T20:55:45.362978+0000","last_undegraded":"2024-09-10T20:55:45.362978+0000","last_fullsized":"2024-09-10T20:55:45.362978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:04.606474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.386749+0000","last_change":"2024-09-10T20:55:44.373563+0000","last_active":"2024-09-10T20:55:44.386749+0000","last_peered":"2024-09-10T20:55:44.386749+0000","last_clean":"2024-09-10T20:55:44.386749+0000","last_became_active":"2024-09-10T20:55:44.373244+0000","last_became_peered":"2024-09-10T20:55:44.373244+0000","last_unstale":"2024-09-10T20:55:44.386749+0000","last_undegraded":"2024-09-10T20:55:44.386749+0000","last_fullsized":"2024-09-10T20:55:44.386749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:29:12.552642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362107+0000","last_change":"2024-09-10T20:55:43.376868+0000","last_active":"2024-09-10T20:55:45.362107+0000","last_peered":"2024-09-10T20:55:45.362107+0000","last_clean":"2024-09-10T20:55:45.362107+0000","last_became_active":"2024-09-10T20:55:43.376616+0000","last_became_peered":"2024-09-10T20:55:43.376616+0000","last_unstale":"2024-09-10T20:55:45.362107+0000","last_undegraded":"2024-09-10T20:55:45.362107+0000","last_fullsized":"2024-09-10T20:55:45.362107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:04.606474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.386518+0000","last_change":"2024-09-10T20:55:44.370871+0000","last_active":"2024-09-10T20:55:44.386518+0000","last_peered":"2024-09-10T20:55:44.386518+0000","last_clean":"2024-09-10T20:55:44.386518+0000","last_became_active":"2024-09-10T20:55:44.370595+0000","last_became_peered":"2024-09-10T20:55:44.370595+0000","last_unstale":"2024-09-10T20:55:44.386518+0000","last_undegraded":"2024-09-10T20:55:44.386518+0000","last_fullsized":"2024-09-10T20:55:44.386518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:00:12.920099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.917992+0000","last_change":"2024-09-10T20:55:43.367129+0000","last_active":"2024-09-10T20:55:45.917992+0000","last_peered":"2024-09-10T20:55:45.917992+0000","last_clean":"2024-09-10T20:55:45.917992+0000","last_became_active":"2024-09-10T20:55:43.366825+0000","last_became_peered":"2024-09-10T20:55:43.366825+0000","last_unstale":"2024-09-10T20:55:45.917992+0000","last_undegraded":"2024-09-10T20:55:45.917992+0000","last_fullsized":"2024-09-10T20:55:45.917992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:44.779833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361375+0000","last_change":"2024-09-10T20:55:44.362975+0000","last_active":"2024-09-10T20:55:45.361375+0000","last_peered":"2024-09-10T20:55:45.361375+0000","last_clean":"2024-09-10T20:55:45.361375+0000","last_became_active":"2024-09-10T20:55:44.362495+0000","last_became_peered":"2024-09-10T20:55:44.362495+0000","last_unstale":"2024-09-10T20:55:45.361375+0000","last_undegraded":"2024-09-10T20:55:45.361375+0000","last_fullsized":"2024-09-10T20:55:45.361375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:01:47.424436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364336+0000","last_change":"2024-09-10T20:55:43.364574+0000","last_active":"2024-09-10T20:55:45.364336+0000","last_peered":"2024-09-10T20:55:45.364336+0000","last_clean":"2024-09-10T20:55:45.364336+0000","last_became_active":"2024-09-10T20:55:43.363895+0000","last_became_peered":"2024-09-10T20:55:43.363895+0000","last_unstale":"2024-09-10T20:55:45.364336+0000","last_undegraded":"2024-09-10T20:55:45.364336+0000","last_fullsized":"2024-09-10T20:55:45.364336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:41:29.573514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.627706+0000","last_change":"2024-09-10T20:55:44.377780+0000","last_active":"2024-09-10T20:55:46.627706+0000","last_peered":"2024-09-10T20:55:46.627706+0000","last_clean":"2024-09-10T20:55:46.627706+0000","last_became_active":"2024-09-10T20:55:44.377120+0000","last_became_peered":"2024-09-10T20:55:44.377120+0000","last_unstale":"2024-09-10T20:55:46.627706+0000","last_undegraded":"2024-09-10T20:55:46.627706+0000","last_fullsized":"2024-09-10T20:55:46.627706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:29.923800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361762+0000","last_change":"2024-09-10T20:55:43.374091+0000","last_active":"2024-09-10T20:55:45.361762+0000","last_peered":"2024-09-10T20:55:45.361762+0000","last_clean":"2024-09-10T20:55:45.361762+0000","last_became_active":"2024-09-10T20:55:43.373736+0000","last_became_peered":"2024-09-10T20:55:43.373736+0000","last_unstale":"2024-09-10T20:55:45.361762+0000","last_undegraded":"2024-09-10T20:55:45.361762+0000","last_fullsized":"2024-09-10T20:55:45.361762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:41:11.107382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364317+0000","last_change":"2024-09-10T20:55:44.382414+0000","last_active":"2024-09-10T20:55:45.364317+0000","last_peered":"2024-09-10T20:55:45.364317+0000","last_clean":"2024-09-10T20:55:45.364317+0000","last_became_active":"2024-09-10T20:55:44.382087+0000","last_became_peered":"2024-09-10T20:55:44.382087+0000","last_unstale":"2024-09-10T20:55:45.364317+0000","last_undegraded":"2024-09-10T20:55:45.364317+0000","last_fullsized":"2024-09-10T20:55:45.364317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:57.600887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364206+0000","last_change":"2024-09-10T20:55:43.380057+0000","last_active":"2024-09-10T20:55:45.364206+0000","last_peered":"2024-09-10T20:55:45.364206+0000","last_clean":"2024-09-10T20:55:45.364206+0000","last_became_active":"2024-09-10T20:55:43.379881+0000","last_became_peered":"2024-09-10T20:55:43.379881+0000","last_unstale":"2024-09-10T20:55:45.364206+0000","last_undegraded":"2024-09-10T20:55:45.364206+0000","last_fullsized":"2024-09-10T20:55:45.364206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:35:50.441609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361728+0000","last_change":"2024-09-10T20:55:44.362979+0000","last_active":"2024-09-10T20:55:45.361728+0000","last_peered":"2024-09-10T20:55:45.361728+0000","last_clean":"2024-09-10T20:55:45.361728+0000","last_became_active":"2024-09-10T20:55:44.362472+0000","last_became_peered":"2024-09-10T20:55:44.362472+0000","last_unstale":"2024-09-10T20:55:45.361728+0000","last_undegraded":"2024-09-10T20:55:45.361728+0000","last_fullsized":"2024-09-10T20:55:45.361728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:32:54.439682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361567+0000","last_change":"2024-09-10T20:55:43.372848+0000","last_active":"2024-09-10T20:55:45.361567+0000","last_peered":"2024-09-10T20:55:45.361567+0000","last_clean":"2024-09-10T20:55:45.361567+0000","last_became_active":"2024-09-10T20:55:43.372619+0000","last_became_peered":"2024-09-10T20:55:43.372619+0000","last_unstale":"2024-09-10T20:55:45.361567+0000","last_undegraded":"2024-09-10T20:55:45.361567+0000","last_fullsized":"2024-09-10T20:55:45.361567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:32.519717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.382754+0000","last_change":"2024-09-10T20:55:44.378521+0000","last_active":"2024-09-10T20:55:44.382754+0000","last_peered":"2024-09-10T20:55:44.382754+0000","last_clean":"2024-09-10T20:55:44.382754+0000","last_became_active":"2024-09-10T20:55:44.378187+0000","last_became_peered":"2024-09-10T20:55:44.378187+0000","last_unstale":"2024-09-10T20:55:44.382754+0000","last_undegraded":"2024-09-10T20:55:44.382754+0000","last_fullsized":"2024-09-10T20:55:44.382754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:49:43.068621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.356149+0000","last_change":"2024-09-10T20:55:43.374477+0000","last_active":"2024-09-10T20:55:46.356149+0000","last_peered":"2024-09-10T20:55:46.356149+0000","last_clean":"2024-09-10T20:55:46.356149+0000","last_became_active":"2024-09-10T20:55:43.373960+0000","last_became_peered":"2024-09-10T20:55:43.373960+0000","last_unstale":"2024-09-10T20:55:46.356149+0000","last_undegraded":"2024-09-10T20:55:46.356149+0000","last_fullsized":"2024-09-10T20:55:46.356149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:04.606474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.386682+0000","last_change":"2024-09-10T20:55:44.377264+0000","last_active":"2024-09-10T20:55:44.386682+0000","last_peered":"2024-09-10T20:55:44.386682+0000","last_clean":"2024-09-10T20:55:44.386682+0000","last_became_active":"2024-09-10T20:55:44.376997+0000","last_became_peered":"2024-09-10T20:55:44.376997+0000","last_unstale":"2024-09-10T20:55:44.386682+0000","last_undegraded":"2024-09-10T20:55:44.386682+0000","last_fullsized":"2024-09-10T20:55:44.386682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:35:10.098109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362099+0000","last_change":"2024-09-10T20:55:43.376292+0000","last_active":"2024-09-10T20:55:45.362099+0000","last_peered":"2024-09-10T20:55:45.362099+0000","last_clean":"2024-09-10T20:55:45.362099+0000","last_became_active":"2024-09-10T20:55:43.375988+0000","last_became_peered":"2024-09-10T20:55:43.375988+0000","last_unstale":"2024-09-10T20:55:45.362099+0000","last_undegraded":"2024-09-10T20:55:45.362099+0000","last_fullsized":"2024-09-10T20:55:45.362099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:41:29.573514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.627612+0000","last_change":"2024-09-10T20:55:44.372839+0000","last_active":"2024-09-10T20:55:46.627612+0000","last_peered":"2024-09-10T20:55:46.627612+0000","last_clean":"2024-09-10T20:55:46.627612+0000","last_became_active":"2024-09-10T20:55:44.372410+0000","last_became_peered":"2024-09-10T20:55:44.372410+0000","last_unstale":"2024-09-10T20:55:46.627612+0000","last_undegraded":"2024-09-10T20:55:46.627612+0000","last_fullsized":"2024-09-10T20:55:46.627612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:27:56.155122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361430+0000","last_change":"2024-09-10T20:55:43.376634+0000","last_active":"2024-09-10T20:55:45.361430+0000","last_peered":"2024-09-10T20:55:45.361430+0000","last_clean":"2024-09-10T20:55:45.361430+0000","last_became_active":"2024-09-10T20:55:43.376322+0000","last_became_peered":"2024-09-10T20:55:43.376322+0000","last_unstale":"2024-09-10T20:55:45.361430+0000","last_undegraded":"2024-09-10T20:55:45.361430+0000","last_fullsized":"2024-09-10T20:55:45.361430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:51:58.280912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.379310+0000","last_change":"2024-09-10T20:55:44.368404+0000","last_active":"2024-09-10T20:55:44.379310+0000","last_peered":"2024-09-10T20:55:44.379310+0000","last_clean":"2024-09-10T20:55:44.379310+0000","last_became_active":"2024-09-10T20:55:44.368024+0000","last_became_peered":"2024-09-10T20:55:44.368024+0000","last_unstale":"2024-09-10T20:55:44.379310+0000","last_undegraded":"2024-09-10T20:55:44.379310+0000","last_fullsized":"2024-09-10T20:55:44.379310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:02:45.844722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361426+0000","last_change":"2024-09-10T20:55:43.362895+0000","last_active":"2024-09-10T20:55:45.361426+0000","last_peered":"2024-09-10T20:55:45.361426+0000","last_clean":"2024-09-10T20:55:45.361426+0000","last_became_active":"2024-09-10T20:55:43.362589+0000","last_became_peered":"2024-09-10T20:55:43.362589+0000","last_unstale":"2024-09-10T20:55:45.361426+0000","last_undegraded":"2024-09-10T20:55:45.361426+0000","last_fullsized":"2024-09-10T20:55:45.361426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:52.212240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.391718+0000","last_change":"2024-09-10T20:55:44.390140+0000","last_active":"2024-09-10T20:55:44.391718+0000","last_peered":"2024-09-10T20:55:44.391718+0000","last_clean":"2024-09-10T20:55:44.391718+0000","last_became_active":"2024-09-10T20:55:44.389852+0000","last_became_peered":"2024-09-10T20:55:44.389852+0000","last_unstale":"2024-09-10T20:55:44.391718+0000","last_undegraded":"2024-09-10T20:55:44.391718+0000","last_fullsized":"2024-09-10T20:55:44.391718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:39:27.469734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363357+0000","last_change":"2024-09-10T20:55:43.376815+0000","last_active":"2024-09-10T20:55:45.363357+0000","last_peered":"2024-09-10T20:55:45.363357+0000","last_clean":"2024-09-10T20:55:45.363357+0000","last_became_active":"2024-09-10T20:55:43.376465+0000","last_became_peered":"2024-09-10T20:55:43.376465+0000","last_unstale":"2024-09-10T20:55:45.363357+0000","last_undegraded":"2024-09-10T20:55:45.363357+0000","last_fullsized":"2024-09-10T20:55:45.363357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:29.358166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.355895+0000","last_change":"2024-09-10T20:55:44.372811+0000","last_active":"2024-09-10T20:55:46.355895+0000","last_peered":"2024-09-10T20:55:46.355895+0000","last_clean":"2024-09-10T20:55:46.355895+0000","last_became_active":"2024-09-10T20:55:44.372498+0000","last_became_peered":"2024-09-10T20:55:44.372498+0000","last_unstale":"2024-09-10T20:55:46.355895+0000","last_undegraded":"2024-09-10T20:55:46.355895+0000","last_fullsized":"2024-09-10T20:55:46.355895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:03:43.922684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364096+0000","last_change":"2024-09-10T20:55:44.356261+0000","last_active":"2024-09-10T20:55:45.364096+0000","last_peered":"2024-09-10T20:55:45.364096+0000","last_clean":"2024-09-10T20:55:45.364096+0000","last_became_active":"2024-09-10T20:55:44.355918+0000","last_became_peered":"2024-09-10T20:55:44.355918+0000","last_unstale":"2024-09-10T20:55:45.364096+0000","last_undegraded":"2024-09-10T20:55:45.364096+0000","last_fullsized":"2024-09-10T20:55:45.364096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:57:27.229133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363650+0000","last_change":"2024-09-10T20:55:43.379354+0000","last_active":"2024-09-10T20:55:45.363650+0000","last_peered":"2024-09-10T20:55:45.363650+0000","last_clean":"2024-09-10T20:55:45.363650+0000","last_became_active":"2024-09-10T20:55:43.378912+0000","last_became_peered":"2024-09-10T20:55:43.378912+0000","last_unstale":"2024-09-10T20:55:45.363650+0000","last_undegraded":"2024-09-10T20:55:45.363650+0000","last_fullsized":"2024-09-10T20:55:45.363650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:16.877259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363676+0000","last_change":"2024-09-10T20:55:44.355826+0000","last_active":"2024-09-10T20:55:45.363676+0000","last_peered":"2024-09-10T20:55:45.363676+0000","last_clean":"2024-09-10T20:55:45.363676+0000","last_became_active":"2024-09-10T20:55:44.355502+0000","last_became_peered":"2024-09-10T20:55:44.355502+0000","last_unstale":"2024-09-10T20:55:45.363676+0000","last_undegraded":"2024-09-10T20:55:45.363676+0000","last_fullsized":"2024-09-10T20:55:45.363676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:46:20.226511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364080+0000","last_change":"2024-09-10T20:55:43.379688+0000","last_active":"2024-09-10T20:55:45.364080+0000","last_peered":"2024-09-10T20:55:45.364080+0000","last_clean":"2024-09-10T20:55:45.364080+0000","last_became_active":"2024-09-10T20:55:43.379480+0000","last_became_peered":"2024-09-10T20:55:43.379480+0000","last_unstale":"2024-09-10T20:55:45.364080+0000","last_undegraded":"2024-09-10T20:55:45.364080+0000","last_fullsized":"2024-09-10T20:55:45.364080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:41:11.107382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.387953+0000","last_change":"2024-09-10T20:55:44.381645+0000","last_active":"2024-09-10T20:55:44.387953+0000","last_peered":"2024-09-10T20:55:44.387953+0000","last_clean":"2024-09-10T20:55:44.387953+0000","last_became_active":"2024-09-10T20:55:44.376799+0000","last_became_peered":"2024-09-10T20:55:44.376799+0000","last_unstale":"2024-09-10T20:55:44.387953+0000","last_undegraded":"2024-09-10T20:55:44.387953+0000","last_fullsized":"2024-09-10T20:55:44.387953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:58.576130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.387283+0000","last_change":"2024-09-10T20:55:43.361529+0000","last_active":"2024-09-10T20:55:44.387283+0000","last_peered":"2024-09-10T20:55:44.387283+0000","last_clean":"2024-09-10T20:55:44.387283+0000","last_became_active":"2024-09-10T20:55:43.361270+0000","last_became_peered":"2024-09-10T20:55:43.361270+0000","last_unstale":"2024-09-10T20:55:44.387283+0000","last_undegraded":"2024-09-10T20:55:44.387283+0000","last_fullsized":"2024-09-10T20:55:44.387283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:26:10.795588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.382609+0000","last_change":"2024-09-10T20:55:44.378339+0000","last_active":"2024-09-10T20:55:44.382609+0000","last_peered":"2024-09-10T20:55:44.382609+0000","last_clean":"2024-09-10T20:55:44.382609+0000","last_became_active":"2024-09-10T20:55:44.378051+0000","last_became_peered":"2024-09-10T20:55:44.378051+0000","last_unstale":"2024-09-10T20:55:44.382609+0000","last_undegraded":"2024-09-10T20:55:44.382609+0000","last_fullsized":"2024-09-10T20:55:44.382609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:47.381553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T20:55:44.384857+0000","last_change":"2024-09-10T20:55:43.370516+0000","last_active":"2024-09-10T20:55:44.384857+0000","last_peered":"2024-09-10T20:55:44.384857+0000","last_clean":"2024-09-10T20:55:44.384857+0000","last_became_active":"2024-09-10T20:55:43.370211+0000","last_became_peered":"2024-09-10T20:55:43.370211+0000","last_unstale":"2024-09-10T20:55:44.384857+0000","last_undegraded":"2024-09-10T20:55:44.384857+0000","last_fullsized":"2024-09-10T20:55:44.384857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:53.823889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":819200,"data_stored":668106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":78768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":77246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":233472,"data_stored":77282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":77156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":77316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":815104,"data_stored":661862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":72468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T20:55:53.348 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T20:55:53.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.514+0000 7f6b7cc00640 1 -- 172.21.15.6:0/3151603453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b7815bb30 msgr2=0x7f6b780cf340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:53.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.514+0000 7f6b7cc00640 1 --2- 172.21.15.6:0/3151603453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b7815bb30 0x7f6b780cf340 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6b68009830 tx=0x7f6b6802a5c0 comp rx=0 tx=0).stop 2024-09-10T20:55:53.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.514+0000 7f6b7cc00640 1 -- 172.21.15.6:0/3151603453 shutdown_connections 2024-09-10T20:55:53.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.514+0000 7f6b7cc00640 1 --2- 172.21.15.6:0/3151603453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b7815bb30 0x7f6b780cf340 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:53.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.514+0000 7f6b7cc00640 1 -- 172.21.15.6:0/3151603453 >> 172.21.15.6:0/3151603453 conn(0x7f6b780cfa20 msgr2=0x7f6b780cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:53.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.514+0000 7f6b7cc00640 1 -- 172.21.15.6:0/3151603453 shutdown_connections 2024-09-10T20:55:53.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.515+0000 7f6b7cc00640 1 -- 172.21.15.6:0/3151603453 wait complete. 2024-09-10T20:55:53.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.516+0000 7f6b7cc00640 1 Processor -- start 2024-09-10T20:55:53.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.516+0000 7f6b7cc00640 1 -- start start 2024-09-10T20:55:53.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.517+0000 7f6b7cc00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b780caa40 0x7f6b78157870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:53.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.517+0000 7f6b7cc00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b7815bb30 0x7f6b7815d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:53.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.517+0000 7f6b7cc00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b78162130 0x7f6b7815dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:53.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.517+0000 7f6b7cc00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6b780ae320 con 0x7f6b780caa40 2024-09-10T20:55:53.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.517+0000 7f6b7cc00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6b780ae1a0 con 0x7f6b7815bb30 2024-09-10T20:55:53.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.517+0000 7f6b7cc00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f6b780ae4a0 con 0x7f6b78162130 2024-09-10T20:55:53.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.517+0000 7f6b75e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b780caa40 0x7f6b78157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:53.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.517+0000 7f6b75e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b780caa40 0x7f6b78157870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51034/0 (socket says 172.21.15.6:51034) 2024-09-10T20:55:53.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.517+0000 7f6b75e00640 1 -- 172.21.15.6:0/527866528 learned_addr learned my addr 172.21.15.6:0/527866528 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:53.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.517+0000 7f6b6d400640 1 --2- 172.21.15.6:0/527866528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b7815bb30 0x7f6b7815d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:53.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.517+0000 7f6b76800640 1 --2- 172.21.15.6:0/527866528 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b78162130 0x7f6b7815dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:53.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.518+0000 7f6b75e00640 1 -- 172.21.15.6:0/527866528 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b78162130 msgr2=0x7f6b7815dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:53.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.518+0000 7f6b75e00640 1 --2- 172.21.15.6:0/527866528 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b78162130 0x7f6b7815dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:53.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.518+0000 7f6b75e00640 1 -- 172.21.15.6:0/527866528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b7815bb30 msgr2=0x7f6b7815d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:53.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.518+0000 7f6b75e00640 1 --2- 172.21.15.6:0/527866528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b7815bb30 0x7f6b7815d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:53.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.518+0000 7f6b75e00640 1 -- 172.21.15.6:0/527866528 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b780b3630 con 0x7f6b780caa40 2024-09-10T20:55:53.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.518+0000 7f6b6d400640 1 --2- 172.21.15.6:0/527866528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b7815bb30 0x7f6b7815d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:55:53.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.518+0000 7f6b76800640 1 --2- 172.21.15.6:0/527866528 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b78162130 0x7f6b7815dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:55:53.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.518+0000 7f6b75e00640 1 --2- 172.21.15.6:0/527866528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b780caa40 0x7f6b78157870 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6b68009950 tx=0x7f6b68032c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:53.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.518+0000 7f6b6ea00640 1 -- 172.21.15.6:0/527866528 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b68040070 con 0x7f6b780caa40 2024-09-10T20:55:53.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.518+0000 7f6b6ea00640 1 -- 172.21.15.6:0/527866528 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b68005310 con 0x7f6b780caa40 2024-09-10T20:55:53.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.518+0000 7f6b7cc00640 1 -- 172.21.15.6:0/527866528 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b780b3910 con 0x7f6b780caa40 2024-09-10T20:55:53.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.518+0000 7f6b6ea00640 1 -- 172.21.15.6:0/527866528 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b680047a0 con 0x7f6b780caa40 2024-09-10T20:55:53.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.519+0000 7f6b7cc00640 1 -- 172.21.15.6:0/527866528 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b780b4140 con 0x7f6b780caa40 2024-09-10T20:55:53.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.520+0000 7f6b7cc00640 1 -- 172.21.15.6:0/527866528 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b780ae950 con 0x7f6b780caa40 2024-09-10T20:55:53.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.521+0000 7f6b6ea00640 1 -- 172.21.15.6:0/527866528 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6b6804c030 con 0x7f6b780caa40 2024-09-10T20:55:53.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.522+0000 7f6b6ea00640 1 --2- 172.21.15.6:0/527866528 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6b54077fd0 0x7f6b5407a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:53.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.522+0000 7f6b6ea00640 1 -- 172.21.15.6:0/527866528 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f6b680baff0 con 0x7f6b780caa40 2024-09-10T20:55:53.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.522+0000 7f6b6d400640 1 --2- 172.21.15.6:0/527866528 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6b54077fd0 0x7f6b5407a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:53.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.523+0000 7f6b6d400640 1 --2- 172.21.15.6:0/527866528 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6b54077fd0 0x7f6b5407a490 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6b780c2f70 tx=0x7f6b60009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:53.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.526+0000 7f6b6ea00640 1 -- 172.21.15.6:0/527866528 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f6b68083ab0 con 0x7f6b780caa40 2024-09-10T20:55:53.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.719+0000 7f6b7cc00640 1 -- 172.21.15.6:0/527866528 --> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6b78069d20 con 0x7f6b54077fd0 2024-09-10T20:55:53.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.724+0000 7f6b6ea00640 1 -- 172.21.15.6:0/527866528 <== mgr.4120 v2:172.21.15.150:6800/1238179351 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251861 (secure 0 0 0) 0x7f6b78069d20 con 0x7f6b54077fd0 2024-09-10T20:55:53.730 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:55:53.732 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-10T20:55:53.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.728+0000 7f6b7cc00640 1 -- 172.21.15.6:0/527866528 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6b54077fd0 msgr2=0x7f6b5407a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:53.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.728+0000 7f6b7cc00640 1 --2- 172.21.15.6:0/527866528 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6b54077fd0 0x7f6b5407a490 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6b780c2f70 tx=0x7f6b60009040 comp rx=0 tx=0).stop 2024-09-10T20:55:53.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.728+0000 7f6b7cc00640 1 -- 172.21.15.6:0/527866528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b780caa40 msgr2=0x7f6b78157870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:53.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.728+0000 7f6b7cc00640 1 --2- 172.21.15.6:0/527866528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b780caa40 0x7f6b78157870 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6b68009950 tx=0x7f6b68032c00 comp rx=0 tx=0).stop 2024-09-10T20:55:53.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.728+0000 7f6b7cc00640 1 -- 172.21.15.6:0/527866528 shutdown_connections 2024-09-10T20:55:53.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.728+0000 7f6b7cc00640 1 --2- 172.21.15.6:0/527866528 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6b54077fd0 0x7f6b5407a490 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:53.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.728+0000 7f6b7cc00640 1 --2- 172.21.15.6:0/527866528 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b78162130 0x7f6b7815dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:53.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.728+0000 7f6b7cc00640 1 --2- 172.21.15.6:0/527866528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b7815bb30 0x7f6b7815d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:53.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.728+0000 7f6b7cc00640 1 --2- 172.21.15.6:0/527866528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b780caa40 0x7f6b78157870 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:53.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.728+0000 7f6b7cc00640 1 -- 172.21.15.6:0/527866528 >> 172.21.15.6:0/527866528 conn(0x7f6b780cfa20 msgr2=0x7f6b7815ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:53.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.728+0000 7f6b7cc00640 1 -- 172.21.15.6:0/527866528 shutdown_connections 2024-09-10T20:55:53.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.728+0000 7f6b7cc00640 1 -- 172.21.15.6:0/527866528 wait complete. 2024-09-10T20:55:53.748 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-10T20:55:53.173657+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219196,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755524,"statfs":{"total":773094113280,"available":772869656576,"internally_reserved":0,"allocated":3022848,"data_stored":1802804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.827910"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364560+0000","last_change":"2024-09-10T20:55:44.378371+0000","last_active":"2024-09-10T20:55:45.364560+0000","last_peered":"2024-09-10T20:55:45.364560+0000","last_clean":"2024-09-10T20:55:45.364560+0000","last_became_active":"2024-09-10T20:55:44.375917+0000","last_became_peered":"2024-09-10T20:55:44.375917+0000","last_unstale":"2024-09-10T20:55:45.364560+0000","last_undegraded":"2024-09-10T20:55:45.364560+0000","last_fullsized":"2024-09-10T20:55:45.364560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:55:42.603736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361499+0000","last_change":"2024-09-10T20:55:44.378072+0000","last_active":"2024-09-10T20:55:45.361499+0000","last_peered":"2024-09-10T20:55:45.361499+0000","last_clean":"2024-09-10T20:55:45.361499+0000","last_became_active":"2024-09-10T20:55:44.377702+0000","last_became_peered":"2024-09-10T20:55:44.377702+0000","last_unstale":"2024-09-10T20:55:45.361499+0000","last_undegraded":"2024-09-10T20:55:45.361499+0000","last_fullsized":"2024-09-10T20:55:45.361499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:19.756412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.619936+0000","last_change":"2024-09-10T20:55:44.373164+0000","last_active":"2024-09-10T20:55:47.619936+0000","last_peered":"2024-09-10T20:55:47.619936+0000","last_clean":"2024-09-10T20:55:47.619936+0000","last_became_active":"2024-09-10T20:55:44.370647+0000","last_became_peered":"2024-09-10T20:55:44.370647+0000","last_unstale":"2024-09-10T20:55:47.619936+0000","last_undegraded":"2024-09-10T20:55:47.619936+0000","last_fullsized":"2024-09-10T20:55:47.619936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:19.756412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364549+0000","last_change":"2024-09-10T20:55:44.383084+0000","last_active":"2024-09-10T20:55:45.364549+0000","last_peered":"2024-09-10T20:55:45.364549+0000","last_clean":"2024-09-10T20:55:45.364549+0000","last_became_active":"2024-09-10T20:55:44.382543+0000","last_became_peered":"2024-09-10T20:55:44.382543+0000","last_unstale":"2024-09-10T20:55:45.364549+0000","last_undegraded":"2024-09-10T20:55:45.364549+0000","last_fullsized":"2024-09-10T20:55:45.364549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:56.566092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362995+0000","last_change":"2024-09-10T20:55:44.373531+0000","last_active":"2024-09-10T20:55:45.362995+0000","last_peered":"2024-09-10T20:55:45.362995+0000","last_clean":"2024-09-10T20:55:45.362995+0000","last_became_active":"2024-09-10T20:55:44.373234+0000","last_became_peered":"2024-09-10T20:55:44.373234+0000","last_unstale":"2024-09-10T20:55:45.362995+0000","last_undegraded":"2024-09-10T20:55:45.362995+0000","last_fullsized":"2024-09-10T20:55:45.362995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:18:22.966502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362646+0000","last_change":"2024-09-10T20:55:44.375328+0000","last_active":"2024-09-10T20:55:45.362646+0000","last_peered":"2024-09-10T20:55:45.362646+0000","last_clean":"2024-09-10T20:55:45.362646+0000","last_became_active":"2024-09-10T20:55:44.375024+0000","last_became_peered":"2024-09-10T20:55:44.375024+0000","last_unstale":"2024-09-10T20:55:45.362646+0000","last_undegraded":"2024-09-10T20:55:45.362646+0000","last_fullsized":"2024-09-10T20:55:45.362646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:32:54.439682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362477+0000","last_change":"2024-09-10T20:55:44.385176+0000","last_active":"2024-09-10T20:55:45.362477+0000","last_peered":"2024-09-10T20:55:45.362477+0000","last_clean":"2024-09-10T20:55:45.362477+0000","last_became_active":"2024-09-10T20:55:44.384916+0000","last_became_peered":"2024-09-10T20:55:44.384916+0000","last_unstale":"2024-09-10T20:55:45.362477+0000","last_undegraded":"2024-09-10T20:55:45.362477+0000","last_fullsized":"2024-09-10T20:55:45.362477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:51:21.066719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.618773+0000","last_change":"2024-09-10T20:55:44.374342+0000","last_active":"2024-09-10T20:55:47.618773+0000","last_peered":"2024-09-10T20:55:47.618773+0000","last_clean":"2024-09-10T20:55:47.618773+0000","last_became_active":"2024-09-10T20:55:44.373477+0000","last_became_peered":"2024-09-10T20:55:44.373477+0000","last_unstale":"2024-09-10T20:55:47.618773+0000","last_undegraded":"2024-09-10T20:55:47.618773+0000","last_fullsized":"2024-09-10T20:55:47.618773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:31:28.477108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364578+0000","last_change":"2024-09-10T20:55:44.379912+0000","last_active":"2024-09-10T20:55:45.364578+0000","last_peered":"2024-09-10T20:55:45.364578+0000","last_clean":"2024-09-10T20:55:45.364578+0000","last_became_active":"2024-09-10T20:55:44.379632+0000","last_became_peered":"2024-09-10T20:55:44.379632+0000","last_unstale":"2024-09-10T20:55:45.364578+0000","last_undegraded":"2024-09-10T20:55:45.364578+0000","last_fullsized":"2024-09-10T20:55:45.364578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:31:58.187489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.356250+0000","last_change":"2024-09-10T20:55:44.379776+0000","last_active":"2024-09-10T20:55:46.356250+0000","last_peered":"2024-09-10T20:55:46.356250+0000","last_clean":"2024-09-10T20:55:46.356250+0000","last_became_active":"2024-09-10T20:55:44.379512+0000","last_became_peered":"2024-09-10T20:55:44.379512+0000","last_unstale":"2024-09-10T20:55:46.356250+0000","last_undegraded":"2024-09-10T20:55:46.356250+0000","last_fullsized":"2024-09-10T20:55:46.356250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:08.229059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.356236+0000","last_change":"2024-09-10T20:55:44.372935+0000","last_active":"2024-09-10T20:55:46.356236+0000","last_peered":"2024-09-10T20:55:46.356236+0000","last_clean":"2024-09-10T20:55:46.356236+0000","last_became_active":"2024-09-10T20:55:44.372660+0000","last_became_peered":"2024-09-10T20:55:44.372660+0000","last_unstale":"2024-09-10T20:55:46.356236+0000","last_undegraded":"2024-09-10T20:55:46.356236+0000","last_fullsized":"2024-09-10T20:55:46.356236+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:16:49.875268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.627691+0000","last_change":"2024-09-10T20:55:44.381853+0000","last_active":"2024-09-10T20:55:46.627691+0000","last_peered":"2024-09-10T20:55:46.627691+0000","last_clean":"2024-09-10T20:55:46.627691+0000","last_became_active":"2024-09-10T20:55:44.381283+0000","last_became_peered":"2024-09-10T20:55:44.381283+0000","last_unstale":"2024-09-10T20:55:46.627691+0000","last_undegraded":"2024-09-10T20:55:46.627691+0000","last_fullsized":"2024-09-10T20:55:46.627691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:01:41.450845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.619721+0000","last_change":"2024-09-10T20:55:44.380947+0000","last_active":"2024-09-10T20:55:47.619721+0000","last_peered":"2024-09-10T20:55:47.619721+0000","last_clean":"2024-09-10T20:55:47.619721+0000","last_became_active":"2024-09-10T20:55:44.380246+0000","last_became_peered":"2024-09-10T20:55:44.380246+0000","last_unstale":"2024-09-10T20:55:47.619721+0000","last_undegraded":"2024-09-10T20:55:47.619721+0000","last_fullsized":"2024-09-10T20:55:47.619721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:36:28.101716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.619064+0000","last_change":"2024-09-10T20:55:44.380329+0000","last_active":"2024-09-10T20:55:47.619064+0000","last_peered":"2024-09-10T20:55:47.619064+0000","last_clean":"2024-09-10T20:55:47.619064+0000","last_became_active":"2024-09-10T20:55:44.379878+0000","last_became_peered":"2024-09-10T20:55:44.379878+0000","last_unstale":"2024-09-10T20:55:47.619064+0000","last_undegraded":"2024-09-10T20:55:47.619064+0000","last_fullsized":"2024-09-10T20:55:47.619064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:48:38.749688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361378+0000","last_change":"2024-09-10T20:55:44.369874+0000","last_active":"2024-09-10T20:55:45.361378+0000","last_peered":"2024-09-10T20:55:45.361378+0000","last_clean":"2024-09-10T20:55:45.361378+0000","last_became_active":"2024-09-10T20:55:44.369125+0000","last_became_peered":"2024-09-10T20:55:44.369125+0000","last_unstale":"2024-09-10T20:55:45.361378+0000","last_undegraded":"2024-09-10T20:55:45.361378+0000","last_fullsized":"2024-09-10T20:55:45.361378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:48:52.277148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362575+0000","last_change":"2024-09-10T20:55:44.377717+0000","last_active":"2024-09-10T20:55:45.362575+0000","last_peered":"2024-09-10T20:55:45.362575+0000","last_clean":"2024-09-10T20:55:45.362575+0000","last_became_active":"2024-09-10T20:55:44.376176+0000","last_became_peered":"2024-09-10T20:55:44.376176+0000","last_unstale":"2024-09-10T20:55:45.362575+0000","last_undegraded":"2024-09-10T20:55:45.362575+0000","last_fullsized":"2024-09-10T20:55:45.362575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:19.756412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363854+0000","last_change":"2024-09-10T20:55:44.371382+0000","last_active":"2024-09-10T20:55:45.363854+0000","last_peered":"2024-09-10T20:55:45.363854+0000","last_clean":"2024-09-10T20:55:45.363854+0000","last_became_active":"2024-09-10T20:55:44.371044+0000","last_became_peered":"2024-09-10T20:55:44.371044+0000","last_unstale":"2024-09-10T20:55:45.363854+0000","last_undegraded":"2024-09-10T20:55:45.363854+0000","last_fullsized":"2024-09-10T20:55:45.363854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:31:48.282296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.918190+0000","last_change":"2024-09-10T20:55:44.375032+0000","last_active":"2024-09-10T20:55:45.918190+0000","last_peered":"2024-09-10T20:55:45.918190+0000","last_clean":"2024-09-10T20:55:45.918190+0000","last_became_active":"2024-09-10T20:55:44.374735+0000","last_became_peered":"2024-09-10T20:55:44.374735+0000","last_unstale":"2024-09-10T20:55:45.918190+0000","last_undegraded":"2024-09-10T20:55:45.918190+0000","last_fullsized":"2024-09-10T20:55:45.918190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:30.365247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364255+0000","last_change":"2024-09-10T20:55:44.379134+0000","last_active":"2024-09-10T20:55:45.364255+0000","last_peered":"2024-09-10T20:55:45.364255+0000","last_clean":"2024-09-10T20:55:45.364255+0000","last_became_active":"2024-09-10T20:55:44.378814+0000","last_became_peered":"2024-09-10T20:55:44.378814+0000","last_unstale":"2024-09-10T20:55:45.364255+0000","last_undegraded":"2024-09-10T20:55:45.364255+0000","last_fullsized":"2024-09-10T20:55:45.364255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:45:07.152884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.356325+0000","last_change":"2024-09-10T20:55:44.381800+0000","last_active":"2024-09-10T20:55:46.356325+0000","last_peered":"2024-09-10T20:55:46.356325+0000","last_clean":"2024-09-10T20:55:46.356325+0000","last_became_active":"2024-09-10T20:55:44.380382+0000","last_became_peered":"2024-09-10T20:55:44.380382+0000","last_unstale":"2024-09-10T20:55:46.356325+0000","last_undegraded":"2024-09-10T20:55:46.356325+0000","last_fullsized":"2024-09-10T20:55:46.356325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:58.419795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.619321+0000","last_change":"2024-09-10T20:55:44.385859+0000","last_active":"2024-09-10T20:55:47.619321+0000","last_peered":"2024-09-10T20:55:47.619321+0000","last_clean":"2024-09-10T20:55:47.619321+0000","last_became_active":"2024-09-10T20:55:44.383049+0000","last_became_peered":"2024-09-10T20:55:44.383049+0000","last_unstale":"2024-09-10T20:55:47.619321+0000","last_undegraded":"2024-09-10T20:55:47.619321+0000","last_fullsized":"2024-09-10T20:55:47.619321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:26:35.929548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362652+0000","last_change":"2024-09-10T20:55:44.373313+0000","last_active":"2024-09-10T20:55:45.362652+0000","last_peered":"2024-09-10T20:55:45.362652+0000","last_clean":"2024-09-10T20:55:45.362652+0000","last_became_active":"2024-09-10T20:55:44.372975+0000","last_became_peered":"2024-09-10T20:55:44.372975+0000","last_unstale":"2024-09-10T20:55:45.362652+0000","last_undegraded":"2024-09-10T20:55:45.362652+0000","last_fullsized":"2024-09-10T20:55:45.362652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:49:46.518440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.619157+0000","last_change":"2024-09-10T20:55:44.372460+0000","last_active":"2024-09-10T20:55:47.619157+0000","last_peered":"2024-09-10T20:55:47.619157+0000","last_clean":"2024-09-10T20:55:47.619157+0000","last_became_active":"2024-09-10T20:55:44.372166+0000","last_became_peered":"2024-09-10T20:55:44.372166+0000","last_unstale":"2024-09-10T20:55:47.619157+0000","last_undegraded":"2024-09-10T20:55:47.619157+0000","last_fullsized":"2024-09-10T20:55:47.619157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:13.189176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362773+0000","last_change":"2024-09-10T20:55:44.382439+0000","last_active":"2024-09-10T20:55:45.362773+0000","last_peered":"2024-09-10T20:55:45.362773+0000","last_clean":"2024-09-10T20:55:45.362773+0000","last_became_active":"2024-09-10T20:55:44.382157+0000","last_became_peered":"2024-09-10T20:55:44.382157+0000","last_unstale":"2024-09-10T20:55:45.362773+0000","last_undegraded":"2024-09-10T20:55:45.362773+0000","last_fullsized":"2024-09-10T20:55:45.362773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:51:21.066719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.620373+0000","last_change":"2024-09-10T20:55:44.379140+0000","last_active":"2024-09-10T20:55:47.620373+0000","last_peered":"2024-09-10T20:55:47.620373+0000","last_clean":"2024-09-10T20:55:47.620373+0000","last_became_active":"2024-09-10T20:55:44.378867+0000","last_became_peered":"2024-09-10T20:55:44.378867+0000","last_unstale":"2024-09-10T20:55:47.620373+0000","last_undegraded":"2024-09-10T20:55:47.620373+0000","last_fullsized":"2024-09-10T20:55:47.620373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:02:02.002953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.356316+0000","last_change":"2024-09-10T20:55:44.374130+0000","last_active":"2024-09-10T20:55:46.356316+0000","last_peered":"2024-09-10T20:55:46.356316+0000","last_clean":"2024-09-10T20:55:46.356316+0000","last_became_active":"2024-09-10T20:55:44.373755+0000","last_became_peered":"2024-09-10T20:55:44.373755+0000","last_unstale":"2024-09-10T20:55:46.356316+0000","last_undegraded":"2024-09-10T20:55:46.356316+0000","last_fullsized":"2024-09-10T20:55:46.356316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:19.756412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361498+0000","last_change":"2024-09-10T20:55:44.380940+0000","last_active":"2024-09-10T20:55:45.361498+0000","last_peered":"2024-09-10T20:55:45.361498+0000","last_clean":"2024-09-10T20:55:45.361498+0000","last_became_active":"2024-09-10T20:55:44.380667+0000","last_became_peered":"2024-09-10T20:55:44.380667+0000","last_unstale":"2024-09-10T20:55:45.361498+0000","last_undegraded":"2024-09-10T20:55:45.361498+0000","last_fullsized":"2024-09-10T20:55:45.361498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:08.229059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.620388+0000","last_change":"2024-09-10T20:55:44.380864+0000","last_active":"2024-09-10T20:55:47.620388+0000","last_peered":"2024-09-10T20:55:47.620388+0000","last_clean":"2024-09-10T20:55:47.620388+0000","last_became_active":"2024-09-10T20:55:44.380634+0000","last_became_peered":"2024-09-10T20:55:44.380634+0000","last_unstale":"2024-09-10T20:55:47.620388+0000","last_undegraded":"2024-09-10T20:55:47.620388+0000","last_fullsized":"2024-09-10T20:55:47.620388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:57.162069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.619406+0000","last_change":"2024-09-10T20:55:44.388198+0000","last_active":"2024-09-10T20:55:47.619406+0000","last_peered":"2024-09-10T20:55:47.619406+0000","last_clean":"2024-09-10T20:55:47.619406+0000","last_became_active":"2024-09-10T20:55:44.387343+0000","last_became_peered":"2024-09-10T20:55:44.387343+0000","last_unstale":"2024-09-10T20:55:47.619406+0000","last_undegraded":"2024-09-10T20:55:47.619406+0000","last_fullsized":"2024-09-10T20:55:47.619406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:21:11.284661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364492+0000","last_change":"2024-09-10T20:55:44.380482+0000","last_active":"2024-09-10T20:55:45.364492+0000","last_peered":"2024-09-10T20:55:45.364492+0000","last_clean":"2024-09-10T20:55:45.364492+0000","last_became_active":"2024-09-10T20:55:44.379945+0000","last_became_peered":"2024-09-10T20:55:44.379945+0000","last_unstale":"2024-09-10T20:55:45.364492+0000","last_undegraded":"2024-09-10T20:55:45.364492+0000","last_fullsized":"2024-09-10T20:55:45.364492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:15:59.746371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.918084+0000","last_change":"2024-09-10T20:55:44.369574+0000","last_active":"2024-09-10T20:55:45.918084+0000","last_peered":"2024-09-10T20:55:45.918084+0000","last_clean":"2024-09-10T20:55:45.918084+0000","last_became_active":"2024-09-10T20:55:44.365888+0000","last_became_peered":"2024-09-10T20:55:44.365888+0000","last_unstale":"2024-09-10T20:55:45.918084+0000","last_undegraded":"2024-09-10T20:55:45.918084+0000","last_fullsized":"2024-09-10T20:55:45.918084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:41:12.114462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.355892+0000","last_change":"2024-09-10T20:55:44.387588+0000","last_active":"2024-09-10T20:55:46.355892+0000","last_peered":"2024-09-10T20:55:46.355892+0000","last_clean":"2024-09-10T20:55:46.355892+0000","last_became_active":"2024-09-10T20:55:44.387293+0000","last_became_peered":"2024-09-10T20:55:44.387293+0000","last_unstale":"2024-09-10T20:55:46.355892+0000","last_undegraded":"2024-09-10T20:55:46.355892+0000","last_fullsized":"2024-09-10T20:55:46.355892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:26:35.929548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.627619+0000","last_change":"2024-09-10T20:55:44.364063+0000","last_active":"2024-09-10T20:55:46.627619+0000","last_peered":"2024-09-10T20:55:46.627619+0000","last_clean":"2024-09-10T20:55:46.627619+0000","last_became_active":"2024-09-10T20:55:44.363460+0000","last_became_peered":"2024-09-10T20:55:44.363460+0000","last_unstale":"2024-09-10T20:55:46.627619+0000","last_undegraded":"2024-09-10T20:55:46.627619+0000","last_fullsized":"2024-09-10T20:55:46.627619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:49.994707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.620144+0000","last_change":"2024-09-10T20:55:43.368822+0000","last_active":"2024-09-10T20:55:47.620144+0000","last_peered":"2024-09-10T20:55:47.620144+0000","last_clean":"2024-09-10T20:55:47.620144+0000","last_became_active":"2024-09-10T20:55:43.368565+0000","last_became_peered":"2024-09-10T20:55:43.368565+0000","last_unstale":"2024-09-10T20:55:47.620144+0000","last_undegraded":"2024-09-10T20:55:47.620144+0000","last_fullsized":"2024-09-10T20:55:47.620144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:23:19.583021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.619609+0000","last_change":"2024-09-10T20:55:44.372807+0000","last_active":"2024-09-10T20:55:47.619609+0000","last_peered":"2024-09-10T20:55:47.619609+0000","last_clean":"2024-09-10T20:55:47.619609+0000","last_became_active":"2024-09-10T20:55:44.372476+0000","last_became_peered":"2024-09-10T20:55:44.372476+0000","last_unstale":"2024-09-10T20:55:47.619609+0000","last_undegraded":"2024-09-10T20:55:47.619609+0000","last_fullsized":"2024-09-10T20:55:47.619609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:16:49.875268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.355691+0000","last_change":"2024-09-10T20:55:43.372918+0000","last_active":"2024-09-10T20:55:46.355691+0000","last_peered":"2024-09-10T20:55:46.355691+0000","last_clean":"2024-09-10T20:55:46.355691+0000","last_became_active":"2024-09-10T20:55:43.369953+0000","last_became_peered":"2024-09-10T20:55:43.369953+0000","last_unstale":"2024-09-10T20:55:46.355691+0000","last_undegraded":"2024-09-10T20:55:46.355691+0000","last_fullsized":"2024-09-10T20:55:46.355691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:51:58.280912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.619245+0000","last_change":"2024-09-10T20:55:43.370997+0000","last_active":"2024-09-10T20:55:47.619245+0000","last_peered":"2024-09-10T20:55:47.619245+0000","last_clean":"2024-09-10T20:55:47.619245+0000","last_became_active":"2024-09-10T20:55:43.370753+0000","last_became_peered":"2024-09-10T20:55:43.370753+0000","last_unstale":"2024-09-10T20:55:47.619245+0000","last_undegraded":"2024-09-10T20:55:47.619245+0000","last_fullsized":"2024-09-10T20:55:47.619245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:04:30.007942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.618843+0000","last_change":"2024-09-10T20:55:44.381520+0000","last_active":"2024-09-10T20:55:47.618843+0000","last_peered":"2024-09-10T20:55:47.618843+0000","last_clean":"2024-09-10T20:55:47.618843+0000","last_became_active":"2024-09-10T20:55:44.381184+0000","last_became_peered":"2024-09-10T20:55:44.381184+0000","last_unstale":"2024-09-10T20:55:47.618843+0000","last_undegraded":"2024-09-10T20:55:47.618843+0000","last_fullsized":"2024-09-10T20:55:47.618843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:10.680496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362827+0000","last_change":"2024-09-10T20:55:43.363749+0000","last_active":"2024-09-10T20:55:45.362827+0000","last_peered":"2024-09-10T20:55:45.362827+0000","last_clean":"2024-09-10T20:55:45.362827+0000","last_became_active":"2024-09-10T20:55:43.363070+0000","last_became_peered":"2024-09-10T20:55:43.363070+0000","last_unstale":"2024-09-10T20:55:45.362827+0000","last_undegraded":"2024-09-10T20:55:45.362827+0000","last_fullsized":"2024-09-10T20:55:45.362827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:44.779833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361364+0000","last_change":"2024-09-10T20:55:44.377537+0000","last_active":"2024-09-10T20:55:45.361364+0000","last_peered":"2024-09-10T20:55:45.361364+0000","last_clean":"2024-09-10T20:55:45.361364+0000","last_became_active":"2024-09-10T20:55:44.377261+0000","last_became_peered":"2024-09-10T20:55:44.377261+0000","last_unstale":"2024-09-10T20:55:45.361364+0000","last_undegraded":"2024-09-10T20:55:45.361364+0000","last_fullsized":"2024-09-10T20:55:45.361364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:21:11.284661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.356082+0000","last_change":"2024-09-10T20:55:43.371067+0000","last_active":"2024-09-10T20:55:46.356082+0000","last_peered":"2024-09-10T20:55:46.356082+0000","last_clean":"2024-09-10T20:55:46.356082+0000","last_became_active":"2024-09-10T20:55:43.370788+0000","last_became_peered":"2024-09-10T20:55:43.370788+0000","last_unstale":"2024-09-10T20:55:46.356082+0000","last_undegraded":"2024-09-10T20:55:46.356082+0000","last_fullsized":"2024-09-10T20:55:46.356082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:41:29.573514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363411+0000","last_change":"2024-09-10T20:55:44.378830+0000","last_active":"2024-09-10T20:55:45.363411+0000","last_peered":"2024-09-10T20:55:45.363411+0000","last_clean":"2024-09-10T20:55:45.363411+0000","last_became_active":"2024-09-10T20:55:44.378020+0000","last_became_peered":"2024-09-10T20:55:44.378020+0000","last_unstale":"2024-09-10T20:55:45.363411+0000","last_undegraded":"2024-09-10T20:55:45.363411+0000","last_fullsized":"2024-09-10T20:55:45.363411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:23:32.772228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363472+0000","last_change":"2024-09-10T20:55:43.372861+0000","last_active":"2024-09-10T20:55:45.363472+0000","last_peered":"2024-09-10T20:55:45.363472+0000","last_clean":"2024-09-10T20:55:45.363472+0000","last_became_active":"2024-09-10T20:55:43.372596+0000","last_became_peered":"2024-09-10T20:55:43.372596+0000","last_unstale":"2024-09-10T20:55:45.363472+0000","last_undegraded":"2024-09-10T20:55:45.363472+0000","last_fullsized":"2024-09-10T20:55:45.363472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:51:58.280912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.620083+0000","last_change":"2024-09-10T20:55:44.368307+0000","last_active":"2024-09-10T20:55:47.620083+0000","last_peered":"2024-09-10T20:55:47.620083+0000","last_clean":"2024-09-10T20:55:47.620083+0000","last_became_active":"2024-09-10T20:55:44.365395+0000","last_became_peered":"2024-09-10T20:55:44.365395+0000","last_unstale":"2024-09-10T20:55:47.620083+0000","last_undegraded":"2024-09-10T20:55:47.620083+0000","last_fullsized":"2024-09-10T20:55:47.620083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:32:54.439682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361560+0000","last_change":"2024-09-10T20:55:43.366971+0000","last_active":"2024-09-10T20:55:45.361560+0000","last_peered":"2024-09-10T20:55:45.361560+0000","last_clean":"2024-09-10T20:55:45.361560+0000","last_became_active":"2024-09-10T20:55:43.366692+0000","last_became_peered":"2024-09-10T20:55:43.366692+0000","last_unstale":"2024-09-10T20:55:45.361560+0000","last_undegraded":"2024-09-10T20:55:45.361560+0000","last_fullsized":"2024-09-10T20:55:45.361560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:04.606474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.627783+0000","last_change":"2024-09-10T20:55:44.368208+0000","last_active":"2024-09-10T20:55:46.627783+0000","last_peered":"2024-09-10T20:55:46.627783+0000","last_clean":"2024-09-10T20:55:46.627783+0000","last_became_active":"2024-09-10T20:55:44.367944+0000","last_became_peered":"2024-09-10T20:55:44.367944+0000","last_unstale":"2024-09-10T20:55:46.627783+0000","last_undegraded":"2024-09-10T20:55:46.627783+0000","last_fullsized":"2024-09-10T20:55:46.627783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:37:32.042518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.356052+0000","last_change":"2024-09-10T20:55:43.370938+0000","last_active":"2024-09-10T20:55:46.356052+0000","last_peered":"2024-09-10T20:55:46.356052+0000","last_clean":"2024-09-10T20:55:46.356052+0000","last_became_active":"2024-09-10T20:55:43.370674+0000","last_became_peered":"2024-09-10T20:55:43.370674+0000","last_unstale":"2024-09-10T20:55:46.356052+0000","last_undegraded":"2024-09-10T20:55:46.356052+0000","last_fullsized":"2024-09-10T20:55:46.356052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:52.212240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363966+0000","last_change":"2024-09-10T20:55:44.383665+0000","last_active":"2024-09-10T20:55:45.363966+0000","last_peered":"2024-09-10T20:55:45.363966+0000","last_clean":"2024-09-10T20:55:45.363966+0000","last_became_active":"2024-09-10T20:55:44.382473+0000","last_became_peered":"2024-09-10T20:55:44.382473+0000","last_unstale":"2024-09-10T20:55:45.363966+0000","last_undegraded":"2024-09-10T20:55:45.363966+0000","last_fullsized":"2024-09-10T20:55:45.363966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:04:31.815506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.619748+0000","last_change":"2024-09-10T20:55:43.365123+0000","last_active":"2024-09-10T20:55:47.619748+0000","last_peered":"2024-09-10T20:55:47.619748+0000","last_clean":"2024-09-10T20:55:47.619748+0000","last_became_active":"2024-09-10T20:55:43.364866+0000","last_became_peered":"2024-09-10T20:55:43.364866+0000","last_unstale":"2024-09-10T20:55:47.619748+0000","last_undegraded":"2024-09-10T20:55:47.619748+0000","last_fullsized":"2024-09-10T20:55:47.619748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:07:11.228176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.619098+0000","last_change":"2024-09-10T20:55:44.384522+0000","last_active":"2024-09-10T20:55:47.619098+0000","last_peered":"2024-09-10T20:55:47.619098+0000","last_clean":"2024-09-10T20:55:47.619098+0000","last_became_active":"2024-09-10T20:55:44.373788+0000","last_became_peered":"2024-09-10T20:55:44.373788+0000","last_unstale":"2024-09-10T20:55:47.619098+0000","last_undegraded":"2024-09-10T20:55:47.619098+0000","last_fullsized":"2024-09-10T20:55:47.619098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:52:15.023488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364231+0000","last_change":"2024-09-10T20:55:43.367632+0000","last_active":"2024-09-10T20:55:45.364231+0000","last_peered":"2024-09-10T20:55:45.364231+0000","last_clean":"2024-09-10T20:55:45.364231+0000","last_became_active":"2024-09-10T20:55:43.366886+0000","last_became_peered":"2024-09-10T20:55:43.366886+0000","last_unstale":"2024-09-10T20:55:45.364231+0000","last_undegraded":"2024-09-10T20:55:45.364231+0000","last_fullsized":"2024-09-10T20:55:45.364231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:52.212240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363214+0000","last_change":"2024-09-10T20:55:44.378167+0000","last_active":"2024-09-10T20:55:45.363214+0000","last_peered":"2024-09-10T20:55:45.363214+0000","last_clean":"2024-09-10T20:55:45.363214+0000","last_became_active":"2024-09-10T20:55:44.377891+0000","last_became_peered":"2024-09-10T20:55:44.377891+0000","last_unstale":"2024-09-10T20:55:45.363214+0000","last_undegraded":"2024-09-10T20:55:45.363214+0000","last_fullsized":"2024-09-10T20:55:45.363214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:03:40.884856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.355694+0000","last_change":"2024-09-10T20:55:43.374275+0000","last_active":"2024-09-10T20:55:46.355694+0000","last_peered":"2024-09-10T20:55:46.355694+0000","last_clean":"2024-09-10T20:55:46.355694+0000","last_became_active":"2024-09-10T20:55:43.373744+0000","last_became_peered":"2024-09-10T20:55:43.373744+0000","last_unstale":"2024-09-10T20:55:46.355694+0000","last_undegraded":"2024-09-10T20:55:46.355694+0000","last_fullsized":"2024-09-10T20:55:46.355694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:44.779833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.356079+0000","last_change":"2024-09-10T20:55:44.387669+0000","last_active":"2024-09-10T20:55:46.356079+0000","last_peered":"2024-09-10T20:55:46.356079+0000","last_clean":"2024-09-10T20:55:46.356079+0000","last_became_active":"2024-09-10T20:55:44.387385+0000","last_became_peered":"2024-09-10T20:55:44.387385+0000","last_unstale":"2024-09-10T20:55:46.356079+0000","last_undegraded":"2024-09-10T20:55:46.356079+0000","last_fullsized":"2024-09-10T20:55:46.356079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:55:40.289116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.918034+0000","last_change":"2024-09-10T20:55:43.364230+0000","last_active":"2024-09-10T20:55:45.918034+0000","last_peered":"2024-09-10T20:55:45.918034+0000","last_clean":"2024-09-10T20:55:45.918034+0000","last_became_active":"2024-09-10T20:55:43.363855+0000","last_became_peered":"2024-09-10T20:55:43.363855+0000","last_unstale":"2024-09-10T20:55:45.918034+0000","last_undegraded":"2024-09-10T20:55:45.918034+0000","last_fullsized":"2024-09-10T20:55:45.918034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:47:38.695432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362684+0000","last_change":"2024-09-10T20:55:44.377758+0000","last_active":"2024-09-10T20:55:45.362684+0000","last_peered":"2024-09-10T20:55:45.362684+0000","last_clean":"2024-09-10T20:55:45.362684+0000","last_became_active":"2024-09-10T20:55:44.376900+0000","last_became_peered":"2024-09-10T20:55:44.376900+0000","last_unstale":"2024-09-10T20:55:45.362684+0000","last_undegraded":"2024-09-10T20:55:45.362684+0000","last_fullsized":"2024-09-10T20:55:45.362684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:56.566092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.627648+0000","last_change":"2024-09-10T20:55:43.366524+0000","last_active":"2024-09-10T20:55:46.627648+0000","last_peered":"2024-09-10T20:55:46.627648+0000","last_clean":"2024-09-10T20:55:46.627648+0000","last_became_active":"2024-09-10T20:55:43.365064+0000","last_became_peered":"2024-09-10T20:55:43.365064+0000","last_unstale":"2024-09-10T20:55:46.627648+0000","last_undegraded":"2024-09-10T20:55:46.627648+0000","last_fullsized":"2024-09-10T20:55:46.627648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:35.578339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364979+0000","last_change":"2024-09-10T20:55:44.380007+0000","last_active":"2024-09-10T20:55:45.364979+0000","last_peered":"2024-09-10T20:55:45.364979+0000","last_clean":"2024-09-10T20:55:45.364979+0000","last_became_active":"2024-09-10T20:55:44.379509+0000","last_became_peered":"2024-09-10T20:55:44.379509+0000","last_unstale":"2024-09-10T20:55:45.364979+0000","last_undegraded":"2024-09-10T20:55:45.364979+0000","last_fullsized":"2024-09-10T20:55:45.364979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:19.493422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.918101+0000","last_change":"2024-09-10T20:55:43.367328+0000","last_active":"2024-09-10T20:55:45.918101+0000","last_peered":"2024-09-10T20:55:45.918101+0000","last_clean":"2024-09-10T20:55:45.918101+0000","last_became_active":"2024-09-10T20:55:43.366880+0000","last_became_peered":"2024-09-10T20:55:43.366880+0000","last_unstale":"2024-09-10T20:55:45.918101+0000","last_undegraded":"2024-09-10T20:55:45.918101+0000","last_fullsized":"2024-09-10T20:55:45.918101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:52.212240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364733+0000","last_change":"2024-09-10T20:55:44.387017+0000","last_active":"2024-09-10T20:55:45.364733+0000","last_peered":"2024-09-10T20:55:45.364733+0000","last_clean":"2024-09-10T20:55:45.364733+0000","last_became_active":"2024-09-10T20:55:44.386824+0000","last_became_peered":"2024-09-10T20:55:44.386824+0000","last_unstale":"2024-09-10T20:55:45.364733+0000","last_undegraded":"2024-09-10T20:55:45.364733+0000","last_fullsized":"2024-09-10T20:55:45.364733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:03.834745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361597+0000","last_change":"2024-09-10T20:55:43.363564+0000","last_active":"2024-09-10T20:55:45.361597+0000","last_peered":"2024-09-10T20:55:45.361597+0000","last_clean":"2024-09-10T20:55:45.361597+0000","last_became_active":"2024-09-10T20:55:43.363247+0000","last_became_peered":"2024-09-10T20:55:43.363247+0000","last_unstale":"2024-09-10T20:55:45.361597+0000","last_undegraded":"2024-09-10T20:55:45.361597+0000","last_fullsized":"2024-09-10T20:55:45.361597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:16.877259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363896+0000","last_change":"2024-09-10T20:55:44.382801+0000","last_active":"2024-09-10T20:55:45.363896+0000","last_peered":"2024-09-10T20:55:45.363896+0000","last_clean":"2024-09-10T20:55:45.363896+0000","last_became_active":"2024-09-10T20:55:44.382172+0000","last_became_peered":"2024-09-10T20:55:44.382172+0000","last_unstale":"2024-09-10T20:55:45.363896+0000","last_undegraded":"2024-09-10T20:55:45.363896+0000","last_fullsized":"2024-09-10T20:55:45.363896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:37:10.807087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.918024+0000","last_change":"2024-09-10T20:55:43.365372+0000","last_active":"2024-09-10T20:55:45.918024+0000","last_peered":"2024-09-10T20:55:45.918024+0000","last_clean":"2024-09-10T20:55:45.918024+0000","last_became_active":"2024-09-10T20:55:43.362283+0000","last_became_peered":"2024-09-10T20:55:43.362283+0000","last_unstale":"2024-09-10T20:55:45.918024+0000","last_undegraded":"2024-09-10T20:55:45.918024+0000","last_fullsized":"2024-09-10T20:55:45.918024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:51:58.280912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363976+0000","last_change":"2024-09-10T20:55:44.379042+0000","last_active":"2024-09-10T20:55:45.363976+0000","last_peered":"2024-09-10T20:55:45.363976+0000","last_clean":"2024-09-10T20:55:45.363976+0000","last_became_active":"2024-09-10T20:55:44.378742+0000","last_became_peered":"2024-09-10T20:55:44.378742+0000","last_unstale":"2024-09-10T20:55:45.363976+0000","last_undegraded":"2024-09-10T20:55:45.363976+0000","last_fullsized":"2024-09-10T20:55:45.363976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:27:25.913460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362265+0000","last_change":"2024-09-10T20:55:34.718784+0000","last_active":"2024-09-10T20:55:45.362265+0000","last_peered":"2024-09-10T20:55:45.362265+0000","last_clean":"2024-09-10T20:55:45.362265+0000","last_became_active":"2024-09-10T20:55:34.717616+0000","last_became_peered":"2024-09-10T20:55:34.717616+0000","last_unstale":"2024-09-10T20:55:45.362265+0000","last_undegraded":"2024-09-10T20:55:45.362265+0000","last_fullsized":"2024-09-10T20:55:45.362265+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:33.618098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:33.618098+0000","last_clean_scrub_stamp":"2024-09-10T20:55:33.618098+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:17.442729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362978+0000","last_change":"2024-09-10T20:55:43.364591+0000","last_active":"2024-09-10T20:55:45.362978+0000","last_peered":"2024-09-10T20:55:45.362978+0000","last_clean":"2024-09-10T20:55:45.362978+0000","last_became_active":"2024-09-10T20:55:43.363372+0000","last_became_peered":"2024-09-10T20:55:43.363372+0000","last_unstale":"2024-09-10T20:55:45.362978+0000","last_undegraded":"2024-09-10T20:55:45.362978+0000","last_fullsized":"2024-09-10T20:55:45.362978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:04.606474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.619744+0000","last_change":"2024-09-10T20:55:44.373563+0000","last_active":"2024-09-10T20:55:47.619744+0000","last_peered":"2024-09-10T20:55:47.619744+0000","last_clean":"2024-09-10T20:55:47.619744+0000","last_became_active":"2024-09-10T20:55:44.373244+0000","last_became_peered":"2024-09-10T20:55:44.373244+0000","last_unstale":"2024-09-10T20:55:47.619744+0000","last_undegraded":"2024-09-10T20:55:47.619744+0000","last_fullsized":"2024-09-10T20:55:47.619744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:57:35.324429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362107+0000","last_change":"2024-09-10T20:55:43.376868+0000","last_active":"2024-09-10T20:55:45.362107+0000","last_peered":"2024-09-10T20:55:45.362107+0000","last_clean":"2024-09-10T20:55:45.362107+0000","last_became_active":"2024-09-10T20:55:43.376616+0000","last_became_peered":"2024-09-10T20:55:43.376616+0000","last_unstale":"2024-09-10T20:55:45.362107+0000","last_undegraded":"2024-09-10T20:55:45.362107+0000","last_fullsized":"2024-09-10T20:55:45.362107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:04.606474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.618795+0000","last_change":"2024-09-10T20:55:44.370871+0000","last_active":"2024-09-10T20:55:47.618795+0000","last_peered":"2024-09-10T20:55:47.618795+0000","last_clean":"2024-09-10T20:55:47.618795+0000","last_became_active":"2024-09-10T20:55:44.370595+0000","last_became_peered":"2024-09-10T20:55:44.370595+0000","last_unstale":"2024-09-10T20:55:47.618795+0000","last_undegraded":"2024-09-10T20:55:47.618795+0000","last_fullsized":"2024-09-10T20:55:47.618795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:29:13.258273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.917992+0000","last_change":"2024-09-10T20:55:43.367129+0000","last_active":"2024-09-10T20:55:45.917992+0000","last_peered":"2024-09-10T20:55:45.917992+0000","last_clean":"2024-09-10T20:55:45.917992+0000","last_became_active":"2024-09-10T20:55:43.366825+0000","last_became_peered":"2024-09-10T20:55:43.366825+0000","last_unstale":"2024-09-10T20:55:45.917992+0000","last_undegraded":"2024-09-10T20:55:45.917992+0000","last_fullsized":"2024-09-10T20:55:45.917992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:44.779833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361375+0000","last_change":"2024-09-10T20:55:44.362975+0000","last_active":"2024-09-10T20:55:45.361375+0000","last_peered":"2024-09-10T20:55:45.361375+0000","last_clean":"2024-09-10T20:55:45.361375+0000","last_became_active":"2024-09-10T20:55:44.362495+0000","last_became_peered":"2024-09-10T20:55:44.362495+0000","last_unstale":"2024-09-10T20:55:45.361375+0000","last_undegraded":"2024-09-10T20:55:45.361375+0000","last_fullsized":"2024-09-10T20:55:45.361375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:01:47.424436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364336+0000","last_change":"2024-09-10T20:55:43.364574+0000","last_active":"2024-09-10T20:55:45.364336+0000","last_peered":"2024-09-10T20:55:45.364336+0000","last_clean":"2024-09-10T20:55:45.364336+0000","last_became_active":"2024-09-10T20:55:43.363895+0000","last_became_peered":"2024-09-10T20:55:43.363895+0000","last_unstale":"2024-09-10T20:55:45.364336+0000","last_undegraded":"2024-09-10T20:55:45.364336+0000","last_fullsized":"2024-09-10T20:55:45.364336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:41:29.573514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.627706+0000","last_change":"2024-09-10T20:55:44.377780+0000","last_active":"2024-09-10T20:55:46.627706+0000","last_peered":"2024-09-10T20:55:46.627706+0000","last_clean":"2024-09-10T20:55:46.627706+0000","last_became_active":"2024-09-10T20:55:44.377120+0000","last_became_peered":"2024-09-10T20:55:44.377120+0000","last_unstale":"2024-09-10T20:55:46.627706+0000","last_undegraded":"2024-09-10T20:55:46.627706+0000","last_fullsized":"2024-09-10T20:55:46.627706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:29.923800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361762+0000","last_change":"2024-09-10T20:55:43.374091+0000","last_active":"2024-09-10T20:55:45.361762+0000","last_peered":"2024-09-10T20:55:45.361762+0000","last_clean":"2024-09-10T20:55:45.361762+0000","last_became_active":"2024-09-10T20:55:43.373736+0000","last_became_peered":"2024-09-10T20:55:43.373736+0000","last_unstale":"2024-09-10T20:55:45.361762+0000","last_undegraded":"2024-09-10T20:55:45.361762+0000","last_fullsized":"2024-09-10T20:55:45.361762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:41:11.107382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364317+0000","last_change":"2024-09-10T20:55:44.382414+0000","last_active":"2024-09-10T20:55:45.364317+0000","last_peered":"2024-09-10T20:55:45.364317+0000","last_clean":"2024-09-10T20:55:45.364317+0000","last_became_active":"2024-09-10T20:55:44.382087+0000","last_became_peered":"2024-09-10T20:55:44.382087+0000","last_unstale":"2024-09-10T20:55:45.364317+0000","last_undegraded":"2024-09-10T20:55:45.364317+0000","last_fullsized":"2024-09-10T20:55:45.364317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:57.600887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364206+0000","last_change":"2024-09-10T20:55:43.380057+0000","last_active":"2024-09-10T20:55:45.364206+0000","last_peered":"2024-09-10T20:55:45.364206+0000","last_clean":"2024-09-10T20:55:45.364206+0000","last_became_active":"2024-09-10T20:55:43.379881+0000","last_became_peered":"2024-09-10T20:55:43.379881+0000","last_unstale":"2024-09-10T20:55:45.364206+0000","last_undegraded":"2024-09-10T20:55:45.364206+0000","last_fullsized":"2024-09-10T20:55:45.364206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:35:50.441609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361728+0000","last_change":"2024-09-10T20:55:44.362979+0000","last_active":"2024-09-10T20:55:45.361728+0000","last_peered":"2024-09-10T20:55:45.361728+0000","last_clean":"2024-09-10T20:55:45.361728+0000","last_became_active":"2024-09-10T20:55:44.362472+0000","last_became_peered":"2024-09-10T20:55:44.362472+0000","last_unstale":"2024-09-10T20:55:45.361728+0000","last_undegraded":"2024-09-10T20:55:45.361728+0000","last_fullsized":"2024-09-10T20:55:45.361728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:32:54.439682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361567+0000","last_change":"2024-09-10T20:55:43.372848+0000","last_active":"2024-09-10T20:55:45.361567+0000","last_peered":"2024-09-10T20:55:45.361567+0000","last_clean":"2024-09-10T20:55:45.361567+0000","last_became_active":"2024-09-10T20:55:43.372619+0000","last_became_peered":"2024-09-10T20:55:43.372619+0000","last_unstale":"2024-09-10T20:55:45.361567+0000","last_undegraded":"2024-09-10T20:55:45.361567+0000","last_fullsized":"2024-09-10T20:55:45.361567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:32.519717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.619659+0000","last_change":"2024-09-10T20:55:44.378521+0000","last_active":"2024-09-10T20:55:47.619659+0000","last_peered":"2024-09-10T20:55:47.619659+0000","last_clean":"2024-09-10T20:55:47.619659+0000","last_became_active":"2024-09-10T20:55:44.378187+0000","last_became_peered":"2024-09-10T20:55:44.378187+0000","last_unstale":"2024-09-10T20:55:47.619659+0000","last_undegraded":"2024-09-10T20:55:47.619659+0000","last_fullsized":"2024-09-10T20:55:47.619659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:10:30.574948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.356149+0000","last_change":"2024-09-10T20:55:43.374477+0000","last_active":"2024-09-10T20:55:46.356149+0000","last_peered":"2024-09-10T20:55:46.356149+0000","last_clean":"2024-09-10T20:55:46.356149+0000","last_became_active":"2024-09-10T20:55:43.373960+0000","last_became_peered":"2024-09-10T20:55:43.373960+0000","last_unstale":"2024-09-10T20:55:46.356149+0000","last_undegraded":"2024-09-10T20:55:46.356149+0000","last_fullsized":"2024-09-10T20:55:46.356149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:04.606474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.619460+0000","last_change":"2024-09-10T20:55:44.377264+0000","last_active":"2024-09-10T20:55:47.619460+0000","last_peered":"2024-09-10T20:55:47.619460+0000","last_clean":"2024-09-10T20:55:47.619460+0000","last_became_active":"2024-09-10T20:55:44.376997+0000","last_became_peered":"2024-09-10T20:55:44.376997+0000","last_unstale":"2024-09-10T20:55:47.619460+0000","last_undegraded":"2024-09-10T20:55:47.619460+0000","last_fullsized":"2024-09-10T20:55:47.619460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:55:40.289116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362099+0000","last_change":"2024-09-10T20:55:43.376292+0000","last_active":"2024-09-10T20:55:45.362099+0000","last_peered":"2024-09-10T20:55:45.362099+0000","last_clean":"2024-09-10T20:55:45.362099+0000","last_became_active":"2024-09-10T20:55:43.375988+0000","last_became_peered":"2024-09-10T20:55:43.375988+0000","last_unstale":"2024-09-10T20:55:45.362099+0000","last_undegraded":"2024-09-10T20:55:45.362099+0000","last_fullsized":"2024-09-10T20:55:45.362099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:41:29.573514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.627612+0000","last_change":"2024-09-10T20:55:44.372839+0000","last_active":"2024-09-10T20:55:46.627612+0000","last_peered":"2024-09-10T20:55:46.627612+0000","last_clean":"2024-09-10T20:55:46.627612+0000","last_became_active":"2024-09-10T20:55:44.372410+0000","last_became_peered":"2024-09-10T20:55:44.372410+0000","last_unstale":"2024-09-10T20:55:46.627612+0000","last_undegraded":"2024-09-10T20:55:46.627612+0000","last_fullsized":"2024-09-10T20:55:46.627612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:27:56.155122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361430+0000","last_change":"2024-09-10T20:55:43.376634+0000","last_active":"2024-09-10T20:55:45.361430+0000","last_peered":"2024-09-10T20:55:45.361430+0000","last_clean":"2024-09-10T20:55:45.361430+0000","last_became_active":"2024-09-10T20:55:43.376322+0000","last_became_peered":"2024-09-10T20:55:43.376322+0000","last_unstale":"2024-09-10T20:55:45.361430+0000","last_undegraded":"2024-09-10T20:55:45.361430+0000","last_fullsized":"2024-09-10T20:55:45.361430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:51:58.280912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.618996+0000","last_change":"2024-09-10T20:55:44.368404+0000","last_active":"2024-09-10T20:55:47.618996+0000","last_peered":"2024-09-10T20:55:47.618996+0000","last_clean":"2024-09-10T20:55:47.618996+0000","last_became_active":"2024-09-10T20:55:44.368024+0000","last_became_peered":"2024-09-10T20:55:44.368024+0000","last_unstale":"2024-09-10T20:55:47.618996+0000","last_undegraded":"2024-09-10T20:55:47.618996+0000","last_fullsized":"2024-09-10T20:55:47.618996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:18:57.908039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361426+0000","last_change":"2024-09-10T20:55:43.362895+0000","last_active":"2024-09-10T20:55:45.361426+0000","last_peered":"2024-09-10T20:55:45.361426+0000","last_clean":"2024-09-10T20:55:45.361426+0000","last_became_active":"2024-09-10T20:55:43.362589+0000","last_became_peered":"2024-09-10T20:55:43.362589+0000","last_unstale":"2024-09-10T20:55:45.361426+0000","last_undegraded":"2024-09-10T20:55:45.361426+0000","last_fullsized":"2024-09-10T20:55:45.361426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:52.212240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.620008+0000","last_change":"2024-09-10T20:55:44.390140+0000","last_active":"2024-09-10T20:55:47.620008+0000","last_peered":"2024-09-10T20:55:47.620008+0000","last_clean":"2024-09-10T20:55:47.620008+0000","last_became_active":"2024-09-10T20:55:44.389852+0000","last_became_peered":"2024-09-10T20:55:44.389852+0000","last_unstale":"2024-09-10T20:55:47.620008+0000","last_undegraded":"2024-09-10T20:55:47.620008+0000","last_fullsized":"2024-09-10T20:55:47.620008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:21:31.573395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363357+0000","last_change":"2024-09-10T20:55:43.376815+0000","last_active":"2024-09-10T20:55:45.363357+0000","last_peered":"2024-09-10T20:55:45.363357+0000","last_clean":"2024-09-10T20:55:45.363357+0000","last_became_active":"2024-09-10T20:55:43.376465+0000","last_became_peered":"2024-09-10T20:55:43.376465+0000","last_unstale":"2024-09-10T20:55:45.363357+0000","last_undegraded":"2024-09-10T20:55:45.363357+0000","last_fullsized":"2024-09-10T20:55:45.363357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:29.358166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.355895+0000","last_change":"2024-09-10T20:55:44.372811+0000","last_active":"2024-09-10T20:55:46.355895+0000","last_peered":"2024-09-10T20:55:46.355895+0000","last_clean":"2024-09-10T20:55:46.355895+0000","last_became_active":"2024-09-10T20:55:44.372498+0000","last_became_peered":"2024-09-10T20:55:44.372498+0000","last_unstale":"2024-09-10T20:55:46.355895+0000","last_undegraded":"2024-09-10T20:55:46.355895+0000","last_fullsized":"2024-09-10T20:55:46.355895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:03:43.922684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364096+0000","last_change":"2024-09-10T20:55:44.356261+0000","last_active":"2024-09-10T20:55:45.364096+0000","last_peered":"2024-09-10T20:55:45.364096+0000","last_clean":"2024-09-10T20:55:45.364096+0000","last_became_active":"2024-09-10T20:55:44.355918+0000","last_became_peered":"2024-09-10T20:55:44.355918+0000","last_unstale":"2024-09-10T20:55:45.364096+0000","last_undegraded":"2024-09-10T20:55:45.364096+0000","last_fullsized":"2024-09-10T20:55:45.364096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:57:27.229133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363650+0000","last_change":"2024-09-10T20:55:43.379354+0000","last_active":"2024-09-10T20:55:45.363650+0000","last_peered":"2024-09-10T20:55:45.363650+0000","last_clean":"2024-09-10T20:55:45.363650+0000","last_became_active":"2024-09-10T20:55:43.378912+0000","last_became_peered":"2024-09-10T20:55:43.378912+0000","last_unstale":"2024-09-10T20:55:45.363650+0000","last_undegraded":"2024-09-10T20:55:45.363650+0000","last_fullsized":"2024-09-10T20:55:45.363650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:16.877259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363676+0000","last_change":"2024-09-10T20:55:44.355826+0000","last_active":"2024-09-10T20:55:45.363676+0000","last_peered":"2024-09-10T20:55:45.363676+0000","last_clean":"2024-09-10T20:55:45.363676+0000","last_became_active":"2024-09-10T20:55:44.355502+0000","last_became_peered":"2024-09-10T20:55:44.355502+0000","last_unstale":"2024-09-10T20:55:45.363676+0000","last_undegraded":"2024-09-10T20:55:45.363676+0000","last_fullsized":"2024-09-10T20:55:45.363676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:46:20.226511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364080+0000","last_change":"2024-09-10T20:55:43.379688+0000","last_active":"2024-09-10T20:55:45.364080+0000","last_peered":"2024-09-10T20:55:45.364080+0000","last_clean":"2024-09-10T20:55:45.364080+0000","last_became_active":"2024-09-10T20:55:43.379480+0000","last_became_peered":"2024-09-10T20:55:43.379480+0000","last_unstale":"2024-09-10T20:55:45.364080+0000","last_undegraded":"2024-09-10T20:55:45.364080+0000","last_fullsized":"2024-09-10T20:55:45.364080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:41:11.107382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.619842+0000","last_change":"2024-09-10T20:55:44.381645+0000","last_active":"2024-09-10T20:55:47.619842+0000","last_peered":"2024-09-10T20:55:47.619842+0000","last_clean":"2024-09-10T20:55:47.619842+0000","last_became_active":"2024-09-10T20:55:44.376799+0000","last_became_peered":"2024-09-10T20:55:44.376799+0000","last_unstale":"2024-09-10T20:55:47.619842+0000","last_undegraded":"2024-09-10T20:55:47.619842+0000","last_fullsized":"2024-09-10T20:55:47.619842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:08.229059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.620479+0000","last_change":"2024-09-10T20:55:43.361529+0000","last_active":"2024-09-10T20:55:47.620479+0000","last_peered":"2024-09-10T20:55:47.620479+0000","last_clean":"2024-09-10T20:55:47.620479+0000","last_became_active":"2024-09-10T20:55:43.361270+0000","last_became_peered":"2024-09-10T20:55:43.361270+0000","last_unstale":"2024-09-10T20:55:47.620479+0000","last_undegraded":"2024-09-10T20:55:47.620479+0000","last_fullsized":"2024-09-10T20:55:47.620479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:26:10.795588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.619676+0000","last_change":"2024-09-10T20:55:44.378339+0000","last_active":"2024-09-10T20:55:47.619676+0000","last_peered":"2024-09-10T20:55:47.619676+0000","last_clean":"2024-09-10T20:55:47.619676+0000","last_became_active":"2024-09-10T20:55:44.378051+0000","last_became_peered":"2024-09-10T20:55:44.378051+0000","last_unstale":"2024-09-10T20:55:47.619676+0000","last_undegraded":"2024-09-10T20:55:47.619676+0000","last_fullsized":"2024-09-10T20:55:47.619676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:36.033123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.620088+0000","last_change":"2024-09-10T20:55:43.370516+0000","last_active":"2024-09-10T20:55:47.620088+0000","last_peered":"2024-09-10T20:55:47.620088+0000","last_clean":"2024-09-10T20:55:47.620088+0000","last_became_active":"2024-09-10T20:55:43.370211+0000","last_became_peered":"2024-09-10T20:55:43.370211+0000","last_unstale":"2024-09-10T20:55:47.620088+0000","last_undegraded":"2024-09-10T20:55:47.620088+0000","last_fullsized":"2024-09-10T20:55:47.620088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:53.823889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":819200,"data_stored":668106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":78768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":77246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":233472,"data_stored":77282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":77156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":77316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":827392,"data_stored":668162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":78768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T20:55:53.753 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T20:55:53.753 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-10T20:55:53.753 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-10T20:55:53.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.945+0000 7f6b72000640 1 -- 172.21.15.6:0/330877159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b6c15c170 msgr2=0x7f6b6c0cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:53.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.945+0000 7f6b72000640 1 --2- 172.21.15.6:0/330877159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b6c15c170 0x7f6b6c0cd920 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c051860 tx=0x7f6b5402a560 comp rx=0 tx=0).stop 2024-09-10T20:55:53.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.945+0000 7f6b72000640 1 -- 172.21.15.6:0/330877159 shutdown_connections 2024-09-10T20:55:53.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.945+0000 7f6b72000640 1 --2- 172.21.15.6:0/330877159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b6c15c170 0x7f6b6c0cd920 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:53.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.945+0000 7f6b72000640 1 --2- 172.21.15.6:0/330877159 >> v2:172.21.15.150:3300/0 conn(0x7f6b6c159670 0x7f6b6c0743b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:53.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.945+0000 7f6b72000640 1 -- 172.21.15.6:0/330877159 >> 172.21.15.6:0/330877159 conn(0x7f6b6c0cfa20 msgr2=0x7f6b6c0cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:53.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.945+0000 7f6b72000640 1 -- 172.21.15.6:0/330877159 shutdown_connections 2024-09-10T20:55:53.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.945+0000 7f6b72000640 1 -- 172.21.15.6:0/330877159 wait complete. 2024-09-10T20:55:53.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.947+0000 7f6b72000640 1 Processor -- start 2024-09-10T20:55:53.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.947+0000 7f6b72000640 1 -- start start 2024-09-10T20:55:53.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.948+0000 7f6b72000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b6c06fd40 0x7f6b6c156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:53.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.948+0000 7f6b72000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b6c159670 0x7f6b6c148ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:53.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.948+0000 7f6b72000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b6c15c170 0x7f6b6c1f4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:53.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.948+0000 7f6b72000640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6b6c0b4a90 con 0x7f6b6c06fd40 2024-09-10T20:55:53.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.948+0000 7f6b72000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6b6c0b4910 con 0x7f6b6c159670 2024-09-10T20:55:53.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.948+0000 7f6b72000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f6b6c0b4c10 con 0x7f6b6c15c170 2024-09-10T20:55:53.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.948+0000 7f6b6b400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b6c06fd40 0x7f6b6c156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:53.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.948+0000 7f6b6b400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b6c06fd40 0x7f6b6c156d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51040/0 (socket says 172.21.15.6:51040) 2024-09-10T20:55:53.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.948+0000 7f6b6b400640 1 -- 172.21.15.6:0/1716999736 learned_addr learned my addr 172.21.15.6:0/1716999736 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:53.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.948+0000 7f6b6be00640 1 --2- 172.21.15.6:0/1716999736 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b6c15c170 0x7f6b6c1f4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:53.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.948+0000 7f6b62a00640 1 --2- 172.21.15.6:0/1716999736 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b6c159670 0x7f6b6c148ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:53.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.948+0000 7f6b6b400640 1 -- 172.21.15.6:0/1716999736 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b6c15c170 msgr2=0x7f6b6c1f4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:53.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.948+0000 7f6b6b400640 1 --2- 172.21.15.6:0/1716999736 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b6c15c170 0x7f6b6c1f4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:53.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.948+0000 7f6b6b400640 1 -- 172.21.15.6:0/1716999736 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b6c159670 msgr2=0x7f6b6c148ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:53.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.948+0000 7f6b6b400640 1 --2- 172.21.15.6:0/1716999736 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b6c159670 0x7f6b6c148ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:53.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.948+0000 7f6b6b400640 1 -- 172.21.15.6:0/1716999736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b6c1f5160 con 0x7f6b6c06fd40 2024-09-10T20:55:53.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.949+0000 7f6b6b400640 1 --2- 172.21.15.6:0/1716999736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b6c06fd40 0x7f6b6c156d80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c00e9f0 tx=0x7f6b5c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:53.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.949+0000 7f6b63e00640 1 -- 172.21.15.6:0/1716999736 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c00cd80 con 0x7f6b6c06fd40 2024-09-10T20:55:53.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.949+0000 7f6b63e00640 1 -- 172.21.15.6:0/1716999736 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b5c005020 con 0x7f6b6c06fd40 2024-09-10T20:55:53.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.949+0000 7f6b63e00640 1 -- 172.21.15.6:0/1716999736 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c005450 con 0x7f6b6c06fd40 2024-09-10T20:55:53.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.949+0000 7f6b72000640 1 -- 172.21.15.6:0/1716999736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b6c15a3b0 con 0x7f6b6c06fd40 2024-09-10T20:55:53.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.949+0000 7f6b72000640 1 -- 172.21.15.6:0/1716999736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b6c15a970 con 0x7f6b6c06fd40 2024-09-10T20:55:53.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.950+0000 7f6b72000640 1 -- 172.21.15.6:0/1716999736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b6c0b50c0 con 0x7f6b6c06fd40 2024-09-10T20:55:53.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.951+0000 7f6b63e00640 1 -- 172.21.15.6:0/1716999736 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6b5c0047a0 con 0x7f6b6c06fd40 2024-09-10T20:55:53.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.952+0000 7f6b63e00640 1 --2- 172.21.15.6:0/1716999736 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6b48077f70 0x7f6b4807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:53.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.952+0000 7f6b63e00640 1 -- 172.21.15.6:0/1716999736 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f6b5c09a800 con 0x7f6b6c06fd40 2024-09-10T20:55:53.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.953+0000 7f6b62a00640 1 --2- 172.21.15.6:0/1716999736 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6b48077f70 0x7f6b4807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:53.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.954+0000 7f6b62a00640 1 --2- 172.21.15.6:0/1716999736 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6b48077f70 0x7f6b4807a430 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6b54033000 tx=0x7f6b54004730 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:53.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:53.956+0000 7f6b63e00640 1 -- 172.21.15.6:0/1716999736 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f6b5c0633b0 con 0x7f6b6c06fd40 2024-09-10T20:55:54.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.151+0000 7f6b72000640 1 -- 172.21.15.6:0/1716999736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f6b6c069d20 con 0x7f6b6c06fd40 2024-09-10T20:55:54.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.151+0000 7f6b63e00640 1 -- 172.21.15.6:0/1716999736 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v27) ==== 86+0+160 (secure 0 0 0) 0x7f6b5c062cb0 con 0x7f6b6c06fd40 2024-09-10T20:55:54.155 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:55:54.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.154+0000 7f6b72000640 1 -- 172.21.15.6:0/1716999736 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6b48077f70 msgr2=0x7f6b4807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:54.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.154+0000 7f6b72000640 1 --2- 172.21.15.6:0/1716999736 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6b48077f70 0x7f6b4807a430 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6b54033000 tx=0x7f6b54004730 comp rx=0 tx=0).stop 2024-09-10T20:55:54.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.154+0000 7f6b72000640 1 -- 172.21.15.6:0/1716999736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b6c06fd40 msgr2=0x7f6b6c156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:54.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.154+0000 7f6b72000640 1 --2- 172.21.15.6:0/1716999736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b6c06fd40 0x7f6b6c156d80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c00e9f0 tx=0x7f6b5c00edf0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.154+0000 7f6b72000640 1 -- 172.21.15.6:0/1716999736 shutdown_connections 2024-09-10T20:55:54.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.154+0000 7f6b72000640 1 --2- 172.21.15.6:0/1716999736 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6b48077f70 0x7f6b4807a430 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.154+0000 7f6b72000640 1 --2- 172.21.15.6:0/1716999736 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b6c15c170 0x7f6b6c1f4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.154+0000 7f6b72000640 1 --2- 172.21.15.6:0/1716999736 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b6c159670 0x7f6b6c148ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.154+0000 7f6b72000640 1 --2- 172.21.15.6:0/1716999736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b6c06fd40 0x7f6b6c156d80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.154+0000 7f6b72000640 1 -- 172.21.15.6:0/1716999736 >> 172.21.15.6:0/1716999736 conn(0x7f6b6c0cfa20 msgr2=0x7f6b6c073fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:54.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.154+0000 7f6b72000640 1 -- 172.21.15.6:0/1716999736 shutdown_connections 2024-09-10T20:55:54.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.154+0000 7f6b72000640 1 -- 172.21.15.6:0/1716999736 wait complete. 2024-09-10T20:55:54.173 INFO:teuthology.orchestra.run.smithi006.stdout:[{"version":27,"timestamp":"2024-09-10T20:55:31.917134+0000","name":"","changes":[{"name":"osd.4/osd_mclock_max_capacity_iops_ssd","new_value":"5834.445474"}]}] 2024-09-10T20:55:54.174 INFO:tasks.ceph_manager:config epoch is 27 2024-09-10T20:55:54.174 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-10T20:55:54.174 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-10T20:55:54.174 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-10T20:55:54.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.330+0000 7f4f0e800640 1 -- 172.21.15.6:0/318538838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f0815dc90 msgr2=0x7f4f080d46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:54.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.330+0000 7f4f0e800640 1 --2- 172.21.15.6:0/318538838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f0815dc90 0x7f4f080d46a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4efc005fd0 tx=0x7f4efc02a670 comp rx=0 tx=0).stop 2024-09-10T20:55:54.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.331+0000 7f4f0e800640 1 -- 172.21.15.6:0/318538838 shutdown_connections 2024-09-10T20:55:54.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.331+0000 7f4f0e800640 1 --2- 172.21.15.6:0/318538838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f0815dc90 0x7f4f080d46a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.331+0000 7f4f0e800640 1 -- 172.21.15.6:0/318538838 >> 172.21.15.6:0/318538838 conn(0x7f4f0809d0a0 msgr2=0x7f4f080d3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:54.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.331+0000 7f4f0e800640 1 -- 172.21.15.6:0/318538838 shutdown_connections 2024-09-10T20:55:54.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.331+0000 7f4f0e800640 1 -- 172.21.15.6:0/318538838 wait complete. 2024-09-10T20:55:54.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.332+0000 7f4f0e800640 1 Processor -- start 2024-09-10T20:55:54.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.332+0000 7f4f0e800640 1 -- start start 2024-09-10T20:55:54.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.333+0000 7f4f0e800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f080cf380 0x7f4f080b7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:54.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.333+0000 7f4f0e800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f0815dc90 0x7f4f080b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:54.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.333+0000 7f4f0e800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f08161930 0x7f4f08160540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:54.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.333+0000 7f4f0e800640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4f080b3350 con 0x7f4f080cf380 2024-09-10T20:55:54.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.333+0000 7f4f0e800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4f0815e280 con 0x7f4f0815dc90 2024-09-10T20:55:54.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.333+0000 7f4f0e800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f4f080b34d0 con 0x7f4f08161930 2024-09-10T20:55:54.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.334+0000 7f4f0d400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f080cf380 0x7f4f080b7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:54.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.334+0000 7f4f0d400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f080cf380 0x7f4f080b7980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51046/0 (socket says 172.21.15.6:51046) 2024-09-10T20:55:54.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.334+0000 7f4f0d400640 1 -- 172.21.15.6:0/3785086547 learned_addr learned my addr 172.21.15.6:0/3785086547 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:54.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.334+0000 7f4f0ca00640 1 --2- 172.21.15.6:0/3785086547 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f0815dc90 0x7f4f080b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:54.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.334+0000 7f4f0de00640 1 --2- 172.21.15.6:0/3785086547 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f08161930 0x7f4f08160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:54.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.334+0000 7f4f0d400640 1 -- 172.21.15.6:0/3785086547 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f08161930 msgr2=0x7f4f08160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:54.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.334+0000 7f4f0d400640 1 --2- 172.21.15.6:0/3785086547 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f08161930 0x7f4f08160540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.334+0000 7f4f0d400640 1 -- 172.21.15.6:0/3785086547 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f0815dc90 msgr2=0x7f4f080b0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:54.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.334+0000 7f4f0d400640 1 --2- 172.21.15.6:0/3785086547 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f0815dc90 0x7f4f080b0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.334+0000 7f4f0d400640 1 -- 172.21.15.6:0/3785086547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f081f4520 con 0x7f4f080cf380 2024-09-10T20:55:54.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.334+0000 7f4f0ca00640 1 --2- 172.21.15.6:0/3785086547 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f0815dc90 0x7f4f080b0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:55:54.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.334+0000 7f4f0de00640 1 --2- 172.21.15.6:0/3785086547 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f08161930 0x7f4f08160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:55:54.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.334+0000 7f4f0d400640 1 --2- 172.21.15.6:0/3785086547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f080cf380 0x7f4f080b7980 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4efc009850 tx=0x7f4efc0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:54.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.335+0000 7f4f05600640 1 -- 172.21.15.6:0/3785086547 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4efc03f070 con 0x7f4f080cf380 2024-09-10T20:55:54.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.335+0000 7f4f0e800640 1 -- 172.21.15.6:0/3785086547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f081f47e0 con 0x7f4f080cf380 2024-09-10T20:55:54.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.335+0000 7f4f05600640 1 -- 172.21.15.6:0/3785086547 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4efc004890 con 0x7f4f080cf380 2024-09-10T20:55:54.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.335+0000 7f4f05600640 1 -- 172.21.15.6:0/3785086547 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4efc035030 con 0x7f4f080cf380 2024-09-10T20:55:54.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.335+0000 7f4f0e800640 1 -- 172.21.15.6:0/3785086547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f081f4da0 con 0x7f4f080cf380 2024-09-10T20:55:54.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.336+0000 7f4f0e800640 1 -- 172.21.15.6:0/3785086547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f080b3a30 con 0x7f4f080cf380 2024-09-10T20:55:54.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.337+0000 7f4f05600640 1 -- 172.21.15.6:0/3785086547 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4efc004c60 con 0x7f4f080cf380 2024-09-10T20:55:54.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.338+0000 7f4f05600640 1 --2- 172.21.15.6:0/3785086547 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4ee8077f70 0x7f4ee807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:54.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.338+0000 7f4f05600640 1 -- 172.21.15.6:0/3785086547 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f4efc0bb180 con 0x7f4f080cf380 2024-09-10T20:55:54.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.338+0000 7f4f0ca00640 1 --2- 172.21.15.6:0/3785086547 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4ee8077f70 0x7f4ee807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:54.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.339+0000 7f4f0ca00640 1 --2- 172.21.15.6:0/3785086547 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4ee8077f70 0x7f4ee807a430 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4007fd0 tx=0x7f4ef4009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:54.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.342+0000 7f4f05600640 1 -- 172.21.15.6:0/3785086547 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4efc083b60 con 0x7f4f080cf380 2024-09-10T20:55:54.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.588+0000 7f4f0e800640 1 -- 172.21.15.6:0/3785086547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f4f081f5140 con 0x7f4f080cf380 2024-09-10T20:55:54.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.591+0000 7f4f05600640 1 -- 172.21.15.6:0/3785086547 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+193250 (secure 0 0 0) 0x7f4efc083460 con 0x7f4f080cf380 2024-09-10T20:55:54.598 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:55:54.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.595+0000 7f4f0e800640 1 -- 172.21.15.6:0/3785086547 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4ee8077f70 msgr2=0x7f4ee807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:54.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.595+0000 7f4f0e800640 1 --2- 172.21.15.6:0/3785086547 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4ee8077f70 0x7f4ee807a430 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4007fd0 tx=0x7f4ef4009040 comp rx=0 tx=0).stop 2024-09-10T20:55:54.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.595+0000 7f4f0e800640 1 -- 172.21.15.6:0/3785086547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f080cf380 msgr2=0x7f4f080b7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:54.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.595+0000 7f4f0e800640 1 --2- 172.21.15.6:0/3785086547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f080cf380 0x7f4f080b7980 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4efc009850 tx=0x7f4efc0039e0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.595+0000 7f4f0e800640 1 -- 172.21.15.6:0/3785086547 shutdown_connections 2024-09-10T20:55:54.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.595+0000 7f4f0e800640 1 --2- 172.21.15.6:0/3785086547 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4ee8077f70 0x7f4ee807a430 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.595+0000 7f4f0e800640 1 --2- 172.21.15.6:0/3785086547 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f08161930 0x7f4f08160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.595+0000 7f4f0e800640 1 --2- 172.21.15.6:0/3785086547 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f0815dc90 0x7f4f080b0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.595+0000 7f4f0e800640 1 --2- 172.21.15.6:0/3785086547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f080cf380 0x7f4f080b7980 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.595+0000 7f4f0e800640 1 -- 172.21.15.6:0/3785086547 >> 172.21.15.6:0/3785086547 conn(0x7f4f0809d0a0 msgr2=0x7f4f080b1f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:54.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.595+0000 7f4f0e800640 1 -- 172.21.15.6:0/3785086547 shutdown_connections 2024-09-10T20:55:54.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.595+0000 7f4f0e800640 1 -- 172.21.15.6:0/3785086547 wait complete. 2024-09-10T20:55:54.614 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":5,"flags":0,"active_gid":4120,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":1238179351},{"type":"v1","addr":"172.21.15.150:6801","nonce":1238179351}]},"active_addr":"172.21.15.150:6801/1238179351","active_change":"2024-09-10T20:55:23.159141+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4105,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.150:0","nonce":2537862174}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.150:0","nonce":1632445662}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.150:0","nonce":2211631949}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.150:0","nonce":3439619322}]}]} 2024-09-10T20:55:54.619 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-10T20:55:54.619 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-10T20:55:54.619 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T20:55:54.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.775+0000 7fd453e00640 1 -- 172.21.15.6:0/2065198912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd454166740 msgr2=0x7fd454168b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:54.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.775+0000 7fd453e00640 1 --2- 172.21.15.6:0/2065198912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd454166740 0x7fd454168b30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd44c005fd0 tx=0x7fd44c02a8b0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.775+0000 7fd453e00640 1 -- 172.21.15.6:0/2065198912 shutdown_connections 2024-09-10T20:55:54.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.775+0000 7fd453e00640 1 --2- 172.21.15.6:0/2065198912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd454166740 0x7fd454168b30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.775+0000 7fd453e00640 1 -- 172.21.15.6:0/2065198912 >> 172.21.15.6:0/2065198912 conn(0x7fd45406cf90 msgr2=0x7fd45406d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:54.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.775+0000 7fd453e00640 1 -- 172.21.15.6:0/2065198912 shutdown_connections 2024-09-10T20:55:54.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.775+0000 7fd453e00640 1 -- 172.21.15.6:0/2065198912 wait complete. 2024-09-10T20:55:54.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.777+0000 7fd453e00640 1 Processor -- start 2024-09-10T20:55:54.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.777+0000 7fd453e00640 1 -- start start 2024-09-10T20:55:54.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.778+0000 7fd453e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4540b3390 0x7fd4540cda70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:54.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.778+0000 7fd453e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd45415e120 0x7fd4540b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:54.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.778+0000 7fd453e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd454166740 0x7fd45414a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:54.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.778+0000 7fd453e00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd454169070 con 0x7fd454166740 2024-09-10T20:55:54.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.778+0000 7fd453e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd4541550a0 con 0x7fd45415e120 2024-09-10T20:55:54.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.778+0000 7fd453e00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd4541691f0 con 0x7fd4540b3390 2024-09-10T20:55:54.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.778+0000 7fd453400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd454166740 0x7fd45414a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:54.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.778+0000 7fd453400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd454166740 0x7fd45414a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51074/0 (socket says 172.21.15.6:51074) 2024-09-10T20:55:54.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.778+0000 7fd453400640 1 -- 172.21.15.6:0/3742073698 learned_addr learned my addr 172.21.15.6:0/3742073698 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:54.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.778+0000 7fd452000640 1 --2- 172.21.15.6:0/3742073698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd45415e120 0x7fd4540b1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:54.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.778+0000 7fd452a00640 1 --2- 172.21.15.6:0/3742073698 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4540b3390 0x7fd4540cda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:54.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.778+0000 7fd453400640 1 -- 172.21.15.6:0/3742073698 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4540b3390 msgr2=0x7fd4540cda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:54.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.778+0000 7fd453400640 1 --2- 172.21.15.6:0/3742073698 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4540b3390 0x7fd4540cda70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.778+0000 7fd453400640 1 -- 172.21.15.6:0/3742073698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd45415e120 msgr2=0x7fd4540b1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:54.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.778+0000 7fd453400640 1 --2- 172.21.15.6:0/3742073698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd45415e120 0x7fd4540b1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.778+0000 7fd453400640 1 -- 172.21.15.6:0/3742073698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd45414a7e0 con 0x7fd454166740 2024-09-10T20:55:54.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.778+0000 7fd452a00640 1 --2- 172.21.15.6:0/3742073698 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4540b3390 0x7fd4540cda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:55:54.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.779+0000 7fd453400640 1 --2- 172.21.15.6:0/3742073698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd454166740 0x7fd45414a2a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd44c009cd0 tx=0x7fd44c0316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:54.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.779+0000 7fd44aa00640 1 -- 172.21.15.6:0/3742073698 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd44c031990 con 0x7fd454166740 2024-09-10T20:55:54.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.779+0000 7fd44aa00640 1 -- 172.21.15.6:0/3742073698 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd44c031c20 con 0x7fd454166740 2024-09-10T20:55:54.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.779+0000 7fd453e00640 1 -- 172.21.15.6:0/3742073698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4540ce100 con 0x7fd454166740 2024-09-10T20:55:54.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.779+0000 7fd44aa00640 1 -- 172.21.15.6:0/3742073698 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd44c0330d0 con 0x7fd454166740 2024-09-10T20:55:54.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.779+0000 7fd453e00640 1 -- 172.21.15.6:0/3742073698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4540cc570 con 0x7fd454166740 2024-09-10T20:55:54.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.780+0000 7fd453e00640 1 -- 172.21.15.6:0/3742073698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4540b3770 con 0x7fd454166740 2024-09-10T20:55:54.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.781+0000 7fd44aa00640 1 -- 172.21.15.6:0/3742073698 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd44c04b030 con 0x7fd454166740 2024-09-10T20:55:54.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.782+0000 7fd44aa00640 1 --2- 172.21.15.6:0/3742073698 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd434077f90 0x7fd43407a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:54.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.782+0000 7fd44aa00640 1 -- 172.21.15.6:0/3742073698 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd44c0baea0 con 0x7fd454166740 2024-09-10T20:55:54.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.782+0000 7fd452a00640 1 --2- 172.21.15.6:0/3742073698 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd434077f90 0x7fd43407a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:54.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.783+0000 7fd452a00640 1 --2- 172.21.15.6:0/3742073698 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd434077f90 0x7fd43407a450 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd4440013f0 tx=0x7fd444009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:54.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.786+0000 7fd44aa00640 1 -- 172.21.15.6:0/3742073698 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fd44c03f030 con 0x7fd454166740 2024-09-10T20:55:54.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.980+0000 7fd453e00640 1 -- 172.21.15.6:0/3742073698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd45415e720 con 0x7fd454166740 2024-09-10T20:55:54.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.982+0000 7fd44aa00640 1 -- 172.21.15.6:0/3742073698 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16605 (secure 0 0 0) 0x7fd44c083990 con 0x7fd454166740 2024-09-10T20:55:54.986 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:55:54.986 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":22,"fsid":"9e04309e-61c3-4c78-82db-9576e465d98a","created":"2024-09-10T20:55:17.972466+0000","modified":"2024-09-10T20:55:45.353614+0000","last_up_change":"2024-09-10T20:55:32.392769+0000","last_in_change":"2024-09-10T20:55:22.232252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:55:33.196464+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:55:41.833420+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T20:55:42.749182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0918c5c8-a028-4987-bad2-406c412ec3f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6801","nonce":895515615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6803","nonce":895515615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6807","nonce":895515615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6805","nonce":895515615}]},"public_addr":"172.21.15.6:6801/895515615","cluster_addr":"172.21.15.6:6803/895515615","heartbeat_back_addr":"172.21.15.6:6807/895515615","heartbeat_front_addr":"172.21.15.6:6805/895515615","state":["exists","up"]},{"osd":1,"uuid":"415e9c78-c3d9-46d6-b277-348453f42155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6809","nonce":1129113250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6811","nonce":1129113250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6815","nonce":1129113250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6813","nonce":1129113250}]},"public_addr":"172.21.15.6:6809/1129113250","cluster_addr":"172.21.15.6:6811/1129113250","heartbeat_back_addr":"172.21.15.6:6815/1129113250","heartbeat_front_addr":"172.21.15.6:6813/1129113250","state":["exists","up"]},{"osd":2,"uuid":"763c1cf2-a43d-4c10-815d-eaf4a32afc1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6825","nonce":3847470051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6827","nonce":3847470051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6831","nonce":3847470051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6829","nonce":3847470051}]},"public_addr":"172.21.15.6:6825/3847470051","cluster_addr":"172.21.15.6:6827/3847470051","heartbeat_back_addr":"172.21.15.6:6831/3847470051","heartbeat_front_addr":"172.21.15.6:6829/3847470051","state":["exists","up"]},{"osd":3,"uuid":"877b1cc1-2434-4b32-af66-9c2485eac9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6817","nonce":3911674247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6819","nonce":3911674247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6823","nonce":3911674247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6821","nonce":3911674247}]},"public_addr":"172.21.15.6:6817/3911674247","cluster_addr":"172.21.15.6:6819/3911674247","heartbeat_back_addr":"172.21.15.6:6823/3911674247","heartbeat_front_addr":"172.21.15.6:6821/3911674247","state":["exists","up"]},{"osd":4,"uuid":"e0b27501-dfdc-4e7f-b73a-9573c869267a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6827","nonce":2568527750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6829","nonce":2568527750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6833","nonce":2568527750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6831","nonce":2568527750}]},"public_addr":"172.21.15.150:6827/2568527750","cluster_addr":"172.21.15.150:6829/2568527750","heartbeat_back_addr":"172.21.15.150:6833/2568527750","heartbeat_front_addr":"172.21.15.150:6831/2568527750","state":["exists","up"]},{"osd":5,"uuid":"67e48053-4f15-44fd-a30c-c9522f86d169","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6811","nonce":371417736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6813","nonce":371417736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6817","nonce":371417736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6815","nonce":371417736}]},"public_addr":"172.21.15.150:6811/371417736","cluster_addr":"172.21.15.150:6813/371417736","heartbeat_back_addr":"172.21.15.150:6817/371417736","heartbeat_front_addr":"172.21.15.150:6815/371417736","state":["exists","up"]},{"osd":6,"uuid":"1456df2e-ae91-45a4-bc3a-a06c753092af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6819","nonce":2329248366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6821","nonce":2329248366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6825","nonce":2329248366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6823","nonce":2329248366}]},"public_addr":"172.21.15.150:6819/2329248366","cluster_addr":"172.21.15.150:6821/2329248366","heartbeat_back_addr":"172.21.15.150:6825/2329248366","heartbeat_front_addr":"172.21.15.150:6823/2329248366","state":["exists","up"]},{"osd":7,"uuid":"a9daafcb-5ecd-43bd-ab0a-dc4b480cfc2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6803","nonce":527018351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6805","nonce":527018351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6809","nonce":527018351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6807","nonce":527018351}]},"public_addr":"172.21.15.150:6803/527018351","cluster_addr":"172.21.15.150:6805/527018351","heartbeat_back_addr":"172.21.15.150:6809/527018351","heartbeat_front_addr":"172.21.15.150:6807/527018351","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.710061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.024506+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.824320+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.431608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.637032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.054828+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.333290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.358875+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:55:54.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.984+0000 7fd453e00640 1 -- 172.21.15.6:0/3742073698 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd434077f90 msgr2=0x7fd43407a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:54.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.984+0000 7fd453e00640 1 --2- 172.21.15.6:0/3742073698 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd434077f90 0x7fd43407a450 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd4440013f0 tx=0x7fd444009040 comp rx=0 tx=0).stop 2024-09-10T20:55:54.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.984+0000 7fd453e00640 1 -- 172.21.15.6:0/3742073698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd454166740 msgr2=0x7fd45414a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:54.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.984+0000 7fd453e00640 1 --2- 172.21.15.6:0/3742073698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd454166740 0x7fd45414a2a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd44c009cd0 tx=0x7fd44c0316d0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.984+0000 7fd453e00640 1 -- 172.21.15.6:0/3742073698 shutdown_connections 2024-09-10T20:55:54.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.984+0000 7fd453e00640 1 --2- 172.21.15.6:0/3742073698 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd434077f90 0x7fd43407a450 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.984+0000 7fd453e00640 1 --2- 172.21.15.6:0/3742073698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd454166740 0x7fd45414a2a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.984+0000 7fd453e00640 1 --2- 172.21.15.6:0/3742073698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd45415e120 0x7fd4540b1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.984+0000 7fd453e00640 1 --2- 172.21.15.6:0/3742073698 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4540b3390 0x7fd4540cda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.984+0000 7fd453e00640 1 -- 172.21.15.6:0/3742073698 >> 172.21.15.6:0/3742073698 conn(0x7fd45406cf90 msgr2=0x7fd454073f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:54.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.984+0000 7fd453e00640 1 -- 172.21.15.6:0/3742073698 shutdown_connections 2024-09-10T20:55:54.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:54.984+0000 7fd453e00640 1 -- 172.21.15.6:0/3742073698 wait complete. 2024-09-10T20:55:55.005 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-10T20:55:55.005 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T20:55:55.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.161+0000 7f8323800640 1 -- 172.21.15.6:0/2439160807 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f831c070450 msgr2=0x7f831c0cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.161+0000 7f8323800640 1 --2- 172.21.15.6:0/2439160807 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f831c070450 0x7f831c0cd920 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8314005fd0 tx=0x7f831402aa10 comp rx=0 tx=0).stop 2024-09-10T20:55:55.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.161+0000 7f8323800640 1 -- 172.21.15.6:0/2439160807 shutdown_connections 2024-09-10T20:55:55.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.161+0000 7f8323800640 1 --2- 172.21.15.6:0/2439160807 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f831c070450 0x7f831c0cd920 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.161+0000 7f8323800640 1 --2- 172.21.15.6:0/2439160807 >> v2:172.21.15.150:3300/0 conn(0x7f831c159670 0x7f831c0743b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.161+0000 7f8323800640 1 -- 172.21.15.6:0/2439160807 >> 172.21.15.6:0/2439160807 conn(0x7f831c0cfa20 msgr2=0x7f831c0cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:55.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.161+0000 7f8323800640 1 -- 172.21.15.6:0/2439160807 shutdown_connections 2024-09-10T20:55:55.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.161+0000 7f8323800640 1 -- 172.21.15.6:0/2439160807 wait complete. 2024-09-10T20:55:55.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.163+0000 7f8323800640 1 Processor -- start 2024-09-10T20:55:55.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.163+0000 7f8323800640 1 -- start start 2024-09-10T20:55:55.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.164+0000 7f8323800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f831c070450 0x7f831c154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:55.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.164+0000 7f8323800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f831c159670 0x7f831c0afa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:55.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.164+0000 7f8323800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f831c15c170 0x7f831c0aff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:55.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.164+0000 7f8323800640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f831c0b4ca0 con 0x7f831c159670 2024-09-10T20:55:55.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.164+0000 7f8323800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f831c0b4b20 con 0x7f831c15c170 2024-09-10T20:55:55.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.164+0000 7f8323800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f831c0b4e20 con 0x7f831c070450 2024-09-10T20:55:55.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.164+0000 7f831be00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f831c159670 0x7f831c0afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:55.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.164+0000 7f831be00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f831c159670 0x7f831c0afa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51082/0 (socket says 172.21.15.6:51082) 2024-09-10T20:55:55.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.164+0000 7f831be00640 1 -- 172.21.15.6:0/267689054 learned_addr learned my addr 172.21.15.6:0/267689054 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:55.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.164+0000 7f8320e00640 1 --2- 172.21.15.6:0/267689054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f831c070450 0x7f831c154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:55.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.164+0000 7f8321800640 1 --2- 172.21.15.6:0/267689054 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f831c15c170 0x7f831c0aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:55.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.164+0000 7f831be00640 1 -- 172.21.15.6:0/267689054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f831c070450 msgr2=0x7f831c154100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.164+0000 7f831be00640 1 --2- 172.21.15.6:0/267689054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f831c070450 0x7f831c154100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.164+0000 7f831be00640 1 -- 172.21.15.6:0/267689054 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f831c15c170 msgr2=0x7f831c0aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.164+0000 7f831be00640 1 --2- 172.21.15.6:0/267689054 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f831c15c170 0x7f831c0aff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.164+0000 7f831be00640 1 -- 172.21.15.6:0/267689054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f831c1f90a0 con 0x7f831c159670 2024-09-10T20:55:55.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.164+0000 7f8321800640 1 --2- 172.21.15.6:0/267689054 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f831c15c170 0x7f831c0aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:55:55.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.165+0000 7f831be00640 1 --2- 172.21.15.6:0/267689054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f831c159670 0x7f831c0afa50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f830800c420 tx=0x7f830800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:55.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.165+0000 7f8318c00640 1 -- 172.21.15.6:0/267689054 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8308017070 con 0x7f831c159670 2024-09-10T20:55:55.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.165+0000 7f8318c00640 1 -- 172.21.15.6:0/267689054 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f83080053c0 con 0x7f831c159670 2024-09-10T20:55:55.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.165+0000 7f8318c00640 1 -- 172.21.15.6:0/267689054 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8308003850 con 0x7f831c159670 2024-09-10T20:55:55.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.165+0000 7f8323800640 1 -- 172.21.15.6:0/267689054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f831c1f4d00 con 0x7f831c159670 2024-09-10T20:55:55.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.165+0000 7f8323800640 1 -- 172.21.15.6:0/267689054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f831c1f52c0 con 0x7f831c159670 2024-09-10T20:55:55.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.166+0000 7f8323800640 1 -- 172.21.15.6:0/267689054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f831c0b52d0 con 0x7f831c159670 2024-09-10T20:55:55.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.167+0000 7f8318c00640 1 -- 172.21.15.6:0/267689054 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f83080039f0 con 0x7f831c159670 2024-09-10T20:55:55.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.169+0000 7f8318c00640 1 --2- 172.21.15.6:0/267689054 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f82fc077fa0 0x7f82fc07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:55.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.169+0000 7f8318c00640 1 -- 172.21.15.6:0/267689054 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f83080993d0 con 0x7f831c159670 2024-09-10T20:55:55.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.169+0000 7f8320e00640 1 --2- 172.21.15.6:0/267689054 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f82fc077fa0 0x7f82fc07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:55.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.170+0000 7f8320e00640 1 --2- 172.21.15.6:0/267689054 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f82fc077fa0 0x7f82fc07a460 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f831c158cf0 tx=0x7f8310005f90 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:55.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.173+0000 7f8318c00640 1 -- 172.21.15.6:0/267689054 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f8308061ec0 con 0x7f831c159670 2024-09-10T20:55:55.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.371+0000 7f8323800640 1 -- 172.21.15.6:0/267689054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f831c069d20 con 0x7f831c159670 2024-09-10T20:55:55.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.372+0000 7f8318c00640 1 -- 172.21.15.6:0/267689054 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16605 (secure 0 0 0) 0x7f83080617c0 con 0x7f831c159670 2024-09-10T20:55:55.376 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:55:55.376 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":22,"fsid":"9e04309e-61c3-4c78-82db-9576e465d98a","created":"2024-09-10T20:55:17.972466+0000","modified":"2024-09-10T20:55:45.353614+0000","last_up_change":"2024-09-10T20:55:32.392769+0000","last_in_change":"2024-09-10T20:55:22.232252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:55:33.196464+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:55:41.833420+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T20:55:42.749182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0918c5c8-a028-4987-bad2-406c412ec3f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6801","nonce":895515615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6803","nonce":895515615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6807","nonce":895515615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6805","nonce":895515615}]},"public_addr":"172.21.15.6:6801/895515615","cluster_addr":"172.21.15.6:6803/895515615","heartbeat_back_addr":"172.21.15.6:6807/895515615","heartbeat_front_addr":"172.21.15.6:6805/895515615","state":["exists","up"]},{"osd":1,"uuid":"415e9c78-c3d9-46d6-b277-348453f42155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6809","nonce":1129113250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6811","nonce":1129113250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6815","nonce":1129113250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6813","nonce":1129113250}]},"public_addr":"172.21.15.6:6809/1129113250","cluster_addr":"172.21.15.6:6811/1129113250","heartbeat_back_addr":"172.21.15.6:6815/1129113250","heartbeat_front_addr":"172.21.15.6:6813/1129113250","state":["exists","up"]},{"osd":2,"uuid":"763c1cf2-a43d-4c10-815d-eaf4a32afc1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6825","nonce":3847470051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6827","nonce":3847470051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6831","nonce":3847470051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6829","nonce":3847470051}]},"public_addr":"172.21.15.6:6825/3847470051","cluster_addr":"172.21.15.6:6827/3847470051","heartbeat_back_addr":"172.21.15.6:6831/3847470051","heartbeat_front_addr":"172.21.15.6:6829/3847470051","state":["exists","up"]},{"osd":3,"uuid":"877b1cc1-2434-4b32-af66-9c2485eac9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6817","nonce":3911674247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6819","nonce":3911674247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6823","nonce":3911674247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6821","nonce":3911674247}]},"public_addr":"172.21.15.6:6817/3911674247","cluster_addr":"172.21.15.6:6819/3911674247","heartbeat_back_addr":"172.21.15.6:6823/3911674247","heartbeat_front_addr":"172.21.15.6:6821/3911674247","state":["exists","up"]},{"osd":4,"uuid":"e0b27501-dfdc-4e7f-b73a-9573c869267a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6827","nonce":2568527750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6829","nonce":2568527750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6833","nonce":2568527750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6831","nonce":2568527750}]},"public_addr":"172.21.15.150:6827/2568527750","cluster_addr":"172.21.15.150:6829/2568527750","heartbeat_back_addr":"172.21.15.150:6833/2568527750","heartbeat_front_addr":"172.21.15.150:6831/2568527750","state":["exists","up"]},{"osd":5,"uuid":"67e48053-4f15-44fd-a30c-c9522f86d169","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6811","nonce":371417736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6813","nonce":371417736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6817","nonce":371417736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6815","nonce":371417736}]},"public_addr":"172.21.15.150:6811/371417736","cluster_addr":"172.21.15.150:6813/371417736","heartbeat_back_addr":"172.21.15.150:6817/371417736","heartbeat_front_addr":"172.21.15.150:6815/371417736","state":["exists","up"]},{"osd":6,"uuid":"1456df2e-ae91-45a4-bc3a-a06c753092af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6819","nonce":2329248366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6821","nonce":2329248366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6825","nonce":2329248366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6823","nonce":2329248366}]},"public_addr":"172.21.15.150:6819/2329248366","cluster_addr":"172.21.15.150:6821/2329248366","heartbeat_back_addr":"172.21.15.150:6825/2329248366","heartbeat_front_addr":"172.21.15.150:6823/2329248366","state":["exists","up"]},{"osd":7,"uuid":"a9daafcb-5ecd-43bd-ab0a-dc4b480cfc2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6803","nonce":527018351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6805","nonce":527018351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6809","nonce":527018351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6807","nonce":527018351}]},"public_addr":"172.21.15.150:6803/527018351","cluster_addr":"172.21.15.150:6805/527018351","heartbeat_back_addr":"172.21.15.150:6809/527018351","heartbeat_front_addr":"172.21.15.150:6807/527018351","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.710061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.024506+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.824320+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.431608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.637032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.054828+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.333290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.358875+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:55:55.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.374+0000 7f8323800640 1 -- 172.21.15.6:0/267689054 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f82fc077fa0 msgr2=0x7f82fc07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.374+0000 7f8323800640 1 --2- 172.21.15.6:0/267689054 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f82fc077fa0 0x7f82fc07a460 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f831c158cf0 tx=0x7f8310005f90 comp rx=0 tx=0).stop 2024-09-10T20:55:55.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.374+0000 7f8323800640 1 -- 172.21.15.6:0/267689054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f831c159670 msgr2=0x7f831c0afa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.374+0000 7f8323800640 1 --2- 172.21.15.6:0/267689054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f831c159670 0x7f831c0afa50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f830800c420 tx=0x7f830800c8e0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.374+0000 7f8323800640 1 -- 172.21.15.6:0/267689054 shutdown_connections 2024-09-10T20:55:55.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.374+0000 7f8323800640 1 --2- 172.21.15.6:0/267689054 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f82fc077fa0 0x7f82fc07a460 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.374+0000 7f8323800640 1 --2- 172.21.15.6:0/267689054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f831c159670 0x7f831c0afa50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.374+0000 7f8323800640 1 --2- 172.21.15.6:0/267689054 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f831c15c170 0x7f831c0aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.374+0000 7f8323800640 1 --2- 172.21.15.6:0/267689054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f831c070450 0x7f831c154100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.374+0000 7f8323800640 1 -- 172.21.15.6:0/267689054 >> 172.21.15.6:0/267689054 conn(0x7f831c0cfa20 msgr2=0x7f831c0cdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:55.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.374+0000 7f8323800640 1 -- 172.21.15.6:0/267689054 shutdown_connections 2024-09-10T20:55:55.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.375+0000 7f8323800640 1 -- 172.21.15.6:0/267689054 wait complete. 2024-09-10T20:55:55.394 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-10T20:55:55.394 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-10T20:55:55.395 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-10T20:55:55.395 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-10T20:55:55.396 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-10T20:55:55.396 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-10T20:55:55.397 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-10T20:55:55.397 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-10T20:55:55.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.678+0000 7f6243600640 1 -- 172.21.15.6:0/3912575677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f623c0aef00 msgr2=0x7f623c0d0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.678+0000 7f6243600640 1 --2- 172.21.15.6:0/3912575677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f623c0aef00 0x7f623c0d0540 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f623c0cdc90 tx=0x7f622802b2a0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.678+0000 7f6243600640 1 -- 172.21.15.6:0/3912575677 shutdown_connections 2024-09-10T20:55:55.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.678+0000 7f6243600640 1 --2- 172.21.15.6:0/3912575677 >> v2:172.21.15.6:3300/0 conn(0x7f623c072560 0x7f623c0ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.678+0000 7f6243600640 1 --2- 172.21.15.6:0/3912575677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f623c0aef00 0x7f623c0d0540 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.678+0000 7f6243600640 1 -- 172.21.15.6:0/3912575677 >> 172.21.15.6:0/3912575677 conn(0x7f623c0cfa20 msgr2=0x7f623c0cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:55.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.679+0000 7f6243600640 1 -- 172.21.15.6:0/3912575677 shutdown_connections 2024-09-10T20:55:55.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.679+0000 7f6243600640 1 -- 172.21.15.6:0/3912575677 wait complete. 2024-09-10T20:55:55.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.679+0000 7fd8cbe00640 1 -- 172.21.15.6:0/4082533233 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8c40e2cf0 msgr2=0x7fd8c40535e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.679+0000 7fd8cbe00640 1 --2- 172.21.15.6:0/4082533233 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8c40e2cf0 0x7fd8c40535e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4059880 tx=0x7fd8b802a560 comp rx=0 tx=0).stop 2024-09-10T20:55:55.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.679+0000 7fd8cbe00640 1 -- 172.21.15.6:0/4082533233 shutdown_connections 2024-09-10T20:55:55.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.679+0000 7fd8cbe00640 1 --2- 172.21.15.6:0/4082533233 >> v2:172.21.15.6:3300/0 conn(0x7fd8c40565a0 0x7fd8c4056a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.679+0000 7fd8cbe00640 1 --2- 172.21.15.6:0/4082533233 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8c40e2cf0 0x7fd8c40535e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.679+0000 7fd8cbe00640 1 --2- 172.21.15.6:0/4082533233 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8c40e2910 0x7fd8c40530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.679+0000 7fd8cbe00640 1 -- 172.21.15.6:0/4082533233 >> 172.21.15.6:0/4082533233 conn(0x7fd8c4058cc0 msgr2=0x7fd8c40590d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:55.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.679+0000 7fd8cbe00640 1 -- 172.21.15.6:0/4082533233 shutdown_connections 2024-09-10T20:55:55.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.679+0000 7fd8cbe00640 1 -- 172.21.15.6:0/4082533233 wait complete. 2024-09-10T20:55:55.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.680+0000 7fb971600640 1 -- 172.21.15.6:0/772945589 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb96c162400 msgr2=0x7fb96c0d4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.680+0000 7fb971600640 1 --2- 172.21.15.6:0/772945589 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb96c162400 0x7fb96c0d4850 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb95c009830 tx=0x7fb95c02a480 comp rx=0 tx=0).stop 2024-09-10T20:55:55.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.681+0000 7fb971600640 1 -- 172.21.15.6:0/772945589 shutdown_connections 2024-09-10T20:55:55.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.681+0000 7fb971600640 1 --2- 172.21.15.6:0/772945589 >> v2:172.21.15.150:3300/0 conn(0x7fb96c0b6c40 0x7fb96c0b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.681+0000 7fb971600640 1 --2- 172.21.15.6:0/772945589 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb96c162400 0x7fb96c0d4850 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.681+0000 7fb971600640 1 -- 172.21.15.6:0/772945589 >> 172.21.15.6:0/772945589 conn(0x7fb96c09d0c0 msgr2=0x7fb96c0d3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:55.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.681+0000 7fb971600640 1 -- 172.21.15.6:0/772945589 shutdown_connections 2024-09-10T20:55:55.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.681+0000 7f6243600640 1 Processor -- start 2024-09-10T20:55:55.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.681+0000 7fb971600640 1 -- 172.21.15.6:0/772945589 wait complete. 2024-09-10T20:55:55.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.683+0000 7fd8cbe00640 1 Processor -- start 2024-09-10T20:55:55.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.683+0000 7fd8cbe00640 1 -- start start 2024-09-10T20:55:55.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.684+0000 7fb971600640 1 Processor -- start 2024-09-10T20:55:55.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.682+0000 7f6243600640 1 -- start start 2024-09-10T20:55:55.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.684+0000 7f6243600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f623c072560 0x7f623c0c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:55.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.684+0000 7f6243600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f623c0aef00 0x7f623c2021c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:55.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.684+0000 7f6243600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f623c15dab0 0x7f623c0c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:55.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.684+0000 7fb971600640 1 -- start start 2024-09-10T20:55:55.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.684+0000 7f6243600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f623c0ced80 con 0x7f623c0aef00 2024-09-10T20:55:55.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.684+0000 7f6243600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f623c0cef00 con 0x7f623c072560 2024-09-10T20:55:55.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.684+0000 7f6243600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f623c0cf080 con 0x7f623c15dab0 2024-09-10T20:55:55.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.685+0000 7f623be00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f623c0aef00 0x7f623c2021c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:55.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.685+0000 7f623be00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f623c0aef00 0x7f623c2021c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51106/0 (socket says 172.21.15.6:51106) 2024-09-10T20:55:55.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.685+0000 7f6240c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f623c072560 0x7f623c0c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:55.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.685+0000 7f623be00640 1 -- 172.21.15.6:0/4219314442 learned_addr learned my addr 172.21.15.6:0/4219314442 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:55.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.685+0000 7f6241600640 1 --2- 172.21.15.6:0/4219314442 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f623c15dab0 0x7f623c0c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:55.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.685+0000 7f623be00640 1 -- 172.21.15.6:0/4219314442 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f623c15dab0 msgr2=0x7f623c0c5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.685+0000 7f623be00640 1 --2- 172.21.15.6:0/4219314442 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f623c15dab0 0x7f623c0c5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.685+0000 7f623be00640 1 -- 172.21.15.6:0/4219314442 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f623c072560 msgr2=0x7f623c0c8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.685+0000 7f623be00640 1 --2- 172.21.15.6:0/4219314442 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f623c072560 0x7f623c0c8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.685+0000 7f623be00640 1 -- 172.21.15.6:0/4219314442 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f623c0c7ea0 con 0x7f623c0aef00 2024-09-10T20:55:55.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.686+0000 7fb971600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb96c0b6c40 0x7fb96c0c9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:55.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.686+0000 7fd8cbe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8c40565a0 0x7fd8c40e3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:55.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.686+0000 7fb971600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb96c0d0330 0x7fb96c150d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:55.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.686+0000 7fd8caa00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8c40565a0 0x7fd8c40e3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:55.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.687+0000 7fb96aa00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb96c0b6c40 0x7fb96c0c9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:55.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.687+0000 7fb96aa00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb96c0b6c40 0x7fb96c0c9bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.6:36816/0 (socket says 172.21.15.6:36816) 2024-09-10T20:55:55.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.686+0000 7f623be00640 1 --2- 172.21.15.6:0/4219314442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f623c0aef00 0x7f623c2021c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f622802b890 tx=0x7f62280038f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:55.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.687+0000 7f6238c00640 1 -- 172.21.15.6:0/4219314442 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6228003d30 con 0x7f623c0aef00 2024-09-10T20:55:55.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.687+0000 7fb96aa00640 1 -- 172.21.15.6:0/509168854 learned_addr learned my addr 172.21.15.6:0/509168854 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:55.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.687+0000 7fb971600640 1 --2- 172.21.15.6:0/509168854 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb96c162400 0x7fb96c157650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:55.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.687+0000 7fb971600640 1 -- 172.21.15.6:0/509168854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb96c0d1000 con 0x7fb96c0d0330 2024-09-10T20:55:55.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.687+0000 7fb96b400640 1 --2- 172.21.15.6:0/509168854 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb96c162400 0x7fb96c157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:55.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.687+0000 7fb971600640 1 -- 172.21.15.6:0/509168854 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb96c0d0e80 con 0x7fb96c0b6c40 2024-09-10T20:55:55.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.687+0000 7fb971600640 1 -- 172.21.15.6:0/509168854 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb96c0b7630 con 0x7fb96c162400 2024-09-10T20:55:55.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.686+0000 7fd8caa00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8c40565a0 0x7fd8c40e3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51122/0 (socket says 172.21.15.6:51122) 2024-09-10T20:55:55.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.687+0000 7fd8caa00640 1 -- 172.21.15.6:0/1200047848 learned_addr learned my addr 172.21.15.6:0/1200047848 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:55.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.687+0000 7f6238c00640 1 -- 172.21.15.6:0/4219314442 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f622800a0d0 con 0x7f623c0aef00 2024-09-10T20:55:55.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.687+0000 7f6238c00640 1 -- 172.21.15.6:0/4219314442 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622800a520 con 0x7f623c0aef00 2024-09-10T20:55:55.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.687+0000 7f5757000640 1 -- 172.21.15.6:0/1872909221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5748005ab0 msgr2=0x7f5748035fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.687+0000 7f5757000640 1 --2- 172.21.15.6:0/1872909221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5748005ab0 0x7f5748035fe0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f575006c290 tx=0x7f57500a79d0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.687+0000 7f5757000640 1 -- 172.21.15.6:0/1872909221 shutdown_connections 2024-09-10T20:55:55.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.687+0000 7f5757000640 1 --2- 172.21.15.6:0/1872909221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5748005ab0 0x7f5748035fe0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.687+0000 7f5757000640 1 -- 172.21.15.6:0/1872909221 >> 172.21.15.6:0/1872909221 conn(0x7f5748054560 msgr2=0x7f5748054940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:55.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.687+0000 7f5757000640 1 -- 172.21.15.6:0/1872909221 shutdown_connections 2024-09-10T20:55:55.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.687+0000 7fd8cbe00640 1 --2- 172.21.15.6:0/1200047848 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8c40e2910 0x7fd8c40d4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:55.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.688+0000 7fd8cbe00640 1 --2- 172.21.15.6:0/1200047848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8c40e2cf0 0x7fd8c40d4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:55.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.687+0000 7f5757000640 1 -- 172.21.15.6:0/1872909221 wait complete. 2024-09-10T20:55:55.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.688+0000 7fd8cbe00640 1 -- 172.21.15.6:0/1200047848 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c40060e0 con 0x7fd8c40565a0 2024-09-10T20:55:55.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.688+0000 7fb96b400640 1 -- 172.21.15.6:0/509168854 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb96c0b6c40 msgr2=0x7fb96c0c9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.688+0000 7fb96b400640 1 --2- 172.21.15.6:0/509168854 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb96c0b6c40 0x7fb96c0c9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.689+0000 7fb96b400640 1 -- 172.21.15.6:0/509168854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb96c0d0330 msgr2=0x7fb96c150d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.689+0000 7fb96b400640 1 --2- 172.21.15.6:0/509168854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb96c0d0330 0x7fb96c150d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.688+0000 7fd8cbe00640 1 -- 172.21.15.6:0/1200047848 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c4005f60 con 0x7fd8c40e2cf0 2024-09-10T20:55:55.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.689+0000 7fb96b400640 1 -- 172.21.15.6:0/509168854 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb96c15f5b0 con 0x7fb96c162400 2024-09-10T20:55:55.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.689+0000 7fd8cb400640 1 --2- 172.21.15.6:0/1200047848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8c40e2cf0 0x7fd8c40d4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:55.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.689+0000 7fb96aa00640 1 --2- 172.21.15.6:0/509168854 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb96c0b6c40 0x7fb96c0c9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:55:55.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.689+0000 7fd8ca000640 1 --2- 172.21.15.6:0/1200047848 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8c40e2910 0x7fd8c40d4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:55.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.689+0000 7fb96b400640 1 --2- 172.21.15.6:0/509168854 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb96c162400 0x7fb96c157650 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb96400ea80 tx=0x7fb96400ef40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:55.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.689+0000 7fd8cbe00640 1 -- 172.21.15.6:0/1200047848 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd8c4006260 con 0x7fd8c40e2910 2024-09-10T20:55:55.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.690+0000 7fb962a00640 1 -- 172.21.15.6:0/509168854 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb96400cea0 con 0x7fb96c162400 2024-09-10T20:55:55.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.690+0000 7fb962a00640 1 -- 172.21.15.6:0/509168854 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb964004c10 con 0x7fb96c162400 2024-09-10T20:55:55.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.690+0000 7fb971600640 1 -- 172.21.15.6:0/509168854 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb96c0ca210 con 0x7fb96c162400 2024-09-10T20:55:55.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.690+0000 7fb971600640 1 -- 172.21.15.6:0/509168854 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb96c15fb50 con 0x7fb96c162400 2024-09-10T20:55:55.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.690+0000 7fd8cb400640 1 -- 172.21.15.6:0/1200047848 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8c40e2910 msgr2=0x7fd8c40d4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.687+0000 7f6243600640 1 -- 172.21.15.6:0/4219314442 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f623c0c8180 con 0x7f623c0aef00 2024-09-10T20:55:55.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.687+0000 7f6243600640 1 -- 172.21.15.6:0/4219314442 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f623c0c8740 con 0x7f623c0aef00 2024-09-10T20:55:55.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.689+0000 7f6243600640 1 -- 172.21.15.6:0/4219314442 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f623c0c6590 con 0x7f623c0aef00 2024-09-10T20:55:55.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.690+0000 7fd8cb400640 1 --2- 172.21.15.6:0/1200047848 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8c40e2910 0x7fd8c40d4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.690+0000 7fd8cb400640 1 -- 172.21.15.6:0/1200047848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8c40565a0 msgr2=0x7fd8c40e3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.690+0000 7fd8cb400640 1 --2- 172.21.15.6:0/1200047848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8c40565a0 0x7fd8c40e3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.690+0000 7fd8cb400640 1 -- 172.21.15.6:0/1200047848 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8c417c8c0 con 0x7fd8c40e2cf0 2024-09-10T20:55:55.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.690+0000 7fd8caa00640 1 --2- 172.21.15.6:0/1200047848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8c40565a0 0x7fd8c40e3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:55:55.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.691+0000 7fb971600640 1 -- 172.21.15.6:0/509168854 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb96c069d80 con 0x7fb96c162400 2024-09-10T20:55:55.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.691+0000 7fb962a00640 1 -- 172.21.15.6:0/509168854 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb964005020 con 0x7fb96c162400 2024-09-10T20:55:55.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.692+0000 7f5757000640 1 Processor -- start 2024-09-10T20:55:55.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.692+0000 7fd8cb400640 1 --2- 172.21.15.6:0/1200047848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8c40e2cf0 0x7fd8c40d4980 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc06ae70 tx=0x7fd8cc069d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:55.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.692+0000 7f5757000640 1 -- start start 2024-09-10T20:55:55.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.692+0000 7fd8c2a00640 1 -- 172.21.15.6:0/1200047848 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc0949a0 con 0x7fd8c40e2cf0 2024-09-10T20:55:55.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.693+0000 7fd8c2a00640 1 -- 172.21.15.6:0/1200047848 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd8cc094b40 con 0x7fd8c40e2cf0 2024-09-10T20:55:55.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.693+0000 7fd8c2a00640 1 -- 172.21.15.6:0/1200047848 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc06a470 con 0x7fd8c40e2cf0 2024-09-10T20:55:55.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.693+0000 7f6238c00640 1 -- 172.21.15.6:0/4219314442 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f622803c070 con 0x7f623c0aef00 2024-09-10T20:55:55.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.693+0000 7fd8cbe00640 1 -- 172.21.15.6:0/1200047848 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8c417cb30 con 0x7fd8c40e2cf0 2024-09-10T20:55:55.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.693+0000 7fd8cbe00640 1 -- 172.21.15.6:0/1200047848 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8c40e4b40 con 0x7fd8c40e2cf0 2024-09-10T20:55:55.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.694+0000 7fb962a00640 1 -- 172.21.15.6:0/509168854 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb964020030 con 0x7fb96c162400 2024-09-10T20:55:55.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.694+0000 7f6238c00640 1 --2- 172.21.15.6:0/4219314442 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f621c077f70 0x7f621c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:55.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.695+0000 7f5757000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5748005ab0 0x7f5748176870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:55.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.695+0000 7f5757000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f574801c890 0x7f5748048000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:55.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.695+0000 7f5757000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5748036520 0x7f574804a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:55.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.695+0000 7f5757000640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f574800a160 con 0x7f574801c890 2024-09-10T20:55:55.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.695+0000 7f5757000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f574801d380 con 0x7f5748036520 2024-09-10T20:55:55.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.695+0000 7f5757000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f574800a2e0 con 0x7f5748005ab0 2024-09-10T20:55:55.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.695+0000 7f6238c00640 1 -- 172.21.15.6:0/4219314442 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f62280b9e20 con 0x7f623c0aef00 2024-09-10T20:55:55.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.695+0000 7f6240c00640 1 --2- 172.21.15.6:0/4219314442 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f621c077f70 0x7f621c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:55.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.695+0000 7f6238c00640 1 --2- 172.21.15.6:0/4219314442 >> [v2:172.21.15.6:6808/1129113250,v1:172.21.15.6:6809/1129113250] conn(0x7f621c080190 0x7f621c0825b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:55.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.695+0000 7f6238c00640 1 -- 172.21.15.6:0/4219314442 --> [v2:172.21.15.6:6808/1129113250,v1:172.21.15.6:6809/1129113250] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f621c082c60 con 0x7f621c080190 2024-09-10T20:55:55.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.695+0000 7f5755c00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5748005ab0 0x7f5748176870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:55.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.695+0000 7f5755c00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5748005ab0 0x7f5748176870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.6:44312/0 (socket says 172.21.15.6:44312) 2024-09-10T20:55:55.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.695+0000 7f5755c00640 1 -- 172.21.15.6:0/89493936 learned_addr learned my addr 172.21.15.6:0/89493936 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:55.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.696+0000 7f5755200640 1 --2- 172.21.15.6:0/89493936 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f574801c890 0x7f5748048000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:55.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.696+0000 7f5756600640 1 --2- 172.21.15.6:0/89493936 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5748036520 0x7f574804a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:55.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.696+0000 7f6238c00640 1 -- 172.21.15.6:0/4219314442 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f62280ba210 con 0x7f623c0aef00 2024-09-10T20:55:55.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.695+0000 7fd8cbe00640 1 -- 172.21.15.6:0/1200047848 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd8c4006780 con 0x7fd8c40e2cf0 2024-09-10T20:55:55.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.696+0000 7f6241600640 1 --2- 172.21.15.6:0/4219314442 >> [v2:172.21.15.6:6808/1129113250,v1:172.21.15.6:6809/1129113250] conn(0x7f621c080190 0x7f621c0825b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:55.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.696+0000 7fb962a00640 1 --2- 172.21.15.6:0/509168854 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb94c077f70 0x7fb94c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:55.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.697+0000 7fb962a00640 1 -- 172.21.15.6:0/509168854 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb96409af10 con 0x7fb96c162400 2024-09-10T20:55:55.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.697+0000 7fb962a00640 1 --2- 172.21.15.6:0/509168854 >> [v2:172.21.15.6:6800/895515615,v1:172.21.15.6:6801/895515615] conn(0x7fb94c080110 0x7fb94c082530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:55.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.697+0000 7fb962a00640 1 -- 172.21.15.6:0/509168854 --> [v2:172.21.15.6:6800/895515615,v1:172.21.15.6:6801/895515615] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb964008e50 con 0x7fb94c080110 2024-09-10T20:55:55.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.697+0000 7fb962a00640 1 -- 172.21.15.6:0/509168854 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fb96409b3a0 con 0x7fb96c162400 2024-09-10T20:55:55.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.697+0000 7fb96aa00640 1 --2- 172.21.15.6:0/509168854 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb94c077f70 0x7fb94c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:55.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.697+0000 7fb96a000640 1 --2- 172.21.15.6:0/509168854 >> [v2:172.21.15.6:6800/895515615,v1:172.21.15.6:6801/895515615] conn(0x7fb94c080110 0x7fb94c082530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:55.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.698+0000 7f3450800640 1 -- 172.21.15.6:0/3211447350 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f344815c170 msgr2=0x7f34480743b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.698+0000 7f3450800640 1 --2- 172.21.15.6:0/3211447350 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f344815c170 0x7f34480743b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f34480cc450 tx=0x7f343402a4a0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.697+0000 7f6241600640 1 --2- 172.21.15.6:0/4219314442 >> [v2:172.21.15.6:6808/1129113250,v1:172.21.15.6:6809/1129113250] conn(0x7f621c080190 0x7f621c0825b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:55.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.698+0000 7f6240c00640 1 --2- 172.21.15.6:0/4219314442 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f621c077f70 0x7f621c07a430 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f62300046b0 tx=0x7f6230004620 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:55.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.698+0000 7f2363200640 1 -- 172.21.15.6:0/2601977982 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f235c0cf7a0 msgr2=0x7f235c15da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.698+0000 7f2363200640 1 --2- 172.21.15.6:0/2601977982 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f235c0cf7a0 0x7f235c15da20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f235c069800 tx=0x7f235802aa10 comp rx=0 tx=0).stop 2024-09-10T20:55:55.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.698+0000 7f2363200640 1 -- 172.21.15.6:0/2601977982 shutdown_connections 2024-09-10T20:55:55.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.698+0000 7f2363200640 1 --2- 172.21.15.6:0/2601977982 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f235c0cf7a0 0x7f235c15da20 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.698+0000 7f2363200640 1 --2- 172.21.15.6:0/2601977982 >> v2:172.21.15.6:3300/0 conn(0x7f235c1619c0 0x7f235c0d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.698+0000 7f2363200640 1 -- 172.21.15.6:0/2601977982 >> 172.21.15.6:0/2601977982 conn(0x7f235c09d100 msgr2=0x7f235c0d3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:55.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.698+0000 7f3450800640 1 -- 172.21.15.6:0/3211447350 shutdown_connections 2024-09-10T20:55:55.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.698+0000 7f3450800640 1 --2- 172.21.15.6:0/3211447350 >> v2:172.21.15.6:3300/0 conn(0x7f3448070450 0x7f34480cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.698+0000 7f3450800640 1 --2- 172.21.15.6:0/3211447350 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f344815c170 0x7f34480743b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.698+0000 7f3450800640 1 -- 172.21.15.6:0/3211447350 >> 172.21.15.6:0/3211447350 conn(0x7f34480cfa20 msgr2=0x7f34480cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:55.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.698+0000 7fb96aa00640 1 --2- 172.21.15.6:0/509168854 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb94c077f70 0x7fb94c07a430 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb95c0095f0 tx=0x7fb95c004730 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:55.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.699+0000 7fb96a000640 1 --2- 172.21.15.6:0/509168854 >> [v2:172.21.15.6:6800/895515615,v1:172.21.15.6:6801/895515615] conn(0x7fb94c080110 0x7fb94c082530 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:55.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.699+0000 7f5755200640 1 -- 172.21.15.6:0/89493936 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5748005ab0 msgr2=0x7f5748176870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.699+0000 7f5755200640 1 --2- 172.21.15.6:0/89493936 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5748005ab0 0x7f5748176870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.699+0000 7f5755200640 1 -- 172.21.15.6:0/89493936 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5748036520 msgr2=0x7f574804a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.699+0000 7f2363200640 1 -- 172.21.15.6:0/2601977982 shutdown_connections 2024-09-10T20:55:55.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.699+0000 7f3450800640 1 -- 172.21.15.6:0/3211447350 shutdown_connections 2024-09-10T20:55:55.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.699+0000 7f5755200640 1 --2- 172.21.15.6:0/89493936 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5748036520 0x7f574804a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.699+0000 7f5755200640 1 -- 172.21.15.6:0/89493936 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57480306f0 con 0x7f574801c890 2024-09-10T20:55:55.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.699+0000 7f3450800640 1 -- 172.21.15.6:0/3211447350 wait complete. 2024-09-10T20:55:55.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.700+0000 7f2363200640 1 -- 172.21.15.6:0/2601977982 wait complete. 2024-09-10T20:55:55.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.700+0000 7f5755200640 1 --2- 172.21.15.6:0/89493936 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f574801c890 0x7f5748048000 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f575006be30 tx=0x7f57500ae6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:55.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.700+0000 7f5756600640 1 --2- 172.21.15.6:0/89493936 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5748036520 0x7f574804a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:55:55.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.700+0000 7f6238c00640 1 -- 172.21.15.6:0/4219314442 <== osd.1 v2:172.21.15.6:6808/1129113250 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f621c082c60 con 0x7f621c080190 2024-09-10T20:55:55.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.700+0000 7f574d600640 1 -- 172.21.15.6:0/89493936 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57500bc020 con 0x7f574801c890 2024-09-10T20:55:55.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.699+0000 7fd8c2a00640 1 -- 172.21.15.6:0/1200047848 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd8cc09b070 con 0x7fd8c40e2cf0 2024-09-10T20:55:55.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.700+0000 7f5757000640 1 -- 172.21.15.6:0/89493936 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5748049cb0 con 0x7f574801c890 2024-09-10T20:55:55.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.701+0000 7f5757000640 1 -- 172.21.15.6:0/89493936 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f574804a270 con 0x7f574801c890 2024-09-10T20:55:55.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.701+0000 7fb962a00640 1 -- 172.21.15.6:0/509168854 <== osd.0 v2:172.21.15.6:6800/895515615 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb964008e50 con 0x7fb94c080110 2024-09-10T20:55:55.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.702+0000 7fd8c2a00640 1 --2- 172.21.15.6:0/1200047848 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd8ac077f70 0x7fd8ac07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:55.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.702+0000 7fd8c2a00640 1 -- 172.21.15.6:0/1200047848 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd8cc11dd60 con 0x7fd8c40e2cf0 2024-09-10T20:55:55.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.702+0000 7fd8c2a00640 1 --2- 172.21.15.6:0/1200047848 >> [v2:172.21.15.6:6824/3847470051,v1:172.21.15.6:6825/3847470051] conn(0x7fd8ac080190 0x7fd8ac0825b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:55.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.702+0000 7f574d600640 1 -- 172.21.15.6:0/89493936 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f57500aecc0 con 0x7f574801c890 2024-09-10T20:55:55.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.702+0000 7fd8c2a00640 1 -- 172.21.15.6:0/1200047848 --> [v2:172.21.15.6:6824/3847470051,v1:172.21.15.6:6825/3847470051] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd8ac082c60 con 0x7fd8ac080190 2024-09-10T20:55:55.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.702+0000 7fd8c2a00640 1 -- 172.21.15.6:0/1200047848 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fd8cc11e150 con 0x7fd8c40e2cf0 2024-09-10T20:55:55.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.702+0000 7f574d600640 1 -- 172.21.15.6:0/89493936 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57500bc020 con 0x7f574801c890 2024-09-10T20:55:55.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.702+0000 7fd8caa00640 1 --2- 172.21.15.6:0/1200047848 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd8ac077f70 0x7fd8ac07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:55.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.703+0000 7f0ad3200640 1 -- 172.21.15.6:0/2852514481 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0acc0aef00 msgr2=0x7f0acc0d0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.703+0000 7f0ad3200640 1 --2- 172.21.15.6:0/2852514481 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0acc0aef00 0x7f0acc0d0540 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0abc005fd0 tx=0x7f0abc02b660 comp rx=0 tx=0).stop 2024-09-10T20:55:55.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.703+0000 7f3450800640 1 Processor -- start 2024-09-10T20:55:55.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.703+0000 7f0ad3200640 1 -- 172.21.15.6:0/2852514481 shutdown_connections 2024-09-10T20:55:55.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.703+0000 7f3450800640 1 -- start start 2024-09-10T20:55:55.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.703+0000 7f0ad3200640 1 --2- 172.21.15.6:0/2852514481 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0acc0aef00 0x7f0acc0d0540 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.703+0000 7f0ad3200640 1 -- 172.21.15.6:0/2852514481 >> 172.21.15.6:0/2852514481 conn(0x7f0acc0cfa20 msgr2=0x7f0acc0cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:55.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.704+0000 7f2363200640 1 Processor -- start 2024-09-10T20:55:55.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.704+0000 7fd8caa00640 1 --2- 172.21.15.6:0/1200047848 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd8ac077f70 0x7fd8ac07a430 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd8c404d790 tx=0x7fd8bc005f90 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:55.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.705+0000 7fd8ca000640 1 --2- 172.21.15.6:0/1200047848 >> [v2:172.21.15.6:6824/3847470051,v1:172.21.15.6:6825/3847470051] conn(0x7fd8ac080190 0x7fd8ac0825b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:55.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.704+0000 7f2363200640 1 -- start start 2024-09-10T20:55:55.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.705+0000 7f2363200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f235c0cf7a0 0x7f235c15bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:55.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.705+0000 7f2363200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f235c1619c0 0x7f235c156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:55.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.706+0000 7f2363200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f235c161da0 0x7f235c1f8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:55.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.706+0000 7f2363200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f235c15e2f0 con 0x7f235c1619c0 2024-09-10T20:55:55.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.706+0000 7f2363200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f235c15e170 con 0x7f235c0cf7a0 2024-09-10T20:55:55.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.706+0000 7f2363200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f235c0cfd70 con 0x7f235c161da0 2024-09-10T20:55:55.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.706+0000 7f3450800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3448070450 0x7f3448149b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:55.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.706+0000 7f3450800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3448159670 0x7f34481517c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:55.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.706+0000 7f3450800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f344815c170 0x7f3448151d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:55.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.706+0000 7f3450800640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f34480b4a90 con 0x7f344815c170 2024-09-10T20:55:55.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.706+0000 7f3450800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f34480b4910 con 0x7f3448159670 2024-09-10T20:55:55.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.706+0000 7f3450800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f34480b4c10 con 0x7f3448070450 2024-09-10T20:55:55.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.705+0000 7f5757000640 1 -- 172.21.15.6:0/89493936 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f572c001030 con 0x7f574801c890 2024-09-10T20:55:55.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.705+0000 7f0ad3200640 1 -- 172.21.15.6:0/2852514481 shutdown_connections 2024-09-10T20:55:55.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.705+0000 7f0ad3200640 1 -- 172.21.15.6:0/2852514481 wait complete. 2024-09-10T20:55:55.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.706+0000 7f2362800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f235c161da0 0x7f235c1f8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:55.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.706+0000 7f2362800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f235c161da0 0x7f235c1f8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.6:44320/0 (socket says 172.21.15.6:44320) 2024-09-10T20:55:55.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.706+0000 7f2362800640 1 -- 172.21.15.6:0/261636144 learned_addr learned my addr 172.21.15.6:0/261636144 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:55.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.706+0000 7f2361400640 1 --2- 172.21.15.6:0/261636144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f235c1619c0 0x7f235c156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:55.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.706+0000 7f2361e00640 1 --2- 172.21.15.6:0/261636144 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f235c0cf7a0 0x7f235c15bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:55.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.706+0000 7fd8ca000640 1 --2- 172.21.15.6:0/1200047848 >> [v2:172.21.15.6:6824/3847470051,v1:172.21.15.6:6825/3847470051] conn(0x7fd8ac080190 0x7fd8ac0825b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:55.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.707+0000 7f2362800640 1 -- 172.21.15.6:0/261636144 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f235c0cf7a0 msgr2=0x7f235c15bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.707+0000 7f2362800640 1 --2- 172.21.15.6:0/261636144 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f235c0cf7a0 0x7f235c15bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.707+0000 7f2362800640 1 -- 172.21.15.6:0/261636144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f235c1619c0 msgr2=0x7f235c156010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.707+0000 7f344d400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3448159670 0x7f34481517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:55.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.707+0000 7f344d400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3448159670 0x7f34481517c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.6:36890/0 (socket says 172.21.15.6:36890) 2024-09-10T20:55:55.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.707+0000 7f344d400640 1 -- 172.21.15.6:0/4066672811 learned_addr learned my addr 172.21.15.6:0/4066672811 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:55.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.707+0000 7f344e800640 1 --2- 172.21.15.6:0/4066672811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f344815c170 0x7f3448151d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:55.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.707+0000 7f344de00640 1 --2- 172.21.15.6:0/4066672811 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3448070450 0x7f3448149b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:55.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.707+0000 7f0ad3200640 1 Processor -- start 2024-09-10T20:55:55.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.707+0000 7f2362800640 1 --2- 172.21.15.6:0/261636144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f235c1619c0 0x7f235c156010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.707+0000 7f0ad3200640 1 -- start start 2024-09-10T20:55:55.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.707+0000 7f2362800640 1 -- 172.21.15.6:0/261636144 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f235c1f94c0 con 0x7f235c161da0 2024-09-10T20:55:55.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.707+0000 7f574d600640 1 -- 172.21.15.6:0/89493936 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f57500b8470 con 0x7f574801c890 2024-09-10T20:55:55.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.707+0000 7f2361400640 1 --2- 172.21.15.6:0/261636144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f235c1619c0 0x7f235c156010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:55:55.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.707+0000 7f2362800640 1 --2- 172.21.15.6:0/261636144 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f235c161da0 0x7f235c1f8c40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2358009d60 tx=0x7f2358003f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:55.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.708+0000 7f2356000640 1 -- 172.21.15.6:0/261636144 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2358047070 con 0x7f235c161da0 2024-09-10T20:55:55.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.708+0000 7f2356000640 1 -- 172.21.15.6:0/261636144 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2358004250 con 0x7f235c161da0 2024-09-10T20:55:55.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.708+0000 7f2356000640 1 -- 172.21.15.6:0/261636144 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2358033050 con 0x7f235c161da0 2024-09-10T20:55:55.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.709+0000 7f2363200640 1 -- 172.21.15.6:0/261636144 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f235c1f97a0 con 0x7f235c161da0 2024-09-10T20:55:55.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.709+0000 7f0ad3200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0acc072560 0x7f0acc0c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:55.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.709+0000 7f0ad3200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0acc0aef00 0x7f0acc0c9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:55.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.709+0000 7f0ad3200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0acc15dab0 0x7f0acc0c6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:55.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.709+0000 7f344e800640 1 -- 172.21.15.6:0/4066672811 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3448070450 msgr2=0x7f3448149b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.709+0000 7f344e800640 1 --2- 172.21.15.6:0/4066672811 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3448070450 0x7f3448149b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.709+0000 7f344e800640 1 -- 172.21.15.6:0/4066672811 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3448159670 msgr2=0x7f34481517c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.709+0000 7f344e800640 1 --2- 172.21.15.6:0/4066672811 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3448159670 0x7f34481517c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.709+0000 7f344e800640 1 -- 172.21.15.6:0/4066672811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f344815bd10 con 0x7f344815c170 2024-09-10T20:55:55.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.709+0000 7f0acbe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0acc072560 0x7f0acc0c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:55.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.709+0000 7f0acbe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0acc072560 0x7f0acc0c7d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51188/0 (socket says 172.21.15.6:51188) 2024-09-10T20:55:55.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.709+0000 7f344e800640 1 --2- 172.21.15.6:0/4066672811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f344815c170 0x7f3448151d00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3444009fd0 tx=0x7f344400c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:55.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.709+0000 7f0acbe00640 1 -- 172.21.15.6:0/365811914 learned_addr learned my addr 172.21.15.6:0/365811914 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:55.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.709+0000 7f0ad3200640 1 -- 172.21.15.6:0/365811914 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0acc0cf0d0 con 0x7f0acc072560 2024-09-10T20:55:55.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.709+0000 7f0ad3200640 1 -- 172.21.15.6:0/365811914 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0acc0cef50 con 0x7f0acc15dab0 2024-09-10T20:55:55.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.709+0000 7f0ad3200640 1 -- 172.21.15.6:0/365811914 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f0acc0cf250 con 0x7f0acc0aef00 2024-09-10T20:55:55.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.709+0000 7f2363200640 1 -- 172.21.15.6:0/261636144 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f235c1f9180 con 0x7f235c161da0 2024-09-10T20:55:55.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.710+0000 7f574d600640 1 --2- 172.21.15.6:0/89493936 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5730078170 0x7f573007a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:55.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.710+0000 7f0ad1200640 1 --2- 172.21.15.6:0/365811914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0acc15dab0 0x7f0acc0c6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:55.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.710+0000 7f3442000640 1 -- 172.21.15.6:0/4066672811 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3444003970 con 0x7f344815c170 2024-09-10T20:55:55.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.710+0000 7f3442000640 1 -- 172.21.15.6:0/4066672811 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3444003b10 con 0x7f344815c170 2024-09-10T20:55:55.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.710+0000 7f3442000640 1 -- 172.21.15.6:0/4066672811 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3444004020 con 0x7f344815c170 2024-09-10T20:55:55.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.710+0000 7f3450800640 1 -- 172.21.15.6:0/4066672811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f344814ea60 con 0x7f344815c170 2024-09-10T20:55:55.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.710+0000 7f0acb400640 1 --2- 172.21.15.6:0/365811914 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0acc0aef00 0x7f0acc0c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:55.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.710+0000 7f0ad1200640 1 -- 172.21.15.6:0/365811914 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0acc0aef00 msgr2=0x7f0acc0c9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.710+0000 7f0ad1200640 1 --2- 172.21.15.6:0/365811914 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0acc0aef00 0x7f0acc0c9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.711+0000 7fd8c2a00640 1 -- 172.21.15.6:0/1200047848 <== osd.2 v2:172.21.15.6:6824/3847470051 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd8ac082c60 con 0x7fd8ac080190 2024-09-10T20:55:55.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.710+0000 7f0ad1200640 1 -- 172.21.15.6:0/365811914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0acc072560 msgr2=0x7f0acc0c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.710+0000 7f574d600640 1 -- 172.21.15.6:0/89493936 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f57501353a0 con 0x7f574801c890 2024-09-10T20:55:55.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.711+0000 7f3450800640 1 -- 172.21.15.6:0/4066672811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f344815b750 con 0x7f344815c170 2024-09-10T20:55:55.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.710+0000 7fdaab600640 1 -- 172.21.15.6:0/503898351 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda9c005ab0 msgr2=0x7fda9c01cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.710+0000 7fdaab600640 1 --2- 172.21.15.6:0/503898351 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda9c005ab0 0x7fda9c01cdd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdaa406b210 tx=0x7fdaa40a9d50 comp rx=0 tx=0).stop 2024-09-10T20:55:55.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.712+0000 7f574d600640 1 --2- 172.21.15.6:0/89493936 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x7f57300803f0 0x7f5730082810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:55.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.712+0000 7f5755c00640 1 --2- 172.21.15.6:0/89493936 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5730078170 0x7f573007a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:55.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.712+0000 7f574d600640 1 -- 172.21.15.6:0/89493936 --> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f57500ae2e0 con 0x7f57300803f0 2024-09-10T20:55:55.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.712+0000 7f574d600640 1 -- 172.21.15.6:0/89493936 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f575013c050 con 0x7f574801c890 2024-09-10T20:55:55.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.712+0000 7f0ad1200640 1 --2- 172.21.15.6:0/365811914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0acc072560 0x7f0acc0c7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.712+0000 7f0ad1200640 1 -- 172.21.15.6:0/365811914 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0acc0c8360 con 0x7f0acc15dab0 2024-09-10T20:55:55.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.713+0000 7f0acbe00640 1 --2- 172.21.15.6:0/365811914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0acc072560 0x7f0acc0c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:55:55.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.713+0000 7fdaab600640 1 -- 172.21.15.6:0/503898351 shutdown_connections 2024-09-10T20:55:55.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.713+0000 7fdaab600640 1 --2- 172.21.15.6:0/503898351 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda9c005ab0 0x7fda9c01cdd0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.713+0000 7fdaab600640 1 --2- 172.21.15.6:0/503898351 >> v2:172.21.15.6:3300/0 conn(0x7fda9c0366f0 0x7fda9c01c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.713+0000 7fdaab600640 1 -- 172.21.15.6:0/503898351 >> 172.21.15.6:0/503898351 conn(0x7fda9c054560 msgr2=0x7fda9c054940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:55.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.713+0000 7fdaab600640 1 -- 172.21.15.6:0/503898351 shutdown_connections 2024-09-10T20:55:55.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.713+0000 7f0ad1200640 1 --2- 172.21.15.6:0/365811914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0acc15dab0 0x7f0acc0c6400 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0ac4000f60 tx=0x7f0ac400c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:55.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.712+0000 7f2363200640 1 -- 172.21.15.6:0/261636144 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2338001030 con 0x7f235c161da0 2024-09-10T20:55:55.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.713+0000 7f2356000640 1 -- 172.21.15.6:0/261636144 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2358004680 con 0x7f235c161da0 2024-09-10T20:55:55.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.713+0000 7f0ac3e00640 1 -- 172.21.15.6:0/365811914 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac4017070 con 0x7f0acc15dab0 2024-09-10T20:55:55.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.714+0000 7f5756600640 1 --2- 172.21.15.6:0/89493936 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x7f57300803f0 0x7f5730082810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:55.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.714+0000 7f5755c00640 1 --2- 172.21.15.6:0/89493936 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5730078170 0x7f573007a630 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f573c0046b0 tx=0x7f573c007d40 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:55.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.714+0000 7f3450800640 1 -- 172.21.15.6:0/4066672811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f344814a050 con 0x7f344815c170 2024-09-10T20:55:55.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.715+0000 7f2356000640 1 --2- 172.21.15.6:0/261636144 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2340077f70 0x7f234007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:55.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.715+0000 7f2356000640 1 -- 172.21.15.6:0/261636144 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f23580bb2d0 con 0x7f235c161da0 2024-09-10T20:55:55.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.715+0000 7f0ac3e00640 1 -- 172.21.15.6:0/365811914 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ac40053c0 con 0x7f0acc15dab0 2024-09-10T20:55:55.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.715+0000 7f0ac3e00640 1 -- 172.21.15.6:0/365811914 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac4003850 con 0x7f0acc15dab0 2024-09-10T20:55:55.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.715+0000 7f2361e00640 1 --2- 172.21.15.6:0/261636144 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2340077f70 0x7f234007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:55.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.715+0000 7f2356000640 1 --2- 172.21.15.6:0/261636144 >> [v2:172.21.15.150:6826/2568527750,v1:172.21.15.150:6827/2568527750] conn(0x7f2340080110 0x7f2340082530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:55.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.715+0000 7f2356000640 1 -- 172.21.15.6:0/261636144 --> [v2:172.21.15.150:6826/2568527750,v1:172.21.15.150:6827/2568527750] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f235802be90 con 0x7f2340080110 2024-09-10T20:55:55.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.715+0000 7f2356000640 1 -- 172.21.15.6:0/261636144 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f23580c2050 con 0x7f235c161da0 2024-09-10T20:55:55.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.715+0000 7f0ad3200640 1 -- 172.21.15.6:0/365811914 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0acc0c8640 con 0x7f0acc15dab0 2024-09-10T20:55:55.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.715+0000 7f0ad3200640 1 -- 172.21.15.6:0/365811914 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0acc0c8c00 con 0x7f0acc15dab0 2024-09-10T20:55:55.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.716+0000 7f2361400640 1 --2- 172.21.15.6:0/261636144 >> [v2:172.21.15.150:6826/2568527750,v1:172.21.15.150:6827/2568527750] conn(0x7f2340080110 0x7f2340082530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:55.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.713+0000 7fdaab600640 1 -- 172.21.15.6:0/503898351 wait complete. 2024-09-10T20:55:55.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.716+0000 7fdaab600640 1 Processor -- start 2024-09-10T20:55:55.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.716+0000 7f2361e00640 1 --2- 172.21.15.6:0/261636144 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2340077f70 0x7f234007a430 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2350005fd0 tx=0x7f2350005e20 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:55.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.715+0000 7f3442000640 1 -- 172.21.15.6:0/4066672811 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f344400b040 con 0x7f344815c170 2024-09-10T20:55:55.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.716+0000 7f0ad3200640 1 -- 172.21.15.6:0/365811914 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0acc069d20 con 0x7f0acc15dab0 2024-09-10T20:55:55.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.717+0000 7fdaab600640 1 -- start start 2024-09-10T20:55:55.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.717+0000 7f5756600640 1 --2- 172.21.15.6:0/89493936 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x7f57300803f0 0x7f5730082810 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:55.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.717+0000 7f3442000640 1 --2- 172.21.15.6:0/4066672811 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3428077fc0 0x7f342807a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:55.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.717+0000 7f3442000640 1 -- 172.21.15.6:0/4066672811 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f344409a0a0 con 0x7f344815c170 2024-09-10T20:55:55.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.718+0000 7f3442000640 1 --2- 172.21.15.6:0/4066672811 >> [v2:172.21.15.150:6810/371417736,v1:172.21.15.150:6811/371417736] conn(0x7f34280801e0 0x7f3428082600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:55.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.718+0000 7f3442000640 1 -- 172.21.15.6:0/4066672811 --> [v2:172.21.15.150:6810/371417736,v1:172.21.15.150:6811/371417736] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f344401ee50 con 0x7f34280801e0 2024-09-10T20:55:55.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.718+0000 7f344de00640 1 --2- 172.21.15.6:0/4066672811 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3428077fc0 0x7f342807a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:55.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.718+0000 7f3442000640 1 -- 172.21.15.6:0/4066672811 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f34440a1050 con 0x7f344815c170 2024-09-10T20:55:55.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.718+0000 7f574d600640 1 -- 172.21.15.6:0/89493936 <== osd.3 v2:172.21.15.6:6816/3911674247 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f57500ae2e0 con 0x7f57300803f0 2024-09-10T20:55:55.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.718+0000 7f344d400640 1 --2- 172.21.15.6:0/4066672811 >> [v2:172.21.15.150:6810/371417736,v1:172.21.15.150:6811/371417736] conn(0x7f34280801e0 0x7f3428082600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:55.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.718+0000 7f0ac3e00640 1 -- 172.21.15.6:0/365811914 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f0ac40039f0 con 0x7f0acc15dab0 2024-09-10T20:55:55.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.718+0000 7f2361400640 1 --2- 172.21.15.6:0/261636144 >> [v2:172.21.15.150:6826/2568527750,v1:172.21.15.150:6827/2568527750] conn(0x7f2340080110 0x7f2340082530 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:55.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.719+0000 7f0ac3e00640 1 --2- 172.21.15.6:0/365811914 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f0aa8078040 0x7f0aa807a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:55.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.719+0000 7f0ac3e00640 1 -- 172.21.15.6:0/365811914 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f0ac4099180 con 0x7f0acc15dab0 2024-09-10T20:55:55.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.719+0000 7f344de00640 1 --2- 172.21.15.6:0/4066672811 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3428077fc0 0x7f342807a480 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f343c007fd0 tx=0x7f343c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:55.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.719+0000 7f0ac3e00640 1 --2- 172.21.15.6:0/365811914 >> [v2:172.21.15.150:6818/2329248366,v1:172.21.15.150:6819/2329248366] conn(0x7f0aa8080260 0x7f0aa8082680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:55.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.719+0000 7f0ac3e00640 1 -- 172.21.15.6:0/365811914 --> [v2:172.21.15.150:6818/2329248366,v1:172.21.15.150:6819/2329248366] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0aa8082d30 con 0x7f0aa8080260 2024-09-10T20:55:55.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.719+0000 7f0ac3e00640 1 -- 172.21.15.6:0/365811914 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f0ac40a0050 con 0x7f0acc15dab0 2024-09-10T20:55:55.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.720+0000 7f344d400640 1 --2- 172.21.15.6:0/4066672811 >> [v2:172.21.15.150:6810/371417736,v1:172.21.15.150:6811/371417736] conn(0x7f34280801e0 0x7f3428082600 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:55.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.719+0000 7f0acbe00640 1 --2- 172.21.15.6:0/365811914 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f0aa8078040 0x7f0aa807a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:55.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.720+0000 7fdaab600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda9c005ab0 0x7fda9c185880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:55.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.720+0000 7f2356000640 1 -- 172.21.15.6:0/261636144 <== osd.4 v2:172.21.15.150:6826/2568527750 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f235802be90 con 0x7f2340080110 2024-09-10T20:55:55.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.720+0000 7f0acb400640 1 --2- 172.21.15.6:0/365811914 >> [v2:172.21.15.150:6818/2329248366,v1:172.21.15.150:6819/2329248366] conn(0x7f0aa8080260 0x7f0aa8082680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:55.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.720+0000 7f0acbe00640 1 --2- 172.21.15.6:0/365811914 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f0aa8078040 0x7f0aa807a500 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4000c00 tx=0x7f0ab4007f50 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:55.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.720+0000 7fdaab600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda9c00ba00 0x7fda9c04da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:55.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.720+0000 7fdaa8c00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda9c005ab0 0x7fda9c185880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:55.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.721+0000 7f0acb400640 1 --2- 172.21.15.6:0/365811914 >> [v2:172.21.15.150:6818/2329248366,v1:172.21.15.150:6819/2329248366] conn(0x7f0aa8080260 0x7f0aa8082680 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:55.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.721+0000 7fdaab600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda9c0366f0 0x7fda9c04dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:55.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.721+0000 7fdaa3e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda9c00ba00 0x7fda9c04da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:55.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.721+0000 7fdaa8c00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda9c005ab0 0x7fda9c185880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51202/0 (socket says 172.21.15.6:51202) 2024-09-10T20:55:55.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.721+0000 7fdaa8c00640 1 -- 172.21.15.6:0/3725844167 learned_addr learned my addr 172.21.15.6:0/3725844167 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:55.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.721+0000 7fdaab600640 1 -- 172.21.15.6:0/3725844167 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fda9c009e90 con 0x7fda9c005ab0 2024-09-10T20:55:55.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.721+0000 7fdaab600640 1 -- 172.21.15.6:0/3725844167 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fda9c009d10 con 0x7fda9c0366f0 2024-09-10T20:55:55.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.721+0000 7fdaab600640 1 -- 172.21.15.6:0/3725844167 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fda9c00a010 con 0x7fda9c00ba00 2024-09-10T20:55:55.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.721+0000 7fdaa9600640 1 --2- 172.21.15.6:0/3725844167 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda9c0366f0 0x7fda9c04dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:55.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.721+0000 7f3442000640 1 -- 172.21.15.6:0/4066672811 <== osd.5 v2:172.21.15.150:6810/371417736 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f344401ee50 con 0x7f34280801e0 2024-09-10T20:55:55.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.722+0000 7f0ac3e00640 1 -- 172.21.15.6:0/365811914 <== osd.6 v2:172.21.15.150:6818/2329248366 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0aa8082d30 con 0x7f0aa8080260 2024-09-10T20:55:55.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.724+0000 7fdaa8c00640 1 -- 172.21.15.6:0/3725844167 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda9c00ba00 msgr2=0x7fda9c04da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.725+0000 7fdaa8c00640 1 --2- 172.21.15.6:0/3725844167 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda9c00ba00 0x7fda9c04da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.725+0000 7fdaa8c00640 1 -- 172.21.15.6:0/3725844167 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda9c0366f0 msgr2=0x7fda9c04dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.725+0000 7fdaa8c00640 1 --2- 172.21.15.6:0/3725844167 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda9c0366f0 0x7fda9c04dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.725+0000 7fdaa8c00640 1 -- 172.21.15.6:0/3725844167 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda9c04c720 con 0x7fda9c005ab0 2024-09-10T20:55:55.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.725+0000 7fdaa9600640 1 --2- 172.21.15.6:0/3725844167 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda9c0366f0 0x7fda9c04dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:55:55.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.726+0000 7fdaa8c00640 1 --2- 172.21.15.6:0/3725844167 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda9c005ab0 0x7fda9c185880 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fda9800c410 tx=0x7fda9800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:55.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.726+0000 7fdaa0c00640 1 -- 172.21.15.6:0/3725844167 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda98017070 con 0x7fda9c005ab0 2024-09-10T20:55:55.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.726+0000 7fdaa0c00640 1 -- 172.21.15.6:0/3725844167 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda980035f0 con 0x7fda9c005ab0 2024-09-10T20:55:55.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.727+0000 7fdaab600640 1 -- 172.21.15.6:0/3725844167 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda9c04ca00 con 0x7fda9c005ab0 2024-09-10T20:55:55.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.727+0000 7fdaa0c00640 1 -- 172.21.15.6:0/3725844167 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda98003a80 con 0x7fda9c005ab0 2024-09-10T20:55:55.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.727+0000 7fdaab600640 1 -- 172.21.15.6:0/3725844167 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda9c04cfc0 con 0x7fda9c005ab0 2024-09-10T20:55:55.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.728+0000 7fda96000640 1 -- 172.21.15.6:0/3725844167 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fda78001030 con 0x7fda9c005ab0 2024-09-10T20:55:55.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.730+0000 7f6243600640 1 -- 172.21.15.6:0/4219314442 --> [v2:172.21.15.6:6808/1129113250,v1:172.21.15.6:6809/1129113250] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f623c1fed40 con 0x7f621c080190 2024-09-10T20:55:55.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.730+0000 7f6238c00640 1 -- 172.21.15.6:0/4219314442 <== osd.1 v2:172.21.15.6:6808/1129113250 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f623c1fed40 con 0x7f621c080190 2024-09-10T20:55:55.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.731+0000 7f6243600640 1 -- 172.21.15.6:0/4219314442 >> [v2:172.21.15.6:6808/1129113250,v1:172.21.15.6:6809/1129113250] conn(0x7f621c080190 msgr2=0x7f621c0825b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.731+0000 7f6243600640 1 --2- 172.21.15.6:0/4219314442 >> [v2:172.21.15.6:6808/1129113250,v1:172.21.15.6:6809/1129113250] conn(0x7f621c080190 0x7f621c0825b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.732+0000 7fb971600640 1 -- 172.21.15.6:0/509168854 --> [v2:172.21.15.6:6800/895515615,v1:172.21.15.6:6801/895515615] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb96c0b7b50 con 0x7fb94c080110 2024-09-10T20:55:55.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.732+0000 7f6243600640 1 -- 172.21.15.6:0/4219314442 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f621c077f70 msgr2=0x7f621c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.731+0000 7fdaa0c00640 1 -- 172.21.15.6:0/3725844167 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fda98003c20 con 0x7fda9c005ab0 2024-09-10T20:55:55.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.732+0000 7f6243600640 1 --2- 172.21.15.6:0/4219314442 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f621c077f70 0x7f621c07a430 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f62300046b0 tx=0x7f6230004620 comp rx=0 tx=0).stop 2024-09-10T20:55:55.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.732+0000 7f6243600640 1 -- 172.21.15.6:0/4219314442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f623c0aef00 msgr2=0x7f623c2021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.732+0000 7f6243600640 1 --2- 172.21.15.6:0/4219314442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f623c0aef00 0x7f623c2021c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f622802b890 tx=0x7f62280038f0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.733+0000 7fb962a00640 1 -- 172.21.15.6:0/509168854 <== osd.0 v2:172.21.15.6:6800/895515615 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb96c0b7b50 con 0x7fb94c080110 2024-09-10T20:55:55.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.733+0000 7f6241600640 1 -- 172.21.15.6:0/4219314442 reap_dead start 2024-09-10T20:55:55.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.733+0000 7f6243600640 1 -- 172.21.15.6:0/4219314442 shutdown_connections 2024-09-10T20:55:55.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.733+0000 7f6243600640 1 -- 172.21.15.6:0/4219314442 >> 172.21.15.6:0/4219314442 conn(0x7f623c0cfa20 msgr2=0x7f623c15a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:55.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.733+0000 7fdaa0c00640 1 --2- 172.21.15.6:0/3725844167 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fda84077f70 0x7fda8407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:55.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.733+0000 7f6243600640 1 -- 172.21.15.6:0/4219314442 shutdown_connections 2024-09-10T20:55:55.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.733+0000 7f6243600640 1 -- 172.21.15.6:0/4219314442 wait complete. 2024-09-10T20:55:55.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.734+0000 7fdaa0c00640 1 -- 172.21.15.6:0/3725844167 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fda980990a0 con 0x7fda9c005ab0 2024-09-10T20:55:55.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.734+0000 7fdaa3e00640 1 --2- 172.21.15.6:0/3725844167 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fda84077f70 0x7fda8407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:55.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.734+0000 7fb971600640 1 -- 172.21.15.6:0/509168854 >> [v2:172.21.15.6:6800/895515615,v1:172.21.15.6:6801/895515615] conn(0x7fb94c080110 msgr2=0x7fb94c082530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.734+0000 7fb971600640 1 --2- 172.21.15.6:0/509168854 >> [v2:172.21.15.6:6800/895515615,v1:172.21.15.6:6801/895515615] conn(0x7fb94c080110 0x7fb94c082530 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.735+0000 7fdaa0c00640 1 --2- 172.21.15.6:0/3725844167 >> [v2:172.21.15.150:6802/527018351,v1:172.21.15.150:6803/527018351] conn(0x7fda84080170 0x7fda84082590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:55.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.735+0000 7fdaa0c00640 1 -- 172.21.15.6:0/3725844167 --> [v2:172.21.15.150:6802/527018351,v1:172.21.15.150:6803/527018351] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fda84082c40 con 0x7fda84080170 2024-09-10T20:55:55.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.735+0000 7fdaa0c00640 1 -- 172.21.15.6:0/3725844167 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fda980a0050 con 0x7fda9c005ab0 2024-09-10T20:55:55.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.735+0000 7fdaa3e00640 1 --2- 172.21.15.6:0/3725844167 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fda84077f70 0x7fda8407a430 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fda9c1895a0 tx=0x7fda90008040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:55.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.735+0000 7fdaa9600640 1 --2- 172.21.15.6:0/3725844167 >> [v2:172.21.15.150:6802/527018351,v1:172.21.15.150:6803/527018351] conn(0x7fda84080170 0x7fda84082590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:55.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.735+0000 7fb971600640 1 -- 172.21.15.6:0/509168854 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb94c077f70 msgr2=0x7fb94c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.735+0000 7fb971600640 1 --2- 172.21.15.6:0/509168854 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb94c077f70 0x7fb94c07a430 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb95c0095f0 tx=0x7fb95c004730 comp rx=0 tx=0).stop 2024-09-10T20:55:55.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.735+0000 7fb971600640 1 -- 172.21.15.6:0/509168854 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb96c162400 msgr2=0x7fb96c157650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.735+0000 7fb971600640 1 --2- 172.21.15.6:0/509168854 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb96c162400 0x7fb96c157650 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb96400ea80 tx=0x7fb96400ef40 comp rx=0 tx=0).stop 2024-09-10T20:55:55.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.736+0000 7fb96b400640 1 -- 172.21.15.6:0/509168854 reap_dead start 2024-09-10T20:55:55.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.736+0000 7fb971600640 1 -- 172.21.15.6:0/509168854 shutdown_connections 2024-09-10T20:55:55.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.736+0000 7fb971600640 1 -- 172.21.15.6:0/509168854 >> 172.21.15.6:0/509168854 conn(0x7fb96c09d0c0 msgr2=0x7fb96c06dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:55.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.736+0000 7fdaa9600640 1 --2- 172.21.15.6:0/3725844167 >> [v2:172.21.15.150:6802/527018351,v1:172.21.15.150:6803/527018351] conn(0x7fda84080170 0x7fda84082590 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:55.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.736+0000 7fb971600640 1 -- 172.21.15.6:0/509168854 shutdown_connections 2024-09-10T20:55:55.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.736+0000 7fb971600640 1 -- 172.21.15.6:0/509168854 wait complete. 2024-09-10T20:55:55.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.738+0000 7fdaa0c00640 1 -- 172.21.15.6:0/3725844167 <== osd.7 v2:172.21.15.150:6802/527018351 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fda84082c40 con 0x7fda84080170 2024-09-10T20:55:55.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.746+0000 7fd8cbe00640 1 -- 172.21.15.6:0/1200047848 --> [v2:172.21.15.6:6824/3847470051,v1:172.21.15.6:6825/3847470051] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd8c40dca70 con 0x7fd8ac080190 2024-09-10T20:55:55.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.746+0000 7fd8c2a00640 1 -- 172.21.15.6:0/1200047848 <== osd.2 v2:172.21.15.6:6824/3847470051 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd8c40dca70 con 0x7fd8ac080190 2024-09-10T20:55:55.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.747+0000 7fd8cbe00640 1 -- 172.21.15.6:0/1200047848 >> [v2:172.21.15.6:6824/3847470051,v1:172.21.15.6:6825/3847470051] conn(0x7fd8ac080190 msgr2=0x7fd8ac0825b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.747+0000 7fd8cbe00640 1 --2- 172.21.15.6:0/1200047848 >> [v2:172.21.15.6:6824/3847470051,v1:172.21.15.6:6825/3847470051] conn(0x7fd8ac080190 0x7fd8ac0825b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.748+0000 7fd8cbe00640 1 -- 172.21.15.6:0/1200047848 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd8ac077f70 msgr2=0x7fd8ac07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.748+0000 7fd8cbe00640 1 --2- 172.21.15.6:0/1200047848 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd8ac077f70 0x7fd8ac07a430 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd8c404d790 tx=0x7fd8bc005f90 comp rx=0 tx=0).stop 2024-09-10T20:55:55.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.748+0000 7fd8cbe00640 1 -- 172.21.15.6:0/1200047848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8c40e2cf0 msgr2=0x7fd8c40d4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.748+0000 7fd8cbe00640 1 --2- 172.21.15.6:0/1200047848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8c40e2cf0 0x7fd8c40d4980 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc06ae70 tx=0x7fd8cc069d80 comp rx=0 tx=0).stop 2024-09-10T20:55:55.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.749+0000 7f5757000640 1 -- 172.21.15.6:0/89493936 --> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f572c002dd0 con 0x7f57300803f0 2024-09-10T20:55:55.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.748+0000 7fd8cb400640 1 -- 172.21.15.6:0/1200047848 reap_dead start 2024-09-10T20:55:55.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.749+0000 7f574d600640 1 -- 172.21.15.6:0/89493936 <== osd.3 v2:172.21.15.6:6816/3911674247 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f572c002dd0 con 0x7f57300803f0 2024-09-10T20:55:55.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.750+0000 7fd8cbe00640 1 -- 172.21.15.6:0/1200047848 shutdown_connections 2024-09-10T20:55:55.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.750+0000 7fd8cbe00640 1 -- 172.21.15.6:0/1200047848 >> 172.21.15.6:0/1200047848 conn(0x7fd8c4058cc0 msgr2=0x7fd8c40590a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:55.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.750+0000 7fd8cbe00640 1 -- 172.21.15.6:0/1200047848 shutdown_connections 2024-09-10T20:55:55.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.750+0000 7fd8cbe00640 1 -- 172.21.15.6:0/1200047848 wait complete. 2024-09-10T20:55:55.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.752+0000 7f5757000640 1 -- 172.21.15.6:0/89493936 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x7f57300803f0 msgr2=0x7f5730082810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.752+0000 7f5757000640 1 --2- 172.21.15.6:0/89493936 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x7f57300803f0 0x7f5730082810 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.751+0000 7f3450800640 1 -- 172.21.15.6:0/4066672811 --> [v2:172.21.15.150:6810/371417736,v1:172.21.15.150:6811/371417736] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f34480b50c0 con 0x7f34280801e0 2024-09-10T20:55:55.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.752+0000 7f2363200640 1 -- 172.21.15.6:0/261636144 --> [v2:172.21.15.150:6826/2568527750,v1:172.21.15.150:6827/2568527750] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2338002dd0 con 0x7f2340080110 2024-09-10T20:55:55.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.752+0000 7f5757000640 1 -- 172.21.15.6:0/89493936 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5730078170 msgr2=0x7f573007a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.752+0000 7f5757000640 1 --2- 172.21.15.6:0/89493936 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5730078170 0x7f573007a630 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f573c0046b0 tx=0x7f573c007d40 comp rx=0 tx=0).stop 2024-09-10T20:55:55.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.752+0000 7f5757000640 1 -- 172.21.15.6:0/89493936 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f574801c890 msgr2=0x7f5748048000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.752+0000 7f3442000640 1 -- 172.21.15.6:0/4066672811 <== osd.5 v2:172.21.15.150:6810/371417736 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f34480b50c0 con 0x7f34280801e0 2024-09-10T20:55:55.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.752+0000 7f5757000640 1 --2- 172.21.15.6:0/89493936 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f574801c890 0x7f5748048000 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f575006be30 tx=0x7f57500ae6c0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.752+0000 7f5756600640 1 -- 172.21.15.6:0/89493936 reap_dead start 2024-09-10T20:55:55.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.752+0000 7f2356000640 1 -- 172.21.15.6:0/261636144 <== osd.4 v2:172.21.15.150:6826/2568527750 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2338002dd0 con 0x7f2340080110 2024-09-10T20:55:55.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.753+0000 7f3450800640 1 -- 172.21.15.6:0/4066672811 >> [v2:172.21.15.150:6810/371417736,v1:172.21.15.150:6811/371417736] conn(0x7f34280801e0 msgr2=0x7f3428082600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.753+0000 7f3450800640 1 --2- 172.21.15.6:0/4066672811 >> [v2:172.21.15.150:6810/371417736,v1:172.21.15.150:6811/371417736] conn(0x7f34280801e0 0x7f3428082600 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.753+0000 7f3450800640 1 -- 172.21.15.6:0/4066672811 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3428077fc0 msgr2=0x7f342807a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.753+0000 7f3450800640 1 --2- 172.21.15.6:0/4066672811 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3428077fc0 0x7f342807a480 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f343c007fd0 tx=0x7f343c009040 comp rx=0 tx=0).stop 2024-09-10T20:55:55.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.753+0000 7f3450800640 1 -- 172.21.15.6:0/4066672811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f344815c170 msgr2=0x7f3448151d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.753+0000 7f3450800640 1 --2- 172.21.15.6:0/4066672811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f344815c170 0x7f3448151d00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3444009fd0 tx=0x7f344400c740 comp rx=0 tx=0).stop 2024-09-10T20:55:55.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.753+0000 7f344e800640 1 -- 172.21.15.6:0/4066672811 reap_dead start 2024-09-10T20:55:55.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.753+0000 7f2363200640 1 -- 172.21.15.6:0/261636144 >> [v2:172.21.15.150:6826/2568527750,v1:172.21.15.150:6827/2568527750] conn(0x7f2340080110 msgr2=0x7f2340082530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.753+0000 7f2363200640 1 --2- 172.21.15.6:0/261636144 >> [v2:172.21.15.150:6826/2568527750,v1:172.21.15.150:6827/2568527750] conn(0x7f2340080110 0x7f2340082530 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.754+0000 7f5757000640 1 -- 172.21.15.6:0/89493936 shutdown_connections 2024-09-10T20:55:55.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.754+0000 7f5757000640 1 -- 172.21.15.6:0/89493936 >> 172.21.15.6:0/89493936 conn(0x7f5748054560 msgr2=0x7f5748052d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:55.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.754+0000 7f3450800640 1 -- 172.21.15.6:0/4066672811 shutdown_connections 2024-09-10T20:55:55.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.754+0000 7f3450800640 1 -- 172.21.15.6:0/4066672811 >> 172.21.15.6:0/4066672811 conn(0x7f34480cfa20 msgr2=0x7f34480cfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:55.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.754+0000 7f5757000640 1 -- 172.21.15.6:0/89493936 shutdown_connections 2024-09-10T20:55:55.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.754+0000 7f0ad3200640 1 -- 172.21.15.6:0/365811914 --> [v2:172.21.15.150:6818/2329248366,v1:172.21.15.150:6819/2329248366] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0acc0c3330 con 0x7f0aa8080260 2024-09-10T20:55:55.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.754+0000 7f3450800640 1 -- 172.21.15.6:0/4066672811 shutdown_connections 2024-09-10T20:55:55.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.754+0000 7f3450800640 1 -- 172.21.15.6:0/4066672811 wait complete. 2024-09-10T20:55:55.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.754+0000 7f5757000640 1 -- 172.21.15.6:0/89493936 wait complete. 2024-09-10T20:55:55.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.754+0000 7f2363200640 1 -- 172.21.15.6:0/261636144 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2340077f70 msgr2=0x7f234007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.754+0000 7f2363200640 1 --2- 172.21.15.6:0/261636144 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2340077f70 0x7f234007a430 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2350005fd0 tx=0x7f2350005e20 comp rx=0 tx=0).stop 2024-09-10T20:55:55.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.754+0000 7f2363200640 1 -- 172.21.15.6:0/261636144 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f235c161da0 msgr2=0x7f235c1f8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.754+0000 7f2363200640 1 --2- 172.21.15.6:0/261636144 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f235c161da0 0x7f235c1f8c40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2358009d60 tx=0x7f2358003f10 comp rx=0 tx=0).stop 2024-09-10T20:55:55.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.754+0000 7f2362800640 1 -- 172.21.15.6:0/261636144 reap_dead start 2024-09-10T20:55:55.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.754+0000 7f2363200640 1 -- 172.21.15.6:0/261636144 shutdown_connections 2024-09-10T20:55:55.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.754+0000 7f2363200640 1 -- 172.21.15.6:0/261636144 >> 172.21.15.6:0/261636144 conn(0x7f235c09d100 msgr2=0x7f235c0b7460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:55.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.754+0000 7f2363200640 1 -- 172.21.15.6:0/261636144 shutdown_connections 2024-09-10T20:55:55.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.754+0000 7f2363200640 1 -- 172.21.15.6:0/261636144 wait complete. 2024-09-10T20:55:55.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.755+0000 7f0ac3e00640 1 -- 172.21.15.6:0/365811914 <== osd.6 v2:172.21.15.150:6818/2329248366 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0acc0c3330 con 0x7f0aa8080260 2024-09-10T20:55:55.774 INFO:teuthology.orchestra.run.smithi006.stdout:64424509447 2024-09-10T20:55:55.775 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T20:55:55.775 INFO:teuthology.orchestra.run.smithi006.stdout:64424509446 2024-09-10T20:55:55.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.758+0000 7f0ad3200640 1 -- 172.21.15.6:0/365811914 >> [v2:172.21.15.150:6818/2329248366,v1:172.21.15.150:6819/2329248366] conn(0x7f0aa8080260 msgr2=0x7f0aa8082680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.758+0000 7f0ad3200640 1 --2- 172.21.15.6:0/365811914 >> [v2:172.21.15.150:6818/2329248366,v1:172.21.15.150:6819/2329248366] conn(0x7f0aa8080260 0x7f0aa8082680 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.776 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T20:55:55.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.759+0000 7f0ad3200640 1 -- 172.21.15.6:0/365811914 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f0aa8078040 msgr2=0x7f0aa807a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.759+0000 7f0ad3200640 1 --2- 172.21.15.6:0/365811914 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f0aa8078040 0x7f0aa807a500 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4000c00 tx=0x7f0ab4007f50 comp rx=0 tx=0).stop 2024-09-10T20:55:55.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.759+0000 7f0ad3200640 1 -- 172.21.15.6:0/365811914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0acc15dab0 msgr2=0x7f0acc0c6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.759+0000 7f0ad3200640 1 --2- 172.21.15.6:0/365811914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0acc15dab0 0x7f0acc0c6400 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0ac4000f60 tx=0x7f0ac400c820 comp rx=0 tx=0).stop 2024-09-10T20:55:55.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.759+0000 7f0ad1200640 1 -- 172.21.15.6:0/365811914 reap_dead start 2024-09-10T20:55:55.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.759+0000 7f0ad3200640 1 -- 172.21.15.6:0/365811914 shutdown_connections 2024-09-10T20:55:55.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.759+0000 7f0ad3200640 1 -- 172.21.15.6:0/365811914 >> 172.21.15.6:0/365811914 conn(0x7f0acc0cfa20 msgr2=0x7f0acc0b5320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:55.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.759+0000 7f0ad3200640 1 -- 172.21.15.6:0/365811914 shutdown_connections 2024-09-10T20:55:55.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.759+0000 7f0ad3200640 1 -- 172.21.15.6:0/365811914 wait complete. 2024-09-10T20:55:55.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.766+0000 7fda96000640 1 -- 172.21.15.6:0/3725844167 --> [v2:172.21.15.150:6802/527018351,v1:172.21.15.150:6803/527018351] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fda78002dd0 con 0x7fda84080170 2024-09-10T20:55:55.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.766+0000 7fdaa0c00640 1 -- 172.21.15.6:0/3725844167 <== osd.7 v2:172.21.15.150:6802/527018351 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fda78002dd0 con 0x7fda84080170 2024-09-10T20:55:55.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.767+0000 7fda96000640 1 -- 172.21.15.6:0/3725844167 >> [v2:172.21.15.150:6802/527018351,v1:172.21.15.150:6803/527018351] conn(0x7fda84080170 msgr2=0x7fda84082590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.767+0000 7fda96000640 1 --2- 172.21.15.6:0/3725844167 >> [v2:172.21.15.150:6802/527018351,v1:172.21.15.150:6803/527018351] conn(0x7fda84080170 0x7fda84082590 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.767+0000 7fda96000640 1 -- 172.21.15.6:0/3725844167 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fda84077f70 msgr2=0x7fda8407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.767+0000 7fda96000640 1 --2- 172.21.15.6:0/3725844167 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fda84077f70 0x7fda8407a430 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fda9c1895a0 tx=0x7fda90008040 comp rx=0 tx=0).stop 2024-09-10T20:55:55.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.767+0000 7fda96000640 1 -- 172.21.15.6:0/3725844167 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda9c005ab0 msgr2=0x7fda9c185880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:55.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.767+0000 7fda96000640 1 --2- 172.21.15.6:0/3725844167 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda9c005ab0 0x7fda9c185880 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fda9800c410 tx=0x7fda9800c8d0 comp rx=0 tx=0).stop 2024-09-10T20:55:55.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.767+0000 7fdaa9600640 1 -- 172.21.15.6:0/3725844167 reap_dead start 2024-09-10T20:55:55.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.767+0000 7fda96000640 1 -- 172.21.15.6:0/3725844167 shutdown_connections 2024-09-10T20:55:55.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.767+0000 7fda96000640 1 -- 172.21.15.6:0/3725844167 >> 172.21.15.6:0/3725844167 conn(0x7fda9c054560 msgr2=0x7fda9c050fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:55.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.767+0000 7fda96000640 1 -- 172.21.15.6:0/3725844167 shutdown_connections 2024-09-10T20:55:55.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:55.768+0000 7fda96000640 1 -- 172.21.15.6:0/3725844167 wait complete. 2024-09-10T20:55:55.781 INFO:teuthology.orchestra.run.smithi006.stdout:64424509446 2024-09-10T20:55:55.781 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T20:55:55.782 INFO:teuthology.orchestra.run.smithi006.stdout:60129542151 2024-09-10T20:55:55.782 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-10T20:55:55.785 INFO:teuthology.orchestra.run.smithi006.stdout:64424509447 2024-09-10T20:55:55.785 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-10T20:55:55.788 INFO:teuthology.orchestra.run.smithi006.stdout:64424509446 2024-09-10T20:55:55.789 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-10T20:55:55.789 INFO:teuthology.orchestra.run.smithi006.stdout:64424509446 2024-09-10T20:55:55.790 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-10T20:55:55.792 INFO:teuthology.orchestra.run.smithi006.stdout:64424509448 2024-09-10T20:55:55.793 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-10T20:55:56.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.036+0000 7f669f200640 1 -- 172.21.15.6:0/3485435464 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66a00d0f60 msgr2=0x7f66a01619c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:56.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.036+0000 7f669f200640 1 --2- 172.21.15.6:0/3485435464 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66a00d0f60 0x7f66a01619c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f668c009800 tx=0x7f668c02a410 comp rx=0 tx=0).stop 2024-09-10T20:55:56.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.037+0000 7f669f200640 1 -- 172.21.15.6:0/3485435464 shutdown_connections 2024-09-10T20:55:56.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.037+0000 7f669f200640 1 --2- 172.21.15.6:0/3485435464 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66a00d0f60 0x7f66a01619c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.037+0000 7f669f200640 1 -- 172.21.15.6:0/3485435464 >> 172.21.15.6:0/3485435464 conn(0x7f66a009d100 msgr2=0x7f66a00d3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:56.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.038+0000 7f669f200640 1 -- 172.21.15.6:0/3485435464 shutdown_connections 2024-09-10T20:55:56.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.038+0000 7f669f200640 1 -- 172.21.15.6:0/3485435464 wait complete. 2024-09-10T20:55:56.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.041+0000 7f669f200640 1 Processor -- start 2024-09-10T20:55:56.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.041+0000 7f669f200640 1 -- start start 2024-09-10T20:55:56.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.043+0000 7f56c2600640 1 -- 172.21.15.6:0/2784168461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56a4004800 msgr2=0x7f56a4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:56.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.043+0000 7f56c2600640 1 --2- 172.21.15.6:0/2784168461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56a4004800 0x7f56a4004c80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f56b0009b30 tx=0x7f56a4005830 comp rx=0 tx=0).stop 2024-09-10T20:55:56.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.043+0000 7f56c1c00640 1 -- 172.21.15.6:0/2784168461 reap_dead start 2024-09-10T20:55:56.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.043+0000 7f56c2600640 1 -- 172.21.15.6:0/2784168461 shutdown_connections 2024-09-10T20:55:56.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.044+0000 7f56c2600640 1 -- 172.21.15.6:0/2784168461 >> 172.21.15.6:0/2784168461 conn(0x7f56b4054560 msgr2=0x7f56b4054940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:56.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.044+0000 7f669f200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66a00d0f60 0x7f66a0160a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:56.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.044+0000 7f56c2600640 1 -- 172.21.15.6:0/2784168461 shutdown_connections 2024-09-10T20:55:56.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.044+0000 7f56c2600640 1 -- 172.21.15.6:0/2784168461 wait complete. 2024-09-10T20:55:56.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.044+0000 7f669f200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66a015dcb0 0x7f66a0158c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:56.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.044+0000 7f669f200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66a015e090 0x7f66a0155df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:56.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.045+0000 7f669d400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66a015dcb0 0x7f66a0158c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:56.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.045+0000 7f669d400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66a015dcb0 0x7f66a0158c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.6:36920/0 (socket says 172.21.15.6:36920) 2024-09-10T20:55:56.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.045+0000 7f669d400640 1 -- 172.21.15.6:0/1023228467 learned_addr learned my addr 172.21.15.6:0/1023228467 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:56.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.045+0000 7f669e800640 1 --2- 172.21.15.6:0/1023228467 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66a015e090 0x7f66a0155df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:56.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.044+0000 7f669f200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f66a00b6fd0 con 0x7f66a00d0f60 2024-09-10T20:55:56.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.045+0000 7f669f200640 1 -- 172.21.15.6:0/1023228467 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f66a00b6e50 con 0x7f66a015dcb0 2024-09-10T20:55:56.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.045+0000 7f669f200640 1 -- 172.21.15.6:0/1023228467 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f66a00b7150 con 0x7f66a015e090 2024-09-10T20:55:56.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.045+0000 7f669de00640 1 --2- 172.21.15.6:0/1023228467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66a00d0f60 0x7f66a0160a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:56.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.046+0000 7f669e800640 1 -- 172.21.15.6:0/1023228467 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66a015dcb0 msgr2=0x7f66a0158c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:56.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.046+0000 7f669e800640 1 --2- 172.21.15.6:0/1023228467 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66a015dcb0 0x7f66a0158c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.046+0000 7f669e800640 1 -- 172.21.15.6:0/1023228467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66a00d0f60 msgr2=0x7f66a0160a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:56.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.046+0000 7f669e800640 1 --2- 172.21.15.6:0/1023228467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66a00d0f60 0x7f66a0160a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.046+0000 7f669e800640 1 -- 172.21.15.6:0/1023228467 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66a0157eb0 con 0x7f66a015e090 2024-09-10T20:55:56.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.047+0000 7f56c2600640 1 Processor -- start 2024-09-10T20:55:56.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.047+0000 7f56c2600640 1 -- start start 2024-09-10T20:55:56.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.047+0000 7f669de00640 1 --2- 172.21.15.6:0/1023228467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66a00d0f60 0x7f66a0160a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:55:56.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.047+0000 7f669d400640 1 --2- 172.21.15.6:0/1023228467 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66a015dcb0 0x7f66a0158c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:55:56.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.048+0000 7f669e800640 1 --2- 172.21.15.6:0/1023228467 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66a015e090 0x7f66a0155df0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f668c031000 tx=0x7f668c032c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:56.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.049+0000 7f6696000640 1 -- 172.21.15.6:0/1023228467 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f668c040070 con 0x7f66a015e090 2024-09-10T20:55:56.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.049+0000 7f56c2600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56a4004800 0x7f56b404f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:56.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.049+0000 7f56c2600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56b401e1e0 0x7f56b40dc490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:56.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.049+0000 7f56c2600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56b4037e30 0x7f56b40382b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:56.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.049+0000 7f56c2600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f56b4009a50 con 0x7f56a4004800 2024-09-10T20:55:56.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.049+0000 7f56c2600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f56b400bc10 con 0x7f56b401e1e0 2024-09-10T20:55:56.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.049+0000 7f56c2600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f56b4009bd0 con 0x7f56b4037e30 2024-09-10T20:55:56.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.050+0000 7f56bbe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56b401e1e0 0x7f56b40dc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:56.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.050+0000 7f56bbe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56b401e1e0 0x7f56b40dc490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.6:36930/0 (socket says 172.21.15.6:36930) 2024-09-10T20:55:56.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.050+0000 7f56bbe00640 1 -- 172.21.15.6:0/4287952579 learned_addr learned my addr 172.21.15.6:0/4287952579 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:56.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.049+0000 7f669f200640 1 -- 172.21.15.6:0/1023228467 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66a0158190 con 0x7f66a015e090 2024-09-10T20:55:56.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.049+0000 7f669f200640 1 -- 172.21.15.6:0/1023228467 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f66a0157ad0 con 0x7f66a015e090 2024-09-10T20:55:56.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.050+0000 7f6696000640 1 -- 172.21.15.6:0/1023228467 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f668c0037f0 con 0x7f66a015e090 2024-09-10T20:55:56.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.050+0000 7f6696000640 1 -- 172.21.15.6:0/1023228467 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f668c040070 con 0x7f66a015e090 2024-09-10T20:55:56.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.050+0000 7f56bbe00640 1 -- 172.21.15.6:0/4287952579 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56b4037e30 msgr2=0x7f56b40382b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T20:55:56.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.050+0000 7f56bbe00640 1 --2- 172.21.15.6:0/4287952579 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56b4037e30 0x7f56b40382b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.050+0000 7f56bbe00640 1 -- 172.21.15.6:0/4287952579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56a4004800 msgr2=0x7f56b404f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:56.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.050+0000 7f56bbe00640 1 --2- 172.21.15.6:0/4287952579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56a4004800 0x7f56b404f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.050+0000 7f56bbe00640 1 -- 172.21.15.6:0/4287952579 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56b4050010 con 0x7f56b401e1e0 2024-09-10T20:55:56.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.051+0000 7f56bbe00640 1 --2- 172.21.15.6:0/4287952579 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56b401e1e0 0x7f56b40dc490 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f56b002b4b0 tx=0x7f56b0033c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:56.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.052+0000 7f56b8c00640 1 -- 172.21.15.6:0/4287952579 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b0041020 con 0x7f56b401e1e0 2024-09-10T20:55:56.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.052+0000 7f56b8c00640 1 -- 172.21.15.6:0/4287952579 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56b0039040 con 0x7f56b401e1e0 2024-09-10T20:55:56.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.052+0000 7f56b8c00640 1 -- 172.21.15.6:0/4287952579 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b0038070 con 0x7f56b401e1e0 2024-09-10T20:55:56.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.053+0000 7f669f200640 1 -- 172.21.15.6:0/1023228467 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6678005290 con 0x7f66a015e090 2024-09-10T20:55:56.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.053+0000 7f56c2600640 1 -- 172.21.15.6:0/4287952579 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56b4048250 con 0x7f56b401e1e0 2024-09-10T20:55:56.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.054+0000 7f56c2600640 1 -- 172.21.15.6:0/4287952579 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56b4048810 con 0x7f56b401e1e0 2024-09-10T20:55:56.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.056+0000 7fbb09a00640 1 -- 172.21.15.6:0/3599083581 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb04162400 msgr2=0x7fbb040d4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:56.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.056+0000 7f2207e00640 1 -- 172.21.15.6:0/3437875135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22080ce500 msgr2=0x7f22080ca500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:56.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.056+0000 7f2207e00640 1 --2- 172.21.15.6:0/3437875135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22080ce500 0x7f22080ca500 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f22080ccde0 tx=0x7f220002a9e0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.056+0000 7f56c2600640 1 -- 172.21.15.6:0/4287952579 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56b4035fe0 con 0x7f56b401e1e0 2024-09-10T20:55:56.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.056+0000 7fbb09a00640 1 --2- 172.21.15.6:0/3599083581 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb04162400 0x7fbb040d4850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4005fd0 tx=0x7fbaf402a5d0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.057+0000 7f2207e00640 1 -- 172.21.15.6:0/3437875135 shutdown_connections 2024-09-10T20:55:56.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.057+0000 7f2207e00640 1 --2- 172.21.15.6:0/3437875135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22080ce500 0x7f22080ca500 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.057+0000 7f2207e00640 1 --2- 172.21.15.6:0/3437875135 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2208158050 0x7f22080cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.057+0000 7f2207e00640 1 -- 172.21.15.6:0/3437875135 >> 172.21.15.6:0/3437875135 conn(0x7f220806d230 msgr2=0x7f22080b1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:56.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.054+0000 7f6696000640 1 -- 172.21.15.6:0/1023228467 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f668c0039c0 con 0x7f66a015e090 2024-09-10T20:55:56.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.056+0000 7f6696000640 1 --2- 172.21.15.6:0/1023228467 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6680078170 0x7f668007a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:56.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.056+0000 7f6696000640 1 -- 172.21.15.6:0/1023228467 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f668c0bb1a0 con 0x7f66a015e090 2024-09-10T20:55:56.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.057+0000 7fbb09a00640 1 -- 172.21.15.6:0/3599083581 shutdown_connections 2024-09-10T20:55:56.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.057+0000 7f2207e00640 1 -- 172.21.15.6:0/3437875135 shutdown_connections 2024-09-10T20:55:56.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.057+0000 7f669de00640 1 --2- 172.21.15.6:0/1023228467 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6680078170 0x7f668007a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:56.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.057+0000 7fbb09a00640 1 --2- 172.21.15.6:0/3599083581 >> v2:172.21.15.6:3300/0 conn(0x7fbb040d0330 0x7fbb040d0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.058+0000 7fbb09a00640 1 --2- 172.21.15.6:0/3599083581 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb04162400 0x7fbb040d4850 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.057+0000 7f2207e00640 1 -- 172.21.15.6:0/3437875135 wait complete. 2024-09-10T20:55:56.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.058+0000 7fbb09a00640 1 -- 172.21.15.6:0/3599083581 >> 172.21.15.6:0/3599083581 conn(0x7fbb0409d0c0 msgr2=0x7fbb040d3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:56.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.059+0000 7f669de00640 1 --2- 172.21.15.6:0/1023228467 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6680078170 0x7f668007a630 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f66900046b0 tx=0x7f6690009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:56.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.059+0000 7fbb09a00640 1 -- 172.21.15.6:0/3599083581 shutdown_connections 2024-09-10T20:55:56.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.059+0000 7f56b8c00640 1 -- 172.21.15.6:0/4287952579 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f56b003d9c0 con 0x7f56b401e1e0 2024-09-10T20:55:56.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.059+0000 7fbb09a00640 1 -- 172.21.15.6:0/3599083581 wait complete. 2024-09-10T20:55:56.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.060+0000 7f2207e00640 1 Processor -- start 2024-09-10T20:55:56.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.060+0000 7f2207e00640 1 -- start start 2024-09-10T20:55:56.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.061+0000 7f56b8c00640 1 --2- 172.21.15.6:0/4287952579 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f569c078070 0x7f569c07a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:56.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.061+0000 7f56b8c00640 1 -- 172.21.15.6:0/4287952579 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f56b00ba6d0 con 0x7f56b401e1e0 2024-09-10T20:55:56.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.061+0000 7fbb09a00640 1 Processor -- start 2024-09-10T20:55:56.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.062+0000 7f56c1200640 1 --2- 172.21.15.6:0/4287952579 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f569c078070 0x7f569c07a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:56.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.062+0000 7f9f2b200640 1 -- 172.21.15.6:0/618020399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f1c01d460 msgr2=0x7f9f1c01d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:56.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.062+0000 7f9f2b200640 1 --2- 172.21.15.6:0/618020399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f1c01d460 0x7f9f1c01d8a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c036bb0 tx=0x7f9f1802a540 comp rx=0 tx=0).stop 2024-09-10T20:55:56.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.062+0000 7f9f2b200640 1 -- 172.21.15.6:0/618020399 shutdown_connections 2024-09-10T20:55:56.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.062+0000 7f9f2b200640 1 --2- 172.21.15.6:0/618020399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f1c01d460 0x7f9f1c01d8a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.062+0000 7f9f2b200640 1 --2- 172.21.15.6:0/618020399 >> v2:172.21.15.150:3300/0 conn(0x7f9f1c00ad60 0x7f9f1c00b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.062+0000 7f9f2b200640 1 -- 172.21.15.6:0/618020399 >> 172.21.15.6:0/618020399 conn(0x7f9f1c054550 msgr2=0x7f9f1c054930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:56.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.062+0000 7f6696000640 1 -- 172.21.15.6:0/1023228467 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f668c04a060 con 0x7f66a015e090 2024-09-10T20:55:56.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.062+0000 7f9f2b200640 1 -- 172.21.15.6:0/618020399 shutdown_connections 2024-09-10T20:55:56.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.063+0000 7f9f2b200640 1 -- 172.21.15.6:0/618020399 wait complete. 2024-09-10T20:55:56.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.062+0000 7f2207e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22080cc7b0 0x7f22080af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:56.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.062+0000 7fbb09a00640 1 -- start start 2024-09-10T20:55:56.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.062+0000 7f2207e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22080ce500 0x7f22081f4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:56.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.062+0000 7f2207e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2208158050 0x7f22081549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:56.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.062+0000 7f2207e00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f22080caec0 con 0x7f22080cc7b0 2024-09-10T20:55:56.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.062+0000 7f2207e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f22080cad40 con 0x7f2208158050 2024-09-10T20:55:56.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.062+0000 7f2207e00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f22080cb040 con 0x7f22080ce500 2024-09-10T20:55:56.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.063+0000 7f2207400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2208158050 0x7f22081549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:56.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.063+0000 7f2207400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2208158050 0x7f22081549c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.6:36958/0 (socket says 172.21.15.6:36958) 2024-09-10T20:55:56.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.063+0000 7f2207400640 1 -- 172.21.15.6:0/1152678406 learned_addr learned my addr 172.21.15.6:0/1152678406 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:56.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.062+0000 7f2206a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22080cc7b0 0x7f22080af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:56.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.063+0000 7f2206000640 1 --2- 172.21.15.6:0/1152678406 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22080ce500 0x7f22081f4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:56.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.063+0000 7f56c1200640 1 --2- 172.21.15.6:0/4287952579 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f569c078070 0x7f569c07a530 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f56a8001c00 tx=0x7f56a8001b90 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:56.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.064+0000 7f2206a00640 1 -- 172.21.15.6:0/1152678406 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22080ce500 msgr2=0x7f22081f4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:56.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.064+0000 7f2206a00640 1 --2- 172.21.15.6:0/1152678406 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22080ce500 0x7f22081f4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.064+0000 7fbb09a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb040d0330 0x7fbb040c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:56.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.064+0000 7fbb09a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb040d0cb0 0x7fbb04158ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:56.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.064+0000 7fbb09a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb04162400 0x7fbb040c9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:56.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.064+0000 7fbb09a00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbb040b7dd0 con 0x7fbb040d0330 2024-09-10T20:55:56.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.064+0000 7fbb09a00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbb040b7c50 con 0x7fbb040d0cb0 2024-09-10T20:55:56.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.064+0000 7fbb09a00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fbb040cf0d0 con 0x7fbb04162400 2024-09-10T20:55:56.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.065+0000 7f9f2b200640 1 Processor -- start 2024-09-10T20:55:56.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.065+0000 7f9f2b200640 1 -- start start 2024-09-10T20:55:56.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.065+0000 7f2206a00640 1 -- 172.21.15.6:0/1152678406 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2208158050 msgr2=0x7f22081549c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:56.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.065+0000 7fbb02a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb040d0330 0x7fbb040c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:56.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.065+0000 7fbb02a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb040d0330 0x7fbb040c84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51286/0 (socket says 172.21.15.6:51286) 2024-09-10T20:55:56.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.065+0000 7fbb02a00640 1 -- 172.21.15.6:0/1634439298 learned_addr learned my addr 172.21.15.6:0/1634439298 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:56.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.065+0000 7f2206a00640 1 --2- 172.21.15.6:0/1152678406 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2208158050 0x7f22081549c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.065+0000 7f2206a00640 1 -- 172.21.15.6:0/1152678406 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22080af9c0 con 0x7f22080cc7b0 2024-09-10T20:55:56.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.065+0000 7f2207400640 1 --2- 172.21.15.6:0/1152678406 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2208158050 0x7f22081549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:55:56.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.065+0000 7fbb02000640 1 --2- 172.21.15.6:0/1634439298 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb040d0cb0 0x7fbb04158ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:56.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.066+0000 7f56b8c00640 1 -- 172.21.15.6:0/4287952579 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f56b00831b0 con 0x7f56b401e1e0 2024-09-10T20:55:56.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.066+0000 7fbb02a00640 1 -- 172.21.15.6:0/1634439298 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb04162400 msgr2=0x7fbb040c9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:56.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.066+0000 7f2206a00640 1 --2- 172.21.15.6:0/1152678406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22080cc7b0 0x7f22080af3a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f21f800b410 tx=0x7f21f800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:56.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.067+0000 7f21fea00640 1 -- 172.21.15.6:0/1152678406 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f8015020 con 0x7f22080cc7b0 2024-09-10T20:55:56.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.067+0000 7f9f2b200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f1c00ad60 0x7f9f1c0dfe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:56.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.067+0000 7fbb03400640 1 --2- 172.21.15.6:0/1634439298 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb04162400 0x7fbb040c9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:56.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.067+0000 7f9f2b200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f1c053990 0x7f9f1c0e03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:56.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.067+0000 7f9f2b200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f1c0069a0 0x7f9f1c0e1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:56.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.067+0000 7f9f2b200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1c009ea0 con 0x7f9f1c053990 2024-09-10T20:55:56.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.067+0000 7f9f2b200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1c009d20 con 0x7f9f1c00ad60 2024-09-10T20:55:56.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.067+0000 7f9f2b200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f9f1c00a020 con 0x7f9f1c0069a0 2024-09-10T20:55:56.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.067+0000 7f21fea00640 1 -- 172.21.15.6:0/1152678406 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f21f8011940 con 0x7f22080cc7b0 2024-09-10T20:55:56.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.067+0000 7f21fea00640 1 -- 172.21.15.6:0/1152678406 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f8011d90 con 0x7f22080cc7b0 2024-09-10T20:55:56.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.067+0000 7f2207e00640 1 -- 172.21.15.6:0/1152678406 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22080afca0 con 0x7f22080cc7b0 2024-09-10T20:55:56.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.067+0000 7f2207e00640 1 -- 172.21.15.6:0/1152678406 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22080b0260 con 0x7f22080cc7b0 2024-09-10T20:55:56.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.067+0000 7f9f23e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f1c00ad60 0x7f9f1c0dfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:56.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.067+0000 7f9f23e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f1c00ad60 0x7f9f1c0dfe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.6:36982/0 (socket says 172.21.15.6:36982) 2024-09-10T20:55:56.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.067+0000 7f9f23e00640 1 -- 172.21.15.6:0/2953688010 learned_addr learned my addr 172.21.15.6:0/2953688010 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:56.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.068+0000 7f9f23400640 1 --2- 172.21.15.6:0/2953688010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f1c053990 0x7f9f1c0e03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:56.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.068+0000 7f9f29200640 1 --2- 172.21.15.6:0/2953688010 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f1c0069a0 0x7f9f1c0e1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:56.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.068+0000 7f9f23400640 1 -- 172.21.15.6:0/2953688010 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f1c0069a0 msgr2=0x7f9f1c0e1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:56.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.068+0000 7f9f23400640 1 --2- 172.21.15.6:0/2953688010 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f1c0069a0 0x7f9f1c0e1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.068+0000 7f9f23400640 1 -- 172.21.15.6:0/2953688010 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f1c00ad60 msgr2=0x7f9f1c0dfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:56.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.068+0000 7f9f23400640 1 --2- 172.21.15.6:0/2953688010 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f1c00ad60 0x7f9f1c0dfe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.068+0000 7f9f23400640 1 -- 172.21.15.6:0/2953688010 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f1c032980 con 0x7f9f1c053990 2024-09-10T20:55:56.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.069+0000 7f9f23400640 1 --2- 172.21.15.6:0/2953688010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f1c053990 0x7f9f1c0e03c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c00ba80 tx=0x7f9f18032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:56.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.070+0000 7fbb02a00640 1 --2- 172.21.15.6:0/1634439298 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb04162400 0x7fbb040c9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.070+0000 7fbb02a00640 1 -- 172.21.15.6:0/1634439298 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb040d0cb0 msgr2=0x7fbb04158ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:56.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.070+0000 7fbb02a00640 1 --2- 172.21.15.6:0/1634439298 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb040d0cb0 0x7fbb04158ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.070+0000 7fbb02a00640 1 -- 172.21.15.6:0/1634439298 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb041fcfc0 con 0x7fbb040d0330 2024-09-10T20:55:56.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.070+0000 7fbb02000640 1 --2- 172.21.15.6:0/1634439298 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb040d0cb0 0x7fbb04158ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:55:56.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.070+0000 7f9f17e00640 1 -- 172.21.15.6:0/2953688010 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f18040070 con 0x7f9f1c053990 2024-09-10T20:55:56.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.070+0000 7f9f17e00640 1 -- 172.21.15.6:0/2953688010 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f18005220 con 0x7f9f1c053990 2024-09-10T20:55:56.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.070+0000 7f9f17e00640 1 -- 172.21.15.6:0/2953688010 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f18005c90 con 0x7f9f1c053990 2024-09-10T20:55:56.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.070+0000 7fbb03400640 1 --2- 172.21.15.6:0/1634439298 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb04162400 0x7fbb040c9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:55:56.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.070+0000 7fbb02a00640 1 --2- 172.21.15.6:0/1634439298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb040d0330 0x7fbb040c84a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4006010 tx=0x7fbaf40038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:56.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.071+0000 7fbafaa00640 1 -- 172.21.15.6:0/1634439298 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf403e030 con 0x7fbb040d0330 2024-09-10T20:55:56.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.071+0000 7fbafaa00640 1 -- 172.21.15.6:0/1634439298 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbaf4003ca0 con 0x7fbb040d0330 2024-09-10T20:55:56.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.071+0000 7fbafaa00640 1 -- 172.21.15.6:0/1634439298 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf4035040 con 0x7fbb040d0330 2024-09-10T20:55:56.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.071+0000 7fbb09a00640 1 -- 172.21.15.6:0/1634439298 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb041fc3b0 con 0x7fbb040d0330 2024-09-10T20:55:56.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.071+0000 7f2207e00640 1 -- 172.21.15.6:0/1152678406 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22080cf640 con 0x7f22080cc7b0 2024-09-10T20:55:56.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.072+0000 7fbb09a00640 1 -- 172.21.15.6:0/1634439298 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb041fc970 con 0x7fbb040d0330 2024-09-10T20:55:56.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.075+0000 7f21fea00640 1 -- 172.21.15.6:0/1152678406 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f21f8022060 con 0x7f22080cc7b0 2024-09-10T20:55:56.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.076+0000 7f21fea00640 1 --2- 172.21.15.6:0/1152678406 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f21e8078040 0x7f21e807a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:56.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.073+0000 7f9f2b200640 1 -- 172.21.15.6:0/2953688010 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f1c0da220 con 0x7f9f1c053990 2024-09-10T20:55:56.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.073+0000 7f9f2b200640 1 -- 172.21.15.6:0/2953688010 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f1c0da7e0 con 0x7f9f1c053990 2024-09-10T20:55:56.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.074+0000 7f9f2b200640 1 -- 172.21.15.6:0/2953688010 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f1c01d8a0 con 0x7f9f1c053990 2024-09-10T20:55:56.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.076+0000 7fbb09a00640 1 -- 172.21.15.6:0/1634439298 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb041f8a40 con 0x7fbb040d0330 2024-09-10T20:55:56.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.077+0000 7f21fea00640 1 -- 172.21.15.6:0/1152678406 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f21f8099840 con 0x7f22080cc7b0 2024-09-10T20:55:56.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.077+0000 7fbafaa00640 1 -- 172.21.15.6:0/1634439298 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fbaf40049e0 con 0x7fbb040d0330 2024-09-10T20:55:56.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.078+0000 7fbafaa00640 1 --2- 172.21.15.6:0/1634439298 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbae4077f70 0x7fbae407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:56.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.079+0000 7fbb02000640 1 --2- 172.21.15.6:0/1634439298 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbae4077f70 0x7fbae407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:56.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.079+0000 7f2206000640 1 --2- 172.21.15.6:0/1152678406 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f21e8078040 0x7f21e807a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:56.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.080+0000 7f2206000640 1 --2- 172.21.15.6:0/1152678406 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f21e8078040 0x7f21e807a500 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2208144ed0 tx=0x7f21f4009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:56.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.080+0000 7f21fea00640 1 -- 172.21.15.6:0/1152678406 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f21f8061d60 con 0x7f22080cc7b0 2024-09-10T20:55:56.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.080+0000 7fbafaa00640 1 -- 172.21.15.6:0/1634439298 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fbaf40b8a50 con 0x7fbb040d0330 2024-09-10T20:55:56.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.085+0000 7fbb02000640 1 --2- 172.21.15.6:0/1634439298 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbae4077f70 0x7fbae407a430 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbb0408df70 tx=0x7fbaf0005f90 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:56.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.085+0000 7f9f17e00640 1 -- 172.21.15.6:0/2953688010 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f9f180047a0 con 0x7f9f1c053990 2024-09-10T20:55:56.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.087+0000 7f9f17e00640 1 --2- 172.21.15.6:0/2953688010 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f9f04077fc0 0x7f9f0407a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:56.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.088+0000 7f9f23e00640 1 --2- 172.21.15.6:0/2953688010 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f9f04077fc0 0x7f9f0407a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:56.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.089+0000 7f9f23e00640 1 --2- 172.21.15.6:0/2953688010 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f9f04077fc0 0x7f9f0407a480 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9f2407ae40 tx=0x7f9f2406f040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:56.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.093+0000 7fbafaa00640 1 -- 172.21.15.6:0/1634439298 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fbaf40829d0 con 0x7fbb040d0330 2024-09-10T20:55:56.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.093+0000 7f9f17e00640 1 -- 172.21.15.6:0/2953688010 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f9f18005610 con 0x7f9f1c053990 2024-09-10T20:55:56.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.104+0000 7f9f17e00640 1 -- 172.21.15.6:0/2953688010 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f9f18049060 con 0x7f9f1c053990 2024-09-10T20:55:56.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.134+0000 7f0bfbe00640 1 -- 172.21.15.6:0/1033967773 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0bf403a990 msgr2=0x7f0bf4056d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:56.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.134+0000 7f0bfbe00640 1 --2- 172.21.15.6:0/1033967773 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0bf403a990 0x7f0bf4056d80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0be8009830 tx=0x7f0be802a5c0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.135+0000 7f0bfbe00640 1 -- 172.21.15.6:0/1033967773 shutdown_connections 2024-09-10T20:55:56.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.135+0000 7f0bfbe00640 1 --2- 172.21.15.6:0/1033967773 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0bf403a990 0x7f0bf4056d80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.135+0000 7f0bfbe00640 1 --2- 172.21.15.6:0/1033967773 >> v2:172.21.15.150:3300/0 conn(0x7f0bf4037a00 0x7f0bf403a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.135+0000 7f0bfbe00640 1 -- 172.21.15.6:0/1033967773 >> 172.21.15.6:0/1033967773 conn(0x7f0bf4055590 msgr2=0x7f0bf4055970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:56.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.135+0000 7f67b1400640 1 -- 172.21.15.6:0/1028655717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67ac0cbaa0 msgr2=0x7f67ac159340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:56.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.135+0000 7f67b1400640 1 --2- 172.21.15.6:0/1028655717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67ac0cbaa0 0x7f67ac159340 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f67ac0721d0 tx=0x7f679c02a600 comp rx=0 tx=0).stop 2024-09-10T20:55:56.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.135+0000 7f0bfbe00640 1 -- 172.21.15.6:0/1033967773 shutdown_connections 2024-09-10T20:55:56.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.136+0000 7f67b1400640 1 -- 172.21.15.6:0/1028655717 shutdown_connections 2024-09-10T20:55:56.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.136+0000 7f67b1400640 1 --2- 172.21.15.6:0/1028655717 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f67ac0cbe80 0x7f67ac159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.136+0000 7f67b1400640 1 --2- 172.21.15.6:0/1028655717 >> v2:172.21.15.150:3300/0 conn(0x7f67ac0d0540 0x7f67ac159880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.136+0000 7f67b1400640 1 --2- 172.21.15.6:0/1028655717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67ac0cbaa0 0x7f67ac159340 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.136+0000 7f67b1400640 1 -- 172.21.15.6:0/1028655717 >> 172.21.15.6:0/1028655717 conn(0x7f67ac0cfa20 msgr2=0x7f67ac0cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:56.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.136+0000 7f0bfbe00640 1 -- 172.21.15.6:0/1033967773 wait complete. 2024-09-10T20:55:56.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.136+0000 7f67b1400640 1 -- 172.21.15.6:0/1028655717 shutdown_connections 2024-09-10T20:55:56.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.138+0000 7f0bfbe00640 1 Processor -- start 2024-09-10T20:55:56.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.138+0000 7f0bfbe00640 1 -- start start 2024-09-10T20:55:56.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.136+0000 7f67b1400640 1 -- 172.21.15.6:0/1028655717 wait complete. 2024-09-10T20:55:56.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.139+0000 7f67b1400640 1 Processor -- start 2024-09-10T20:55:56.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.140+0000 7f67b1400640 1 -- start start 2024-09-10T20:55:56.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.140+0000 7f0bfbe00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0bf4037a00 0x7f0bf4051d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:56.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.140+0000 7f0bfbe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0bf403a990 0x7f0bf404ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:56.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.140+0000 7f0bfbe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bf40e2bd0 0x7f0bf404f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:56.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.140+0000 7fb3b5000640 1 -- 172.21.15.6:0/797450573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3a80535b0 msgr2=0x7fb3a80511e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:56.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.140+0000 7fb3b5000640 1 --2- 172.21.15.6:0/797450573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3a80535b0 0x7fb3a80511e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8039af0 tx=0x7fb39c02a5a0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.140+0000 7f0bfbe00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf4057650 con 0x7f0bf40e2bd0 2024-09-10T20:55:56.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.141+0000 7fb3b5000640 1 -- 172.21.15.6:0/797450573 shutdown_connections 2024-09-10T20:55:56.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.141+0000 7fb3b5000640 1 --2- 172.21.15.6:0/797450573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3a80535b0 0x7fb3a80511e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.141+0000 7fb3b5000640 1 -- 172.21.15.6:0/797450573 >> 172.21.15.6:0/797450573 conn(0x7fb3a801f9b0 msgr2=0x7fb3a8056710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:56.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.140+0000 7f0bfbe00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf40574d0 con 0x7f0bf403a990 2024-09-10T20:55:56.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.140+0000 7f0bfbe00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f0bf40577d0 con 0x7f0bf4037a00 2024-09-10T20:55:56.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.141+0000 7f0bfb400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bf40e2bd0 0x7f0bf404f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:56.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.141+0000 7f0bfa000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0bf403a990 0x7f0bf404ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:56.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.141+0000 7f0bfb400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bf40e2bd0 0x7f0bf404f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51314/0 (socket says 172.21.15.6:51314) 2024-09-10T20:55:56.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.141+0000 7f0bfb400640 1 -- 172.21.15.6:0/3604490030 learned_addr learned my addr 172.21.15.6:0/3604490030 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:56.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.141+0000 7f0bfaa00640 1 --2- 172.21.15.6:0/3604490030 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0bf4037a00 0x7f0bf4051d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:56.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.141+0000 7f67b1400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67ac0cbaa0 0x7f67ac0c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:56.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.142+0000 7fb3b5000640 1 -- 172.21.15.6:0/797450573 shutdown_connections 2024-09-10T20:55:56.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.142+0000 7f0bfb400640 1 -- 172.21.15.6:0/3604490030 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0bf4037a00 msgr2=0x7f0bf4051d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:56.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.142+0000 7f0bfb400640 1 --2- 172.21.15.6:0/3604490030 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0bf4037a00 0x7f0bf4051d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.142+0000 7f0bfb400640 1 -- 172.21.15.6:0/3604490030 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0bf403a990 msgr2=0x7f0bf404ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:56.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.142+0000 7f0bfb400640 1 --2- 172.21.15.6:0/3604490030 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0bf403a990 0x7f0bf404ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.142+0000 7f0bfb400640 1 -- 172.21.15.6:0/3604490030 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bf40509c0 con 0x7f0bf40e2bd0 2024-09-10T20:55:56.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.142+0000 7f0bfa000640 1 --2- 172.21.15.6:0/3604490030 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0bf403a990 0x7f0bf404ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:55:56.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.142+0000 7f67b1400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f67ac0cbe80 0x7f67ac0c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:56.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.142+0000 7f67aa800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67ac0cbaa0 0x7f67ac0c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:56.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.142+0000 7f67aa800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67ac0cbaa0 0x7f67ac0c6af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51328/0 (socket says 172.21.15.6:51328) 2024-09-10T20:55:56.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.143+0000 7f67aa800640 1 -- 172.21.15.6:0/2438645561 learned_addr learned my addr 172.21.15.6:0/2438645561 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:56.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.143+0000 7f67b1400640 1 --2- 172.21.15.6:0/2438645561 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f67ac0d0540 0x7f67ac0c6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:56.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.143+0000 7f67b1400640 1 -- 172.21.15.6:0/2438645561 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f67ac070c60 con 0x7f67ac0cbaa0 2024-09-10T20:55:56.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.142+0000 7f0bfb400640 1 --2- 172.21.15.6:0/3604490030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bf40e2bd0 0x7f0bf404f150 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0be8009950 tx=0x7f0be8032b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:56.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.143+0000 7f67b1400640 1 -- 172.21.15.6:0/2438645561 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f67ac070ae0 con 0x7f67ac0cbe80 2024-09-10T20:55:56.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.143+0000 7f0bf2a00640 1 -- 172.21.15.6:0/3604490030 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be8040070 con 0x7f0bf40e2bd0 2024-09-10T20:55:56.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.143+0000 7f67b1400640 1 -- 172.21.15.6:0/2438645561 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f67ac0a0130 con 0x7f67ac0d0540 2024-09-10T20:55:56.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.143+0000 7f67ab200640 1 --2- 172.21.15.6:0/2438645561 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f67ac0d0540 0x7f67ac0c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:56.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.143+0000 7f67a9e00640 1 --2- 172.21.15.6:0/2438645561 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f67ac0cbe80 0x7f67ac0c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:56.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.143+0000 7f0bf2a00640 1 -- 172.21.15.6:0/3604490030 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0be8005220 con 0x7f0bf40e2bd0 2024-09-10T20:55:56.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.143+0000 7f0bf2a00640 1 -- 172.21.15.6:0/3604490030 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be80047a0 con 0x7f0bf40e2bd0 2024-09-10T20:55:56.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.144+0000 7f0bfbe00640 1 -- 172.21.15.6:0/3604490030 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bf4050c60 con 0x7f0bf40e2bd0 2024-09-10T20:55:56.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.144+0000 7f67ab200640 1 -- 172.21.15.6:0/2438645561 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f67ac0cbe80 msgr2=0x7f67ac0c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:56.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.144+0000 7f67ab200640 1 --2- 172.21.15.6:0/2438645561 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f67ac0cbe80 0x7f67ac0c5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.144+0000 7f67ab200640 1 -- 172.21.15.6:0/2438645561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67ac0cbaa0 msgr2=0x7f67ac0c6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:56.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.142+0000 7fb3b5000640 1 -- 172.21.15.6:0/797450573 wait complete. 2024-09-10T20:55:56.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.144+0000 7f0bfbe00640 1 -- 172.21.15.6:0/3604490030 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bf4051220 con 0x7f0bf40e2bd0 2024-09-10T20:55:56.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.144+0000 7fb3b5000640 1 Processor -- start 2024-09-10T20:55:56.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.145+0000 7fb3b5000640 1 -- start start 2024-09-10T20:55:56.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.146+0000 7f0bfbe00640 1 -- 172.21.15.6:0/3604490030 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bf4057cf0 con 0x7f0bf40e2bd0 2024-09-10T20:55:56.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.146+0000 7f67ab200640 1 --2- 172.21.15.6:0/2438645561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67ac0cbaa0 0x7f67ac0c6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.146+0000 7f67ab200640 1 -- 172.21.15.6:0/2438645561 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67ac0c65b0 con 0x7f67ac0d0540 2024-09-10T20:55:56.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.147+0000 7f67aa800640 1 --2- 172.21.15.6:0/2438645561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67ac0cbaa0 0x7f67ac0c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:55:56.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.147+0000 7f67ab200640 1 --2- 172.21.15.6:0/2438645561 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f67ac0d0540 0x7f67ac0c6070 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f679800e970 tx=0x7f679800ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:56.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.147+0000 7f67a2a00640 1 -- 172.21.15.6:0/2438645561 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f679800ccc0 con 0x7f67ac0d0540 2024-09-10T20:55:56.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.147+0000 7f67b1400640 1 -- 172.21.15.6:0/2438645561 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67ac073320 con 0x7f67ac0d0540 2024-09-10T20:55:56.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.148+0000 7f67a2a00640 1 -- 172.21.15.6:0/2438645561 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6798004020 con 0x7f67ac0d0540 2024-09-10T20:55:56.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.148+0000 7f67a2a00640 1 -- 172.21.15.6:0/2438645561 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6798004470 con 0x7f67ac0d0540 2024-09-10T20:55:56.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.148+0000 7f67b1400640 1 -- 172.21.15.6:0/2438645561 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f67ac0c7030 con 0x7f67ac0d0540 2024-09-10T20:55:56.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.149+0000 7fb3b5000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3a8051720 0x7fb3a804b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:56.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.149+0000 7fb3b5000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3a80535b0 0x7fb3a800bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:56.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.149+0000 7fb3b5000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3a80e3fa0 0x7fb3a800c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:56.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.149+0000 7fb3b5000640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a803a8a0 con 0x7fb3a80535b0 2024-09-10T20:55:56.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.149+0000 7fb3b5000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a803a720 con 0x7fb3a8051720 2024-09-10T20:55:56.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.149+0000 7fb3b5000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb3a803aa20 con 0x7fb3a80e3fa0 2024-09-10T20:55:56.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.150+0000 7fb3aea00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3a80535b0 0x7fb3a800bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:56.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.150+0000 7fb3aea00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3a80535b0 0x7fb3a800bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51332/0 (socket says 172.21.15.6:51332) 2024-09-10T20:55:56.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.150+0000 7fb3aea00640 1 -- 172.21.15.6:0/3891667793 learned_addr learned my addr 172.21.15.6:0/3891667793 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:56.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.150+0000 7fb3afe00640 1 --2- 172.21.15.6:0/3891667793 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3a80e3fa0 0x7fb3a800c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:56.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.150+0000 7fb3aea00640 1 -- 172.21.15.6:0/3891667793 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3a80e3fa0 msgr2=0x7fb3a800c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:56.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.150+0000 7fb3aea00640 1 --2- 172.21.15.6:0/3891667793 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3a80e3fa0 0x7fb3a800c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.150+0000 7fb3aea00640 1 -- 172.21.15.6:0/3891667793 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3a8051720 msgr2=0x7fb3a804b940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T20:55:56.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.150+0000 7fb3aea00640 1 --2- 172.21.15.6:0/3891667793 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3a8051720 0x7fb3a804b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.150+0000 7fb3aea00640 1 -- 172.21.15.6:0/3891667793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a80d9660 con 0x7fb3a80535b0 2024-09-10T20:55:56.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.151+0000 7fb3aea00640 1 --2- 172.21.15.6:0/3891667793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3a80535b0 0x7fb3a800bbf0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb39c02ab90 tx=0x7fb39c032fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:56.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.148+0000 7f0bf2a00640 1 -- 172.21.15.6:0/3604490030 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f0be8004940 con 0x7f0bf40e2bd0 2024-09-10T20:55:56.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.150+0000 7f0bf2a00640 1 --2- 172.21.15.6:0/3604490030 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f0bdc077f70 0x7f0bdc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:56.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.150+0000 7f0bf2a00640 1 -- 172.21.15.6:0/3604490030 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f0be80ba8e0 con 0x7f0bf40e2bd0 2024-09-10T20:55:56.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.151+0000 7f0bfaa00640 1 --2- 172.21.15.6:0/3604490030 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f0bdc077f70 0x7f0bdc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:56.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.152+0000 7f0bfaa00640 1 --2- 172.21.15.6:0/3604490030 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f0bdc077f70 0x7f0bdc07a430 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc052150 tx=0x7f0bfc06f040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:56.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.153+0000 7f67b1400640 1 -- 172.21.15.6:0/2438645561 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67ac1622c0 con 0x7f67ac0d0540 2024-09-10T20:55:56.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.154+0000 7f67a2a00640 1 -- 172.21.15.6:0/2438645561 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6798035bb0 con 0x7f67ac0d0540 2024-09-10T20:55:56.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.155+0000 7f0bf2a00640 1 -- 172.21.15.6:0/3604490030 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f0be804b070 con 0x7f0bf40e2bd0 2024-09-10T20:55:56.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.156+0000 7fb3a3400640 1 -- 172.21.15.6:0/3891667793 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39c040070 con 0x7fb3a80535b0 2024-09-10T20:55:56.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.156+0000 7fb3a3400640 1 -- 172.21.15.6:0/3891667793 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb39c003a00 con 0x7fb3a80535b0 2024-09-10T20:55:56.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.156+0000 7fb3b5000640 1 -- 172.21.15.6:0/3891667793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3a80d9940 con 0x7fb3a80535b0 2024-09-10T20:55:56.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.158+0000 7f67a2a00640 1 --2- 172.21.15.6:0/2438645561 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f678c077f70 0x7f678c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:56.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.158+0000 7f67a2a00640 1 -- 172.21.15.6:0/2438645561 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f6798099b90 con 0x7f67ac0d0540 2024-09-10T20:55:56.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.159+0000 7f67aa800640 1 --2- 172.21.15.6:0/2438645561 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f678c077f70 0x7f678c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:56.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.156+0000 7fb3b5000640 1 -- 172.21.15.6:0/3891667793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3a80d9f00 con 0x7fb3a80535b0 2024-09-10T20:55:56.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.158+0000 7fb3a3400640 1 -- 172.21.15.6:0/3891667793 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39c040070 con 0x7fb3a80535b0 2024-09-10T20:55:56.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.160+0000 7f67a2a00640 1 -- 172.21.15.6:0/2438645561 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f67ac1622c0 con 0x7f67ac0d0540 2024-09-10T20:55:56.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.161+0000 7fb3b5000640 1 -- 172.21.15.6:0/3891667793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb38c005290 con 0x7fb3a80535b0 2024-09-10T20:55:56.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.161+0000 7f67aa800640 1 --2- 172.21.15.6:0/2438645561 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f678c077f70 0x7f678c07a430 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f67ac072f50 tx=0x7f679c004730 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:56.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.162+0000 7fb3a3400640 1 -- 172.21.15.6:0/3891667793 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb39c003bb0 con 0x7fb3a80535b0 2024-09-10T20:55:56.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.164+0000 7fb3a3400640 1 --2- 172.21.15.6:0/3891667793 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb3900781a0 0x7fb39007a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:56.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.164+0000 7fb3a3400640 1 -- 172.21.15.6:0/3891667793 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb39c0baf80 con 0x7fb3a80535b0 2024-09-10T20:55:56.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.165+0000 7fb3af400640 1 --2- 172.21.15.6:0/3891667793 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb3900781a0 0x7fb39007a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:56.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.170+0000 7fb3af400640 1 --2- 172.21.15.6:0/3891667793 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb3900781a0 0x7fb39007a660 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb3a804d530 tx=0x7fb3a4006b50 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:56.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.173+0000 7fb3a3400640 1 -- 172.21.15.6:0/3891667793 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb39c0839e0 con 0x7fb3a80535b0 2024-09-10T20:55:56.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.502+0000 7f669f200640 1 -- 172.21.15.6:0/1023228467 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f6678005580 con 0x7f66a015e090 2024-09-10T20:55:56.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.503+0000 7f6696000640 1 -- 172.21.15.6:0/1023228467 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f668c083c90 con 0x7f66a015e090 2024-09-10T20:55:56.507 INFO:teuthology.orchestra.run.smithi006.stdout:64424509446 2024-09-10T20:55:56.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.505+0000 7f56c2600640 1 -- 172.21.15.6:0/4287952579 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f56b401d9a0 con 0x7f56b401e1e0 2024-09-10T20:55:56.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.505+0000 7f56b8c00640 1 -- 172.21.15.6:0/4287952579 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f56b0082ab0 con 0x7f56b401e1e0 2024-09-10T20:55:56.511 INFO:teuthology.orchestra.run.smithi006.stdout:64424509445 2024-09-10T20:55:56.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.506+0000 7f669f200640 1 -- 172.21.15.6:0/1023228467 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6680078170 msgr2=0x7f668007a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:56.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.506+0000 7f669f200640 1 --2- 172.21.15.6:0/1023228467 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6680078170 0x7f668007a630 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f66900046b0 tx=0x7f6690009040 comp rx=0 tx=0).stop 2024-09-10T20:55:56.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.506+0000 7f669f200640 1 -- 172.21.15.6:0/1023228467 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66a015e090 msgr2=0x7f66a0155df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:56.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.506+0000 7f669f200640 1 --2- 172.21.15.6:0/1023228467 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66a015e090 0x7f66a0155df0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f668c031000 tx=0x7f668c032c10 comp rx=0 tx=0).stop 2024-09-10T20:55:56.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.507+0000 7f669f200640 1 -- 172.21.15.6:0/1023228467 shutdown_connections 2024-09-10T20:55:56.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.507+0000 7f669f200640 1 --2- 172.21.15.6:0/1023228467 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6680078170 0x7f668007a630 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f66900046b0 tx=0x7f6690009040 comp rx=0 tx=0).stop 2024-09-10T20:55:56.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.507+0000 7f669f200640 1 --2- 172.21.15.6:0/1023228467 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66a015e090 0x7f66a0155df0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.507+0000 7f669f200640 1 --2- 172.21.15.6:0/1023228467 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66a015dcb0 0x7f66a0158c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.507+0000 7f669f200640 1 --2- 172.21.15.6:0/1023228467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66a00d0f60 0x7f66a0160a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.507+0000 7f669f200640 1 -- 172.21.15.6:0/1023228467 >> 172.21.15.6:0/1023228467 conn(0x7f66a009d100 msgr2=0x7f66a006ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:56.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.508+0000 7f669f200640 1 -- 172.21.15.6:0/1023228467 shutdown_connections 2024-09-10T20:55:56.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.508+0000 7f669f200640 1 -- 172.21.15.6:0/1023228467 wait complete. 2024-09-10T20:55:56.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.510+0000 7f56c2600640 1 -- 172.21.15.6:0/4287952579 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f569c078070 msgr2=0x7f569c07a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:56.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.510+0000 7f56c2600640 1 --2- 172.21.15.6:0/4287952579 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f569c078070 0x7f569c07a530 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f56a8001c00 tx=0x7f56a8001b90 comp rx=0 tx=0).stop 2024-09-10T20:55:56.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.510+0000 7f56c2600640 1 -- 172.21.15.6:0/4287952579 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56b401e1e0 msgr2=0x7f56b40dc490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:56.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.510+0000 7f56c2600640 1 --2- 172.21.15.6:0/4287952579 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56b401e1e0 0x7f56b40dc490 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f56b002b4b0 tx=0x7f56b0033c10 comp rx=0 tx=0).stop 2024-09-10T20:55:56.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.510+0000 7f56c2600640 1 -- 172.21.15.6:0/4287952579 shutdown_connections 2024-09-10T20:55:56.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.510+0000 7f56c2600640 1 --2- 172.21.15.6:0/4287952579 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f569c078070 0x7f569c07a530 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.510+0000 7f56c2600640 1 --2- 172.21.15.6:0/4287952579 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56b4037e30 0x7f56b40382b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.510+0000 7f56c2600640 1 --2- 172.21.15.6:0/4287952579 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56b401e1e0 0x7f56b40dc490 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.510+0000 7f56c2600640 1 --2- 172.21.15.6:0/4287952579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56a4004800 0x7f56b404f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.510+0000 7f56c2600640 1 -- 172.21.15.6:0/4287952579 >> 172.21.15.6:0/4287952579 conn(0x7f56b4054560 msgr2=0x7f56b4054940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:56.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.511+0000 7f56c2600640 1 -- 172.21.15.6:0/4287952579 shutdown_connections 2024-09-10T20:55:56.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.511+0000 7f56c2600640 1 -- 172.21.15.6:0/4287952579 wait complete. 2024-09-10T20:55:56.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.528+0000 7f2207e00640 1 -- 172.21.15.6:0/1152678406 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f22081607d0 con 0x7f22080cc7b0 2024-09-10T20:55:56.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.528+0000 7f21fea00640 1 -- 172.21.15.6:0/1152678406 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f21f8066790 con 0x7f22080cc7b0 2024-09-10T20:55:56.536 INFO:teuthology.orchestra.run.smithi006.stdout:64424509445 2024-09-10T20:55:56.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.532+0000 7f2207e00640 1 -- 172.21.15.6:0/1152678406 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f21e8078040 msgr2=0x7f21e807a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:56.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.532+0000 7f2207e00640 1 --2- 172.21.15.6:0/1152678406 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f21e8078040 0x7f21e807a500 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2208144ed0 tx=0x7f21f4009040 comp rx=0 tx=0).stop 2024-09-10T20:55:56.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.532+0000 7f2207e00640 1 -- 172.21.15.6:0/1152678406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22080cc7b0 msgr2=0x7f22080af3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:56.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.532+0000 7f2207e00640 1 --2- 172.21.15.6:0/1152678406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22080cc7b0 0x7f22080af3a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f21f800b410 tx=0x7f21f800b8d0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.533+0000 7f2207e00640 1 -- 172.21.15.6:0/1152678406 shutdown_connections 2024-09-10T20:55:56.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.533+0000 7f2207e00640 1 --2- 172.21.15.6:0/1152678406 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f21e8078040 0x7f21e807a500 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.533+0000 7f2207e00640 1 --2- 172.21.15.6:0/1152678406 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2208158050 0x7f22081549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.533+0000 7f2207e00640 1 --2- 172.21.15.6:0/1152678406 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22080ce500 0x7f22081f4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.533+0000 7f2207e00640 1 --2- 172.21.15.6:0/1152678406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22080cc7b0 0x7f22080af3a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.533+0000 7f2207e00640 1 -- 172.21.15.6:0/1152678406 >> 172.21.15.6:0/1152678406 conn(0x7f220806d230 msgr2=0x7f2208161650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:56.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.533+0000 7f2207e00640 1 -- 172.21.15.6:0/1152678406 shutdown_connections 2024-09-10T20:55:56.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.533+0000 7f2207e00640 1 -- 172.21.15.6:0/1152678406 wait complete. 2024-09-10T20:55:56.540 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.1 2024-09-10T20:55:56.542 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.0 2024-09-10T20:55:56.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.543+0000 7fbb09a00640 1 -- 172.21.15.6:0/1634439298 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fbb040cf620 con 0x7fbb040d0330 2024-09-10T20:55:56.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.543+0000 7fbafaa00640 1 -- 172.21.15.6:0/1634439298 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbaf4087400 con 0x7fbb040d0330 2024-09-10T20:55:56.547 INFO:teuthology.orchestra.run.smithi006.stdout:60129542150 2024-09-10T20:55:56.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.547+0000 7fbb09a00640 1 -- 172.21.15.6:0/1634439298 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbae4077f70 msgr2=0x7fbae407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:56.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.547+0000 7fbb09a00640 1 --2- 172.21.15.6:0/1634439298 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbae4077f70 0x7fbae407a430 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbb0408df70 tx=0x7fbaf0005f90 comp rx=0 tx=0).stop 2024-09-10T20:55:56.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.548+0000 7fbb09a00640 1 -- 172.21.15.6:0/1634439298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb040d0330 msgr2=0x7fbb040c84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:56.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.548+0000 7fbb09a00640 1 --2- 172.21.15.6:0/1634439298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb040d0330 0x7fbb040c84a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4006010 tx=0x7fbaf40038a0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.548+0000 7fbb09a00640 1 -- 172.21.15.6:0/1634439298 shutdown_connections 2024-09-10T20:55:56.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.548+0000 7fbb09a00640 1 --2- 172.21.15.6:0/1634439298 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbae4077f70 0x7fbae407a430 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.548+0000 7fbb09a00640 1 --2- 172.21.15.6:0/1634439298 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb04162400 0x7fbb040c9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.548+0000 7fbb09a00640 1 --2- 172.21.15.6:0/1634439298 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb040d0cb0 0x7fbb04158ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.548+0000 7fbb09a00640 1 --2- 172.21.15.6:0/1634439298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb040d0330 0x7fbb040c84a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.548+0000 7fbb09a00640 1 -- 172.21.15.6:0/1634439298 >> 172.21.15.6:0/1634439298 conn(0x7fbb0409d0c0 msgr2=0x7fbb040b7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:56.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.548+0000 7fbb09a00640 1 -- 172.21.15.6:0/1634439298 shutdown_connections 2024-09-10T20:55:56.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.548+0000 7fbb09a00640 1 -- 172.21.15.6:0/1634439298 wait complete. 2024-09-10T20:55:56.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.554+0000 7f9f2b200640 1 -- 172.21.15.6:0/2953688010 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f9f1c00ab40 con 0x7f9f1c053990 2024-09-10T20:55:56.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.555+0000 7f9f17e00640 1 -- 172.21.15.6:0/2953688010 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9f1c032980 con 0x7f9f1c053990 2024-09-10T20:55:56.559 INFO:teuthology.orchestra.run.smithi006.stdout:64424509446 2024-09-10T20:55:56.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.557+0000 7f9f2b200640 1 -- 172.21.15.6:0/2953688010 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f9f04077fc0 msgr2=0x7f9f0407a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:56.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.557+0000 7f9f2b200640 1 --2- 172.21.15.6:0/2953688010 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f9f04077fc0 0x7f9f0407a480 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9f2407ae40 tx=0x7f9f2406f040 comp rx=0 tx=0).stop 2024-09-10T20:55:56.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.557+0000 7f9f2b200640 1 -- 172.21.15.6:0/2953688010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f1c053990 msgr2=0x7f9f1c0e03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:56.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.557+0000 7f9f2b200640 1 --2- 172.21.15.6:0/2953688010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f1c053990 0x7f9f1c0e03c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c00ba80 tx=0x7f9f18032c10 comp rx=0 tx=0).stop 2024-09-10T20:55:56.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.558+0000 7f9f2b200640 1 -- 172.21.15.6:0/2953688010 shutdown_connections 2024-09-10T20:55:56.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.558+0000 7f9f2b200640 1 --2- 172.21.15.6:0/2953688010 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f9f04077fc0 0x7f9f0407a480 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.558+0000 7f9f2b200640 1 --2- 172.21.15.6:0/2953688010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f1c053990 0x7f9f1c0e03c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.558+0000 7f9f2b200640 1 --2- 172.21.15.6:0/2953688010 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f1c0069a0 0x7f9f1c0e1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.558+0000 7f9f2b200640 1 --2- 172.21.15.6:0/2953688010 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f1c00ad60 0x7f9f1c0dfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.558+0000 7f9f2b200640 1 -- 172.21.15.6:0/2953688010 >> 172.21.15.6:0/2953688010 conn(0x7f9f1c054550 msgr2=0x7f9f1c033eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:56.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.558+0000 7f9f2b200640 1 -- 172.21.15.6:0/2953688010 shutdown_connections 2024-09-10T20:55:56.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.558+0000 7f9f2b200640 1 -- 172.21.15.6:0/2953688010 wait complete. 2024-09-10T20:55:56.564 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.2 2024-09-10T20:55:56.580 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.3 2024-09-10T20:55:56.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.578+0000 7f0bfbe00640 1 -- 172.21.15.6:0/3604490030 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f0bf40e6c90 con 0x7f0bf40e2bd0 2024-09-10T20:55:56.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.579+0000 7f0bf2a00640 1 -- 172.21.15.6:0/3604490030 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0be8083340 con 0x7f0bf40e2bd0 2024-09-10T20:55:56.583 INFO:teuthology.orchestra.run.smithi006.stdout:64424509445 2024-09-10T20:55:56.585 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.5 2024-09-10T20:55:56.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.581+0000 7f67b1400640 1 -- 172.21.15.6:0/2438645561 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f67ac0a0650 con 0x7f67ac0d0540 2024-09-10T20:55:56.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.581+0000 7f0bfbe00640 1 -- 172.21.15.6:0/3604490030 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f0bdc077f70 msgr2=0x7f0bdc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:56.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.581+0000 7f0bfbe00640 1 --2- 172.21.15.6:0/3604490030 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f0bdc077f70 0x7f0bdc07a430 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc052150 tx=0x7f0bfc06f040 comp rx=0 tx=0).stop 2024-09-10T20:55:56.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.581+0000 7f0bfbe00640 1 -- 172.21.15.6:0/3604490030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bf40e2bd0 msgr2=0x7f0bf404f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:56.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.581+0000 7f0bfbe00640 1 --2- 172.21.15.6:0/3604490030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bf40e2bd0 0x7f0bf404f150 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0be8009950 tx=0x7f0be8032b90 comp rx=0 tx=0).stop 2024-09-10T20:55:56.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.581+0000 7f0bfbe00640 1 -- 172.21.15.6:0/3604490030 shutdown_connections 2024-09-10T20:55:56.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.581+0000 7f0bfbe00640 1 --2- 172.21.15.6:0/3604490030 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f0bdc077f70 0x7f0bdc07a430 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.581+0000 7f0bfbe00640 1 --2- 172.21.15.6:0/3604490030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bf40e2bd0 0x7f0bf404f150 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.581+0000 7f0bfbe00640 1 --2- 172.21.15.6:0/3604490030 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0bf403a990 0x7f0bf404ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.582+0000 7f0bfbe00640 1 --2- 172.21.15.6:0/3604490030 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0bf4037a00 0x7f0bf4051d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.582+0000 7f0bfbe00640 1 -- 172.21.15.6:0/3604490030 >> 172.21.15.6:0/3604490030 conn(0x7f0bf4055590 msgr2=0x7f0bf4005ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:56.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.582+0000 7f67a2a00640 1 -- 172.21.15.6:0/2438645561 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f67ac0c65b0 con 0x7f67ac0d0540 2024-09-10T20:55:56.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.582+0000 7f0bfbe00640 1 -- 172.21.15.6:0/3604490030 shutdown_connections 2024-09-10T20:55:56.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.582+0000 7f0bfbe00640 1 -- 172.21.15.6:0/3604490030 wait complete. 2024-09-10T20:55:56.588 INFO:teuthology.orchestra.run.smithi006.stdout:64424509445 2024-09-10T20:55:56.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.584+0000 7f67b1400640 1 -- 172.21.15.6:0/2438645561 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f678c077f70 msgr2=0x7f678c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:56.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.584+0000 7f67b1400640 1 --2- 172.21.15.6:0/2438645561 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f678c077f70 0x7f678c07a430 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f67ac072f50 tx=0x7f679c004730 comp rx=0 tx=0).stop 2024-09-10T20:55:56.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.584+0000 7f67b1400640 1 -- 172.21.15.6:0/2438645561 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f67ac0d0540 msgr2=0x7f67ac0c6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:56.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.584+0000 7f67b1400640 1 --2- 172.21.15.6:0/2438645561 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f67ac0d0540 0x7f67ac0c6070 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f679800e970 tx=0x7f679800ee30 comp rx=0 tx=0).stop 2024-09-10T20:55:56.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.585+0000 7f67b1400640 1 -- 172.21.15.6:0/2438645561 shutdown_connections 2024-09-10T20:55:56.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.585+0000 7f67b1400640 1 --2- 172.21.15.6:0/2438645561 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f678c077f70 0x7f678c07a430 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.585+0000 7f67b1400640 1 --2- 172.21.15.6:0/2438645561 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f67ac0d0540 0x7f67ac0c6070 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.585+0000 7f67b1400640 1 --2- 172.21.15.6:0/2438645561 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f67ac0cbe80 0x7f67ac0c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.585+0000 7f67b1400640 1 --2- 172.21.15.6:0/2438645561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67ac0cbaa0 0x7f67ac0c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.585+0000 7f67b1400640 1 -- 172.21.15.6:0/2438645561 >> 172.21.15.6:0/2438645561 conn(0x7f67ac0cfa20 msgr2=0x7f67ac159a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:56.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.585+0000 7f67b1400640 1 -- 172.21.15.6:0/2438645561 shutdown_connections 2024-09-10T20:55:56.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.585+0000 7f67b1400640 1 -- 172.21.15.6:0/2438645561 wait complete. 2024-09-10T20:55:56.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.586+0000 7fb3b5000640 1 -- 172.21.15.6:0/3891667793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fb38c005580 con 0x7fb3a80535b0 2024-09-10T20:55:56.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.586+0000 7fb3a3400640 1 -- 172.21.15.6:0/3891667793 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb39c08c100 con 0x7fb3a80535b0 2024-09-10T20:55:56.591 INFO:teuthology.orchestra.run.smithi006.stdout:64424509447 2024-09-10T20:55:56.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.589+0000 7fb3b5000640 1 -- 172.21.15.6:0/3891667793 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb3900781a0 msgr2=0x7fb39007a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:56.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.589+0000 7fb3b5000640 1 --2- 172.21.15.6:0/3891667793 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb3900781a0 0x7fb39007a660 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb3a804d530 tx=0x7fb3a4006b50 comp rx=0 tx=0).stop 2024-09-10T20:55:56.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.589+0000 7fb3b5000640 1 -- 172.21.15.6:0/3891667793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3a80535b0 msgr2=0x7fb3a800bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:56.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.589+0000 7fb3b5000640 1 --2- 172.21.15.6:0/3891667793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3a80535b0 0x7fb3a800bbf0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb39c02ab90 tx=0x7fb39c032fb0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.589+0000 7fb3b5000640 1 -- 172.21.15.6:0/3891667793 shutdown_connections 2024-09-10T20:55:56.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.589+0000 7fb3b5000640 1 --2- 172.21.15.6:0/3891667793 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb3900781a0 0x7fb39007a660 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.589+0000 7fb3b5000640 1 --2- 172.21.15.6:0/3891667793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3a80535b0 0x7fb3a800bbf0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.589+0000 7fb3b5000640 1 --2- 172.21.15.6:0/3891667793 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3a80e3fa0 0x7fb3a800c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.589+0000 7fb3b5000640 1 --2- 172.21.15.6:0/3891667793 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3a8051720 0x7fb3a804b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:56.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.589+0000 7fb3b5000640 1 -- 172.21.15.6:0/3891667793 >> 172.21.15.6:0/3891667793 conn(0x7fb3a801f9b0 msgr2=0x7fb3a80db030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:56.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.589+0000 7fb3b5000640 1 -- 172.21.15.6:0/3891667793 shutdown_connections 2024-09-10T20:55:56.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:56.590+0000 7fb3b5000640 1 -- 172.21.15.6:0/3891667793 wait complete. 2024-09-10T20:55:56.605 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.6 2024-09-10T20:55:56.607 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.4 2024-09-10T20:55:56.611 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.7 2024-09-10T20:55:57.542 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T20:55:57.542 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T20:55:57.565 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T20:55:57.581 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-10T20:55:57.586 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-10T20:55:57.606 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-10T20:55:57.608 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-10T20:55:57.612 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-10T20:55:57.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.798+0000 7f6009600640 1 -- 172.21.15.6:0/2594137451 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f600406fd50 msgr2=0x7f60040c4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:57.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.798+0000 7f6009600640 1 --2- 172.21.15.6:0/2594137451 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f600406fd50 0x7f60040c4780 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5ff0005fd0 tx=0x7f5ff002a5e0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.798+0000 7f6009600640 1 -- 172.21.15.6:0/2594137451 shutdown_connections 2024-09-10T20:55:57.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.799+0000 7f6009600640 1 --2- 172.21.15.6:0/2594137451 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f600406fd50 0x7f60040c4780 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.799+0000 7f6009600640 1 -- 172.21.15.6:0/2594137451 >> 172.21.15.6:0/2594137451 conn(0x7f600406d230 msgr2=0x7f60040b1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:57.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.799+0000 7f6009600640 1 -- 172.21.15.6:0/2594137451 shutdown_connections 2024-09-10T20:55:57.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.799+0000 7f6009600640 1 -- 172.21.15.6:0/2594137451 wait complete. 2024-09-10T20:55:57.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.800+0000 7f5c49a00640 1 -- 172.21.15.6:0/2912632941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c28004360 msgr2=0x7f5c2800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:57.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.800+0000 7f5c41600640 1 -- 172.21.15.6:0/2912632941 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c30006ae0 con 0x7f5c28004360 2024-09-10T20:55:57.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.800+0000 7f5c49a00640 1 --2- 172.21.15.6:0/2912632941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c28004360 0x7f5c2800b9c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5c30006e80 tx=0x7f5c28005830 comp rx=0 tx=0).stop 2024-09-10T20:55:57.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.801+0000 7f5c49a00640 1 -- 172.21.15.6:0/2912632941 shutdown_connections 2024-09-10T20:55:57.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.801+0000 7f5c49a00640 1 --2- 172.21.15.6:0/2912632941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c28004360 0x7f5c2800b9c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.801+0000 7f5c49a00640 1 -- 172.21.15.6:0/2912632941 >> 172.21.15.6:0/2912632941 conn(0x7f5c4406d230 msgr2=0x7f5c440b1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:57.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.801+0000 7f5c49a00640 1 -- 172.21.15.6:0/2912632941 shutdown_connections 2024-09-10T20:55:57.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.802+0000 7f5c49a00640 1 -- 172.21.15.6:0/2912632941 wait complete. 2024-09-10T20:55:57.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.804+0000 7f6009600640 1 Processor -- start 2024-09-10T20:55:57.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.804+0000 7f6009600640 1 -- start start 2024-09-10T20:55:57.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.805+0000 7f5c49a00640 1 Processor -- start 2024-09-10T20:55:57.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.805+0000 7f5c49a00640 1 -- start start 2024-09-10T20:55:57.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.806+0000 7f6009600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f600406fd50 0x7f6004155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.806+0000 7f6009600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60040cc090 0x7f60040c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.806+0000 7f6009600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6004154020 0x7f60040c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.806+0000 7f6009600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f60041545f0 con 0x7f600406fd50 2024-09-10T20:55:57.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.806+0000 7f6009600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f60040b1e30 con 0x7f6004154020 2024-09-10T20:55:57.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.806+0000 7f6009600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f600406ea20 con 0x7f60040cc090 2024-09-10T20:55:57.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.806+0000 7f6002000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60040cc090 0x7f60040c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.806+0000 7f6002000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60040cc090 0x7f60040c81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.6:44478/0 (socket says 172.21.15.6:44478) 2024-09-10T20:55:57.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.806+0000 7f6002000640 1 -- 172.21.15.6:0/2511264542 learned_addr learned my addr 172.21.15.6:0/2511264542 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:57.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.806+0000 7f6003400640 1 --2- 172.21.15.6:0/2511264542 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6004154020 0x7f60040c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.806+0000 7f6002a00640 1 --2- 172.21.15.6:0/2511264542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f600406fd50 0x7f6004155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.807+0000 7f6002a00640 1 -- 172.21.15.6:0/2511264542 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60040cc090 msgr2=0x7f60040c81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:57.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.807+0000 7f6002a00640 1 --2- 172.21.15.6:0/2511264542 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60040cc090 0x7f60040c81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.807+0000 7f6002a00640 1 -- 172.21.15.6:0/2511264542 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6004154020 msgr2=0x7f60040c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:57.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.807+0000 7f6002a00640 1 --2- 172.21.15.6:0/2511264542 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6004154020 0x7f60040c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.807+0000 7f6002a00640 1 -- 172.21.15.6:0/2511264542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6004155c20 con 0x7f600406fd50 2024-09-10T20:55:57.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.808+0000 7f6002a00640 1 --2- 172.21.15.6:0/2511264542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f600406fd50 0x7f6004155210 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5ff400c730 tx=0x7f5ff400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:57.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.808+0000 7f5ffaa00640 1 -- 172.21.15.6:0/2511264542 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff40050d0 con 0x7f600406fd50 2024-09-10T20:55:57.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.809+0000 7f5ffaa00640 1 -- 172.21.15.6:0/2511264542 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ff4005270 con 0x7f600406fd50 2024-09-10T20:55:57.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.809+0000 7f5ffaa00640 1 -- 172.21.15.6:0/2511264542 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff40050d0 con 0x7f600406fd50 2024-09-10T20:55:57.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.810+0000 7f6009600640 1 -- 172.21.15.6:0/2511264542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60040b2a60 con 0x7f600406fd50 2024-09-10T20:55:57.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.811+0000 7f5c49a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c28004360 0x7f5c440c9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.811+0000 7f6009600640 1 -- 172.21.15.6:0/2511264542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6004155750 con 0x7f600406fd50 2024-09-10T20:55:57.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.811+0000 7f5c49a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c440b4370 0x7f5c4412fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.811+0000 7f5c49a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c441302b0 0x7f5c441fbd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.811+0000 7f5c42a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c28004360 0x7f5c440c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.811+0000 7f5c42a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c28004360 0x7f5c440c9230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51360/0 (socket says 172.21.15.6:51360) 2024-09-10T20:55:57.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.812+0000 7f5c42a00640 1 -- 172.21.15.6:0/3764342005 learned_addr learned my addr 172.21.15.6:0/3764342005 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:57.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.812+0000 7f5c49a00640 1 -- 172.21.15.6:0/3764342005 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5c440cc6c0 con 0x7f5c28004360 2024-09-10T20:55:57.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.812+0000 7f5c49a00640 1 -- 172.21.15.6:0/3764342005 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5c440cc540 con 0x7f5c441302b0 2024-09-10T20:55:57.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.812+0000 7f5c49a00640 1 -- 172.21.15.6:0/3764342005 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f5c440cc840 con 0x7f5c440b4370 2024-09-10T20:55:57.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.812+0000 7f5c43400640 1 --2- 172.21.15.6:0/3764342005 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c441302b0 0x7f5c441fbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.813+0000 7f5c42a00640 1 -- 172.21.15.6:0/3764342005 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c440b4370 msgr2=0x7f5c4412fd70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T20:55:57.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.813+0000 7f5c42a00640 1 --2- 172.21.15.6:0/3764342005 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c440b4370 0x7f5c4412fd70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.813+0000 7f5c42a00640 1 -- 172.21.15.6:0/3764342005 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c441302b0 msgr2=0x7f5c441fbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:57.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.813+0000 7f5c42a00640 1 --2- 172.21.15.6:0/3764342005 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c441302b0 0x7f5c441fbd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.813+0000 7f5c42a00640 1 -- 172.21.15.6:0/3764342005 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c440b4830 con 0x7f5c28004360 2024-09-10T20:55:57.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.814+0000 7f5c42a00640 1 --2- 172.21.15.6:0/3764342005 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c28004360 0x7f5c440c9230 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5c3400d960 tx=0x7f5c3400de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:57.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.815+0000 7f5c3aa00640 1 -- 172.21.15.6:0/3764342005 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c34008c20 con 0x7f5c28004360 2024-09-10T20:55:57.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.815+0000 7f5c49a00640 1 -- 172.21.15.6:0/3764342005 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c440b4b10 con 0x7f5c28004360 2024-09-10T20:55:57.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.816+0000 7f5c49a00640 1 -- 172.21.15.6:0/3764342005 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c440b50d0 con 0x7f5c28004360 2024-09-10T20:55:57.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.816+0000 7f5c3aa00640 1 -- 172.21.15.6:0/3764342005 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c34017420 con 0x7f5c28004360 2024-09-10T20:55:57.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.816+0000 7f5c3aa00640 1 -- 172.21.15.6:0/3764342005 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c34008c20 con 0x7f5c28004360 2024-09-10T20:55:57.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.817+0000 7f5fefe00640 1 -- 172.21.15.6:0/2511264542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fd8005290 con 0x7f600406fd50 2024-09-10T20:55:57.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.818+0000 7f5ffaa00640 1 -- 172.21.15.6:0/2511264542 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5ff400a640 con 0x7f600406fd50 2024-09-10T20:55:57.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.822+0000 7f5c3aa00640 1 -- 172.21.15.6:0/3764342005 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5c34017610 con 0x7f5c28004360 2024-09-10T20:55:57.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.824+0000 7f5c49a00640 1 -- 172.21.15.6:0/3764342005 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c1c005290 con 0x7f5c28004360 2024-09-10T20:55:57.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.825+0000 7f5c3aa00640 1 --2- 172.21.15.6:0/3764342005 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5c24078170 0x7f5c2407a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.825+0000 7f5c3aa00640 1 -- 172.21.15.6:0/3764342005 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f5c3409a2c0 con 0x7f5c28004360 2024-09-10T20:55:57.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.826+0000 7f5c42000640 1 --2- 172.21.15.6:0/3764342005 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5c24078170 0x7f5c2407a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.826+0000 7f5ffaa00640 1 --2- 172.21.15.6:0/2511264542 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5fe40781a0 0x7f5fe407a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.826+0000 7f5ffaa00640 1 -- 172.21.15.6:0/2511264542 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f5ff4099340 con 0x7f600406fd50 2024-09-10T20:55:57.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.828+0000 7f5c42000640 1 --2- 172.21.15.6:0/3764342005 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5c24078170 0x7f5c2407a630 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c006fd0 tx=0x7f5c3c0069e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:57.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.827+0000 7f6002000640 1 --2- 172.21.15.6:0/2511264542 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5fe40781a0 0x7f5fe407a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.829+0000 7f6002000640 1 --2- 172.21.15.6:0/2511264542 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5fe40781a0 0x7f5fe407a660 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5ff0000c00 tx=0x7f5ff0004730 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:57.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.833+0000 7f5ffaa00640 1 -- 172.21.15.6:0/2511264542 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5ff4061ed0 con 0x7f600406fd50 2024-09-10T20:55:57.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.840+0000 7f5c3aa00640 1 -- 172.21.15.6:0/3764342005 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5c34062d20 con 0x7f5c28004360 2024-09-10T20:55:57.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.857+0000 7f8daaa00640 1 -- 172.21.15.6:0/502839991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d8c003440 msgr2=0x7f8d8c0038f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:57.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.857+0000 7f8daaa00640 1 --2- 172.21.15.6:0/502839991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d8c003440 0x7f8d8c0038f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8da407ad90 tx=0x7f8d8c006940 comp rx=0 tx=0).stop 2024-09-10T20:55:57.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.857+0000 7f8daaa00640 1 -- 172.21.15.6:0/502839991 shutdown_connections 2024-09-10T20:55:57.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.858+0000 7f8daaa00640 1 --2- 172.21.15.6:0/502839991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d8c003440 0x7f8d8c0038f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.858+0000 7f8daaa00640 1 -- 172.21.15.6:0/502839991 >> 172.21.15.6:0/502839991 conn(0x7f8d9c054560 msgr2=0x7f8d9c054940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:57.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.858+0000 7f8daaa00640 1 -- 172.21.15.6:0/502839991 shutdown_connections 2024-09-10T20:55:57.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.858+0000 7f8daaa00640 1 -- 172.21.15.6:0/502839991 wait complete. 2024-09-10T20:55:57.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.858+0000 7fd867e00640 1 -- 172.21.15.6:0/564410858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd84c003bc0 msgr2=0x7fd84c003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:57.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.858+0000 7fd867e00640 1 --2- 172.21.15.6:0/564410858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd84c003bc0 0x7fd84c003fa0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd858006e70 tx=0x7fd84c005830 comp rx=0 tx=0).stop 2024-09-10T20:55:57.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.858+0000 7fd867400640 1 -- 172.21.15.6:0/564410858 reap_dead start 2024-09-10T20:55:57.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.859+0000 7fd867e00640 1 -- 172.21.15.6:0/564410858 shutdown_connections 2024-09-10T20:55:57.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.859+0000 7fd867e00640 1 -- 172.21.15.6:0/564410858 >> 172.21.15.6:0/564410858 conn(0x7fd86809d100 msgr2=0x7fd8680d3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:57.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.859+0000 7fd867e00640 1 -- 172.21.15.6:0/564410858 shutdown_connections 2024-09-10T20:55:57.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.859+0000 7fd867e00640 1 -- 172.21.15.6:0/564410858 wait complete. 2024-09-10T20:55:57.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.862+0000 7f8daaa00640 1 Processor -- start 2024-09-10T20:55:57.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.862+0000 7f8daaa00640 1 -- start start 2024-09-10T20:55:57.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.862+0000 7fd867e00640 1 Processor -- start 2024-09-10T20:55:57.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.863+0000 7fd867e00640 1 -- start start 2024-09-10T20:55:57.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.865+0000 7f8daaa00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d8c003440 0x7f8d9c16d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.865+0000 7f8daaa00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d9c021c30 0x7f8d9c0dca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.865+0000 7f8daaa00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d9c04d140 0x7f8d9c04d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.865+0000 7f8daaa00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8d9c00bcd0 con 0x7f8d9c04d140 2024-09-10T20:55:57.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.865+0000 7f8daaa00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8d9c01d380 con 0x7f8d9c021c30 2024-09-10T20:55:57.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.865+0000 7f8daaa00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8d9c0361f0 con 0x7f8d8c003440 2024-09-10T20:55:57.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.865+0000 7fd867e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd84c003bc0 0x7fd8681598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.865+0000 7fb8f3200640 1 -- 172.21.15.6:0/1294775054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8ec0d0330 msgr2=0x7fb8ec0d0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:57.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.865+0000 7fb8f3200640 1 --2- 172.21.15.6:0/1294775054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8ec0d0330 0x7fb8ec0d0770 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4005fd0 tx=0x7fb8e402aa30 comp rx=0 tx=0).stop 2024-09-10T20:55:57.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.865+0000 7fd866a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd84c003bc0 0x7fd8681598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.866+0000 7fd867e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd868159e10 0x7fd868157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.866+0000 7fb8f3200640 1 -- 172.21.15.6:0/1294775054 shutdown_connections 2024-09-10T20:55:57.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.866+0000 7fb8f3200640 1 --2- 172.21.15.6:0/1294775054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8ec0d0330 0x7fb8ec0d0770 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.866+0000 7fb8f3200640 1 --2- 172.21.15.6:0/1294775054 >> v2:172.21.15.6:3300/0 conn(0x7fb8ec162400 0x7fb8ec0d4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.866+0000 7fb8f3200640 1 -- 172.21.15.6:0/1294775054 >> 172.21.15.6:0/1294775054 conn(0x7fb8ec09d0c0 msgr2=0x7fb8ec0d3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:57.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.866+0000 7fd867e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd868157d70 0x7fd8681f72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.865+0000 7f8da8c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d9c021c30 0x7f8d9c0dca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.866+0000 7f8da9600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d8c003440 0x7f8d9c16d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.866+0000 7fd866a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd84c003bc0 0x7fd8681598d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56096/0 (socket says 172.21.15.6:56096) 2024-09-10T20:55:57.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.866+0000 7fd866000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd868159e10 0x7fd868157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.866+0000 7fd866000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd868159e10 0x7fd868157830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.6:34714/0 (socket says 172.21.15.6:34714) 2024-09-10T20:55:57.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.866+0000 7fb8f3200640 1 -- 172.21.15.6:0/1294775054 shutdown_connections 2024-09-10T20:55:57.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.866+0000 7f8da9600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d8c003440 0x7f8d9c16d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.6:41428/0 (socket says 172.21.15.6:41428) 2024-09-10T20:55:57.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.866+0000 7f8da9600640 1 -- 172.21.15.6:0/1436294210 learned_addr learned my addr 172.21.15.6:0/1436294210 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:57.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.866+0000 7fd866000640 1 -- 172.21.15.6:0/3122140203 learned_addr learned my addr 172.21.15.6:0/3122140203 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:57.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.866+0000 7fd867e00640 1 -- 172.21.15.6:0/3122140203 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd8681621d0 con 0x7fd84c003bc0 2024-09-10T20:55:57.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.866+0000 7fd867400640 1 --2- 172.21.15.6:0/3122140203 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd868157d70 0x7fd8681f72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.867+0000 7fd867e00640 1 -- 172.21.15.6:0/3122140203 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd868162050 con 0x7fd868159e10 2024-09-10T20:55:57.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.867+0000 7fd867e00640 1 -- 172.21.15.6:0/3122140203 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd868162350 con 0x7fd868157d70 2024-09-10T20:55:57.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.867+0000 7f8daa000640 1 --2- 172.21.15.6:0/1436294210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d9c04d140 0x7f8d9c04d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.867+0000 7f8da9600640 1 -- 172.21.15.6:0/1436294210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d9c021c30 msgr2=0x7f8d9c0dca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:57.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.867+0000 7f8da9600640 1 --2- 172.21.15.6:0/1436294210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d9c021c30 0x7f8d9c0dca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.867+0000 7f8da9600640 1 -- 172.21.15.6:0/1436294210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d9c04d140 msgr2=0x7f8d9c04d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:57.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.867+0000 7f8da9600640 1 --2- 172.21.15.6:0/1436294210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d9c04d140 0x7f8d9c04d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.867+0000 7f8da9600640 1 -- 172.21.15.6:0/1436294210 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d9c022090 con 0x7f8d8c003440 2024-09-10T20:55:57.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.867+0000 7fd867400640 1 -- 172.21.15.6:0/3122140203 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd868159e10 msgr2=0x7fd868157830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:57.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.867+0000 7fd867400640 1 --2- 172.21.15.6:0/3122140203 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd868159e10 0x7fd868157830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.867+0000 7fd867400640 1 -- 172.21.15.6:0/3122140203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd84c003bc0 msgr2=0x7fd8681598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:57.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.867+0000 7fd867400640 1 --2- 172.21.15.6:0/3122140203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd84c003bc0 0x7fd8681598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.867+0000 7fd867400640 1 -- 172.21.15.6:0/3122140203 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd86815a3b0 con 0x7fd868157d70 2024-09-10T20:55:57.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.868+0000 7fd866a00640 1 --2- 172.21.15.6:0/3122140203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd84c003bc0 0x7fd8681598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:55:57.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.868+0000 7f8da9600640 1 --2- 172.21.15.6:0/1436294210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d8c003440 0x7f8d9c16d3b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8d90003e60 tx=0x7f8d90001620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:57.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.868+0000 7fd867400640 1 --2- 172.21.15.6:0/3122140203 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd868157d70 0x7fd8681f72e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd8680d3270 tx=0x7fd86000f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:57.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.869+0000 7f8da1600640 1 -- 172.21.15.6:0/1436294210 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d90015020 con 0x7f8d8c003440 2024-09-10T20:55:57.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.869+0000 7f8da1600640 1 -- 172.21.15.6:0/1436294210 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d90011840 con 0x7f8d8c003440 2024-09-10T20:55:57.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.869+0000 7f8da1600640 1 -- 172.21.15.6:0/1436294210 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d90011c10 con 0x7f8d8c003440 2024-09-10T20:55:57.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.866+0000 7fb8f3200640 1 -- 172.21.15.6:0/1294775054 wait complete. 2024-09-10T20:55:57.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.869+0000 7fb8f3200640 1 Processor -- start 2024-09-10T20:55:57.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.869+0000 7f8daaa00640 1 -- 172.21.15.6:0/1436294210 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d9c0dcfa0 con 0x7f8d8c003440 2024-09-10T20:55:57.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.869+0000 7fd85ea00640 1 -- 172.21.15.6:0/3122140203 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd860003d80 con 0x7fd868157d70 2024-09-10T20:55:57.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.869+0000 7fd85ea00640 1 -- 172.21.15.6:0/3122140203 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd860004030 con 0x7fd868157d70 2024-09-10T20:55:57.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.869+0000 7fd85ea00640 1 -- 172.21.15.6:0/3122140203 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd860004420 con 0x7fd868157d70 2024-09-10T20:55:57.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.870+0000 7f8daaa00640 1 -- 172.21.15.6:0/1436294210 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d9c0483e0 con 0x7f8d8c003440 2024-09-10T20:55:57.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.869+0000 7fb8f3200640 1 -- start start 2024-09-10T20:55:57.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.871+0000 7fb8f3200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8ec0d0330 0x7fb8ec15a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.870+0000 7fd867e00640 1 -- 172.21.15.6:0/3122140203 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd86815a690 con 0x7fd868157d70 2024-09-10T20:55:57.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.870+0000 7fd867e00640 1 -- 172.21.15.6:0/3122140203 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8680c8af0 con 0x7fd868157d70 2024-09-10T20:55:57.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.871+0000 7fb8f3200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8ec0d0cb0 0x7fb8ec0cc610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.872+0000 7fb8eb400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8ec0d0cb0 0x7fb8ec0cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.872+0000 7fb8eb400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8ec0d0cb0 0x7fb8ec0cc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56114/0 (socket says 172.21.15.6:56114) 2024-09-10T20:55:57.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.872+0000 7fb8f3200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8ec162400 0x7fb8ec1569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.873+0000 7fb8f3200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb8ec0b7dd0 con 0x7fb8ec0d0cb0 2024-09-10T20:55:57.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.873+0000 7fb8f3200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb8ec0b7c50 con 0x7fb8ec162400 2024-09-10T20:55:57.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.873+0000 7fb8f1200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8ec162400 0x7fb8ec1569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.873+0000 7fb8f1200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8ec162400 0x7fb8ec1569d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.6:34716/0 (socket says 172.21.15.6:34716) 2024-09-10T20:55:57.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.873+0000 7fb8f1200640 1 -- 172.21.15.6:0/626438864 learned_addr learned my addr 172.21.15.6:0/626438864 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:57.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.873+0000 7fb8f3200640 1 -- 172.21.15.6:0/626438864 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb8ec0cf0d0 con 0x7fb8ec0d0330 2024-09-10T20:55:57.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.874+0000 7f8daaa00640 1 -- 172.21.15.6:0/1436294210 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d9c01cd50 con 0x7f8d8c003440 2024-09-10T20:55:57.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.874+0000 7f8da1600640 1 -- 172.21.15.6:0/1436294210 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8d9001a400 con 0x7f8d8c003440 2024-09-10T20:55:57.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.874+0000 7fb8ebe00640 1 --2- 172.21.15.6:0/626438864 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8ec0d0330 0x7fb8ec15a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.875+0000 7fb8f1200640 1 -- 172.21.15.6:0/626438864 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8ec0d0330 msgr2=0x7fb8ec15a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:57.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.875+0000 7fb8f1200640 1 --2- 172.21.15.6:0/626438864 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8ec0d0330 0x7fb8ec15a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.875+0000 7fb8f1200640 1 -- 172.21.15.6:0/626438864 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8ec0d0cb0 msgr2=0x7fb8ec0cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:57.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.875+0000 7fb8f1200640 1 --2- 172.21.15.6:0/626438864 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8ec0d0cb0 0x7fb8ec0cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.875+0000 7fb8f1200640 1 -- 172.21.15.6:0/626438864 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8ec15aa80 con 0x7fb8ec162400 2024-09-10T20:55:57.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.875+0000 7fb8ebe00640 1 --2- 172.21.15.6:0/626438864 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8ec0d0330 0x7fb8ec15a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:55:57.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.872+0000 7fd867e00640 1 -- 172.21.15.6:0/3122140203 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd86815abb0 con 0x7fd868157d70 2024-09-10T20:55:57.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.875+0000 7fd85ea00640 1 -- 172.21.15.6:0/3122140203 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd860018070 con 0x7fd868157d70 2024-09-10T20:55:57.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.875+0000 7fb8f1200640 1 --2- 172.21.15.6:0/626438864 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8ec162400 0x7fb8ec1569d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb8d800c760 tx=0x7fb8d800cc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:57.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.876+0000 7f8da1600640 1 --2- 172.21.15.6:0/1436294210 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f8d84078070 0x7f8d8407a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.876+0000 7f8da1600640 1 -- 172.21.15.6:0/1436294210 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f8d9009a9b0 con 0x7f8d8c003440 2024-09-10T20:55:57.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.877+0000 7f8da8c00640 1 --2- 172.21.15.6:0/1436294210 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f8d84078070 0x7f8d8407a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.876+0000 7fb8e3e00640 1 -- 172.21.15.6:0/626438864 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d800ce10 con 0x7fb8ec162400 2024-09-10T20:55:57.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.876+0000 7fb8e3e00640 1 -- 172.21.15.6:0/626438864 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb8d800a640 con 0x7fb8ec162400 2024-09-10T20:55:57.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.876+0000 7fb8e3e00640 1 -- 172.21.15.6:0/626438864 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d800aa90 con 0x7fb8ec162400 2024-09-10T20:55:57.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.877+0000 7fb8f3200640 1 -- 172.21.15.6:0/626438864 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8ec15ad20 con 0x7fb8ec162400 2024-09-10T20:55:57.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.877+0000 7fb8f3200640 1 -- 172.21.15.6:0/626438864 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8ec1f48f0 con 0x7fb8ec162400 2024-09-10T20:55:57.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.877+0000 7fd85ea00640 1 --2- 172.21.15.6:0/3122140203 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd848078040 0x7fd84807a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.877+0000 7fd85ea00640 1 -- 172.21.15.6:0/3122140203 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd86009b1a0 con 0x7fd868157d70 2024-09-10T20:55:57.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.878+0000 7fd866a00640 1 --2- 172.21.15.6:0/3122140203 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd848078040 0x7fd84807a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.878+0000 7f8da8c00640 1 --2- 172.21.15.6:0/1436294210 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f8d84078070 0x7f8d8407a530 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c04e460 tx=0x7f8d98006040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:57.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.879+0000 7fb8f3200640 1 -- 172.21.15.6:0/626438864 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8ec0cf5f0 con 0x7fb8ec162400 2024-09-10T20:55:57.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.879+0000 7fd85ea00640 1 -- 172.21.15.6:0/3122140203 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fd86815abb0 con 0x7fd868157d70 2024-09-10T20:55:57.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.879+0000 7fd866a00640 1 --2- 172.21.15.6:0/3122140203 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd848078040 0x7fd84807a500 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd858033000 tx=0x7fd8680d17d0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:57.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.881+0000 7fb8e3e00640 1 -- 172.21.15.6:0/626438864 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb8d800ac30 con 0x7fb8ec162400 2024-09-10T20:55:57.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.883+0000 7fb8e3e00640 1 --2- 172.21.15.6:0/626438864 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb8cc078040 0x7fb8cc07a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.883+0000 7fb8e3e00640 1 -- 172.21.15.6:0/626438864 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb8d8099a20 con 0x7fb8ec162400 2024-09-10T20:55:57.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.884+0000 7fb8ebe00640 1 --2- 172.21.15.6:0/626438864 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb8cc078040 0x7fb8cc07a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.884+0000 7f8da1600640 1 -- 172.21.15.6:0/1436294210 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f8d9001f020 con 0x7f8d8c003440 2024-09-10T20:55:57.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.885+0000 7fb8ebe00640 1 --2- 172.21.15.6:0/626438864 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb8cc078040 0x7fb8cc07a500 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc009ab0 tx=0x7fb8dc005f90 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:57.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.889+0000 7fb8e3e00640 1 -- 172.21.15.6:0/626438864 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb8d8062590 con 0x7fb8ec162400 2024-09-10T20:55:57.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.934+0000 7fd036200640 1 -- 172.21.15.6:0/1067041685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd030159670 msgr2=0x7fd0300743b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:57.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.934+0000 7fd036200640 1 --2- 172.21.15.6:0/1067041685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd030159670 0x7fd0300743b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd01c005fd0 tx=0x7fd01c02e950 comp rx=0 tx=0).stop 2024-09-10T20:55:57.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.935+0000 7fd036200640 1 -- 172.21.15.6:0/1067041685 shutdown_connections 2024-09-10T20:55:57.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.935+0000 7fd036200640 1 --2- 172.21.15.6:0/1067041685 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd030070450 0x7fd0300cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.936+0000 7f8a75800640 1 -- 172.21.15.6:0/2558370976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a700cc7b0 msgr2=0x7f8a700cddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:57.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.935+0000 7fd036200640 1 --2- 172.21.15.6:0/1067041685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd030159670 0x7fd0300743b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.935+0000 7fd036200640 1 -- 172.21.15.6:0/1067041685 >> 172.21.15.6:0/1067041685 conn(0x7fd0300cfa20 msgr2=0x7fd0300cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:57.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.936+0000 7f8a75800640 1 --2- 172.21.15.6:0/2558370976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a700cc7b0 0x7f8a700cddf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8a7015f000 tx=0x7f8a5c02a5d0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.936+0000 7fd036200640 1 -- 172.21.15.6:0/1067041685 shutdown_connections 2024-09-10T20:55:57.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.936+0000 7f8a75800640 1 -- 172.21.15.6:0/2558370976 shutdown_connections 2024-09-10T20:55:57.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.936+0000 7f8a75800640 1 --2- 172.21.15.6:0/2558370976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a700cc7b0 0x7f8a700cddf0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.936+0000 7f8a75800640 1 --2- 172.21.15.6:0/2558370976 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a70158050 0x7f8a700cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.936+0000 7f8a75800640 1 -- 172.21.15.6:0/2558370976 >> 172.21.15.6:0/2558370976 conn(0x7f8a7006d230 msgr2=0x7f8a700b1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:57.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.936+0000 7fd036200640 1 -- 172.21.15.6:0/1067041685 wait complete. 2024-09-10T20:55:57.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.937+0000 7f8a75800640 1 -- 172.21.15.6:0/2558370976 shutdown_connections 2024-09-10T20:55:57.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.937+0000 7f8a75800640 1 -- 172.21.15.6:0/2558370976 wait complete. 2024-09-10T20:55:57.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.937+0000 7fc8c6800640 1 -- 172.21.15.6:0/1128683425 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc8a40051c0 msgr2=0x7fc8a400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:57.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.937+0000 7fc8c6800640 1 --2- 172.21.15.6:0/1128683425 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc8a40051c0 0x7fc8a400b9c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc8c00cc260 tx=0x7fc8a4005830 comp rx=0 tx=0).stop 2024-09-10T20:55:57.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.937+0000 7fc8bfe00640 1 -- 172.21.15.6:0/1128683425 reap_dead start 2024-09-10T20:55:57.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.938+0000 7fc8c6800640 1 -- 172.21.15.6:0/1128683425 shutdown_connections 2024-09-10T20:55:57.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.938+0000 7fc8c6800640 1 -- 172.21.15.6:0/1128683425 >> 172.21.15.6:0/1128683425 conn(0x7fc8c00cfa20 msgr2=0x7fc8c00cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:57.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.939+0000 7fc8c6800640 1 -- 172.21.15.6:0/1128683425 shutdown_connections 2024-09-10T20:55:57.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.939+0000 7fd036200640 1 Processor -- start 2024-09-10T20:55:57.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.939+0000 7fd036200640 1 -- start start 2024-09-10T20:55:57.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.941+0000 7f8a75800640 1 Processor -- start 2024-09-10T20:55:57.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.941+0000 7f8a75800640 1 -- start start 2024-09-10T20:55:57.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.942+0000 7fc8c6800640 1 -- 172.21.15.6:0/1128683425 wait complete. 2024-09-10T20:55:57.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.942+0000 7fd036200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd030070450 0x7fd0301f44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.942+0000 7fd036200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd030159670 0x7fd03015d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.942+0000 7fd036200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd03015c170 0x7fd03014efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.942+0000 7fd036200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd0300b4ca0 con 0x7fd03015c170 2024-09-10T20:55:57.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.942+0000 7fd02ea00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd030159670 0x7fd03015d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.942+0000 7fd02ea00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd030159670 0x7fd03015d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.6:34740/0 (socket says 172.21.15.6:34740) 2024-09-10T20:55:57.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.942+0000 7fd036200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd0300b4b20 con 0x7fd030159670 2024-09-10T20:55:57.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.942+0000 7fd036200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd0300b4e20 con 0x7fd030070450 2024-09-10T20:55:57.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.942+0000 7fd02ea00640 1 -- 172.21.15.6:0/3460630490 learned_addr learned my addr 172.21.15.6:0/3460630490 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:57.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.942+0000 7fd02f400640 1 --2- 172.21.15.6:0/3460630490 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd030070450 0x7fd0301f44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.943+0000 7fd02fe00640 1 --2- 172.21.15.6:0/3460630490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd03015c170 0x7fd03014efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.943+0000 7fd02f400640 1 -- 172.21.15.6:0/3460630490 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd030159670 msgr2=0x7fd03015d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:57.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.943+0000 7fd02f400640 1 --2- 172.21.15.6:0/3460630490 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd030159670 0x7fd03015d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.943+0000 7fd02f400640 1 -- 172.21.15.6:0/3460630490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd03015c170 msgr2=0x7fd03014efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:57.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.943+0000 7fd02f400640 1 --2- 172.21.15.6:0/3460630490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd03015c170 0x7fd03014efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.943+0000 7fd02f400640 1 -- 172.21.15.6:0/3460630490 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0301f4a20 con 0x7fd030070450 2024-09-10T20:55:57.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.944+0000 7fd02f400640 1 --2- 172.21.15.6:0/3460630490 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd030070450 0x7fd0301f44e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd01c036000 tx=0x7fd01c005760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:57.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.944+0000 7fd027400640 1 -- 172.21.15.6:0/3460630490 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd01c030040 con 0x7fd030070450 2024-09-10T20:55:57.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.944+0000 7fd027400640 1 -- 172.21.15.6:0/3460630490 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd01c042070 con 0x7fd030070450 2024-09-10T20:55:57.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.944+0000 7fd027400640 1 -- 172.21.15.6:0/3460630490 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd01c0035f0 con 0x7fd030070450 2024-09-10T20:55:57.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.944+0000 7fc8c6800640 1 Processor -- start 2024-09-10T20:55:57.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.945+0000 7fc8c6800640 1 -- start start 2024-09-10T20:55:57.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.946+0000 7f8a75800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a700cc7b0 0x7f8a70153d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.944+0000 7fd036200640 1 -- 172.21.15.6:0/3460630490 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0300b0000 con 0x7fd030070450 2024-09-10T20:55:57.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.944+0000 7fd036200640 1 -- 172.21.15.6:0/3460630490 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0300b05c0 con 0x7fd030070450 2024-09-10T20:55:57.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.946+0000 7f8a75800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a700ce330 0x7f8a70160520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.946+0000 7f8a75800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a70158050 0x7f8a70160a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.946+0000 7f8a75800640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8a700c92a0 con 0x7f8a700cc7b0 2024-09-10T20:55:57.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.946+0000 7f8a75800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8a700cb720 con 0x7f8a700ce330 2024-09-10T20:55:57.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.946+0000 7f8a75800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8a700c9420 con 0x7f8a70158050 2024-09-10T20:55:57.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.946+0000 7f8a6fe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a700cc7b0 0x7f8a70153d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.946+0000 7f8a6fe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a700cc7b0 0x7f8a70153d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56156/0 (socket says 172.21.15.6:56156) 2024-09-10T20:55:57.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.946+0000 7f8a6fe00640 1 -- 172.21.15.6:0/3351563500 learned_addr learned my addr 172.21.15.6:0/3351563500 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:57.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.946+0000 7f8a74e00640 1 --2- 172.21.15.6:0/3351563500 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a70158050 0x7f8a70160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.947+0000 7f8a6fe00640 1 -- 172.21.15.6:0/3351563500 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a70158050 msgr2=0x7f8a70160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:57.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.947+0000 7f8a6fe00640 1 --2- 172.21.15.6:0/3351563500 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a70158050 0x7f8a70160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.947+0000 7f8a6fe00640 1 -- 172.21.15.6:0/3351563500 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a700ce330 msgr2=0x7f8a70160520 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T20:55:57.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.947+0000 7f8a6fe00640 1 --2- 172.21.15.6:0/3351563500 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a700ce330 0x7f8a70160520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.947+0000 7f8a6fe00640 1 -- 172.21.15.6:0/3351563500 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a7015dcf0 con 0x7f8a700cc7b0 2024-09-10T20:55:57.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.947+0000 7f8a6fe00640 1 --2- 172.21.15.6:0/3351563500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a700cc7b0 0x7f8a70153d30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8a6000d750 tx=0x7f8a6000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:57.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.947+0000 7fc8c6800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8a40051c0 0x7fc8c00c44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.948+0000 7f8a67e00640 1 -- 172.21.15.6:0/3351563500 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a60017070 con 0x7f8a700cc7b0 2024-09-10T20:55:57.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.948+0000 7f8a67e00640 1 -- 172.21.15.6:0/3351563500 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a60004310 con 0x7f8a700cc7b0 2024-09-10T20:55:57.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.948+0000 7f8a67e00640 1 -- 172.21.15.6:0/3351563500 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6000de60 con 0x7f8a700cc7b0 2024-09-10T20:55:57.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.947+0000 7fc8c6800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc8c00d00a0 0x7fc8c00b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.948+0000 7fc8c6800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8c0156580 0x7fc8c0156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.948+0000 7fc8bea00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc8c00d00a0 0x7fc8c00b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.948+0000 7fc8bea00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc8c00d00a0 0x7fc8c00b4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.6:41524/0 (socket says 172.21.15.6:41524) 2024-09-10T20:55:57.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.948+0000 7fc8bfe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8c0156580 0x7fc8c0156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.948+0000 7fc8bfe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8c0156580 0x7fc8c0156a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.6:34764/0 (socket says 172.21.15.6:34764) 2024-09-10T20:55:57.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.948+0000 7fc8bf400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8a40051c0 0x7fc8c00c44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.948+0000 7fc8bf400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8a40051c0 0x7fc8c00c44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56160/0 (socket says 172.21.15.6:56160) 2024-09-10T20:55:57.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.949+0000 7fc8c6800640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c00708d0 con 0x7fc8a40051c0 2024-09-10T20:55:57.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.949+0000 7fc8c6800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c015a1a0 con 0x7fc8c0156580 2024-09-10T20:55:57.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.949+0000 7fc8c6800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fc8c0070a50 con 0x7fc8c00d00a0 2024-09-10T20:55:57.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.949+0000 7fc8bea00640 1 -- 172.21.15.6:0/1581627420 learned_addr learned my addr 172.21.15.6:0/1581627420 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:57.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.950+0000 7fc8bf400640 1 -- 172.21.15.6:0/1581627420 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc8c00d00a0 msgr2=0x7fc8c00b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:57.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.950+0000 7fc8bf400640 1 --2- 172.21.15.6:0/1581627420 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc8c00d00a0 0x7fc8c00b4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.950+0000 7fc8bf400640 1 -- 172.21.15.6:0/1581627420 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8c0156580 msgr2=0x7fc8c0156a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:57.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.950+0000 7f8a75800640 1 -- 172.21.15.6:0/3351563500 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a7015d730 con 0x7f8a700cc7b0 2024-09-10T20:55:57.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.950+0000 7f8a75800640 1 -- 172.21.15.6:0/3351563500 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a700b3fe0 con 0x7f8a700cc7b0 2024-09-10T20:55:57.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.950+0000 7fc8bf400640 1 --2- 172.21.15.6:0/1581627420 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8c0156580 0x7fc8c0156a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.950+0000 7fc8bf400640 1 -- 172.21.15.6:0/1581627420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8c00c4000 con 0x7fc8a40051c0 2024-09-10T20:55:57.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.951+0000 7fc8bf400640 1 --2- 172.21.15.6:0/1581627420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8a40051c0 0x7fc8c00c44e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc8b000d920 tx=0x7fc8b000dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:57.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.952+0000 7fc8b7400640 1 -- 172.21.15.6:0/1581627420 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b0014020 con 0x7fc8a40051c0 2024-09-10T20:55:57.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.952+0000 7fc8b7400640 1 -- 172.21.15.6:0/1581627420 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc8b0006570 con 0x7fc8a40051c0 2024-09-10T20:55:57.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.951+0000 7fd027400640 1 -- 172.21.15.6:0/3460630490 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd01c04f030 con 0x7fd030070450 2024-09-10T20:55:57.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.952+0000 7fd027400640 1 --2- 172.21.15.6:0/3460630490 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd010078040 0x7fd01007a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.952+0000 7fd027400640 1 -- 172.21.15.6:0/3460630490 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd01c0bea70 con 0x7fd030070450 2024-09-10T20:55:57.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.952+0000 7f8a75800640 1 -- 172.21.15.6:0/3351563500 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a700c98d0 con 0x7f8a700cc7b0 2024-09-10T20:55:57.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.952+0000 7fc8b7400640 1 -- 172.21.15.6:0/1581627420 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b0014020 con 0x7fc8a40051c0 2024-09-10T20:55:57.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.952+0000 7fc8c6800640 1 -- 172.21.15.6:0/1581627420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8c00ceb60 con 0x7fc8a40051c0 2024-09-10T20:55:57.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.952+0000 7fc8c6800640 1 -- 172.21.15.6:0/1581627420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8c00c6520 con 0x7fc8a40051c0 2024-09-10T20:55:57.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.954+0000 7fd02ea00640 1 --2- 172.21.15.6:0/3460630490 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd010078040 0x7fd01007a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.954+0000 7fc8c6800640 1 -- 172.21.15.6:0/1581627420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8c00a0970 con 0x7fc8a40051c0 2024-09-10T20:55:57.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.954+0000 7f8a67e00640 1 -- 172.21.15.6:0/3351563500 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8a60009c30 con 0x7f8a700cc7b0 2024-09-10T20:55:57.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.956+0000 7f8a67e00640 1 --2- 172.21.15.6:0/3351563500 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f8a50078040 0x7f8a5007a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.957+0000 7f8a67e00640 1 -- 172.21.15.6:0/3351563500 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f8a6009a1d0 con 0x7f8a700cc7b0 2024-09-10T20:55:57.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.957+0000 7fd036200640 1 -- 172.21.15.6:0/3460630490 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0300b52d0 con 0x7fd030070450 2024-09-10T20:55:57.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.957+0000 7f8a6f400640 1 --2- 172.21.15.6:0/3351563500 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f8a50078040 0x7f8a5007a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.958+0000 7fd02ea00640 1 --2- 172.21.15.6:0/3460630490 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd010078040 0x7fd01007a500 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd0300afeb0 tx=0x7fd020009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:57.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.958+0000 7f8a6f400640 1 --2- 172.21.15.6:0/3351563500 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f8a50078040 0x7f8a5007a500 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c033000 tx=0x7f8a5c004730 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:57.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.959+0000 7fc8b7400640 1 -- 172.21.15.6:0/1581627420 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc8b000b7d0 con 0x7fc8a40051c0 2024-09-10T20:55:57.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.960+0000 7fc8b7400640 1 --2- 172.21.15.6:0/1581627420 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fc8a0078170 0x7fc8a007a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.961+0000 7fc8b7400640 1 -- 172.21.15.6:0/1581627420 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fc8b009a1e0 con 0x7fc8a40051c0 2024-09-10T20:55:57.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.962+0000 7fc8bea00640 1 --2- 172.21.15.6:0/1581627420 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fc8a0078170 0x7fc8a007a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.963+0000 7fc8bea00640 1 --2- 172.21.15.6:0/1581627420 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fc8a0078170 0x7fc8a007a630 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc8c00d04e0 tx=0x7fc8ac00d490 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:57.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.963+0000 7fd027400640 1 -- 172.21.15.6:0/3460630490 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fd01c086f00 con 0x7fd030070450 2024-09-10T20:55:57.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.965+0000 7f8a67e00640 1 -- 172.21.15.6:0/3351563500 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f8a60020020 con 0x7f8a700cc7b0 2024-09-10T20:55:57.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:57.976+0000 7fc8b7400640 1 -- 172.21.15.6:0/1581627420 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc8c00a0970 con 0x7fc8a40051c0 2024-09-10T20:55:58.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.270+0000 7f5c49a00640 1 -- 172.21.15.6:0/3764342005 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f5c1c005580 con 0x7f5c28004360 2024-09-10T20:55:58.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.271+0000 7f5c3aa00640 1 -- 172.21.15.6:0/3764342005 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5c34062620 con 0x7f5c28004360 2024-09-10T20:55:58.276 INFO:teuthology.orchestra.run.smithi006.stdout:64424509447 2024-09-10T20:55:58.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.275+0000 7f5c49a00640 1 -- 172.21.15.6:0/3764342005 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5c24078170 msgr2=0x7f5c2407a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:58.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.275+0000 7f5c49a00640 1 --2- 172.21.15.6:0/3764342005 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5c24078170 0x7f5c2407a630 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c006fd0 tx=0x7f5c3c0069e0 comp rx=0 tx=0).stop 2024-09-10T20:55:58.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.276+0000 7f5c49a00640 1 -- 172.21.15.6:0/3764342005 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c28004360 msgr2=0x7f5c440c9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:58.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.276+0000 7f5c49a00640 1 --2- 172.21.15.6:0/3764342005 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c28004360 0x7f5c440c9230 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5c3400d960 tx=0x7f5c3400de20 comp rx=0 tx=0).stop 2024-09-10T20:55:58.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.277+0000 7f5c49a00640 1 -- 172.21.15.6:0/3764342005 shutdown_connections 2024-09-10T20:55:58.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.277+0000 7f5c49a00640 1 --2- 172.21.15.6:0/3764342005 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5c24078170 0x7f5c2407a630 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:58.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.277+0000 7f5c49a00640 1 --2- 172.21.15.6:0/3764342005 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c441302b0 0x7f5c441fbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:58.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.277+0000 7f5c49a00640 1 --2- 172.21.15.6:0/3764342005 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c440b4370 0x7f5c4412fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:58.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.277+0000 7f5c49a00640 1 --2- 172.21.15.6:0/3764342005 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c28004360 0x7f5c440c9230 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:58.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.277+0000 7f5c49a00640 1 -- 172.21.15.6:0/3764342005 >> 172.21.15.6:0/3764342005 conn(0x7f5c4406d230 msgr2=0x7f5c4406f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:58.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.277+0000 7f5fefe00640 1 -- 172.21.15.6:0/2511264542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f5fd8005850 con 0x7f600406fd50 2024-09-10T20:55:58.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.277+0000 7f5c49a00640 1 -- 172.21.15.6:0/3764342005 shutdown_connections 2024-09-10T20:55:58.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.278+0000 7f5c49a00640 1 -- 172.21.15.6:0/3764342005 wait complete. 2024-09-10T20:55:58.283 INFO:teuthology.orchestra.run.smithi006.stdout:64424509446 2024-09-10T20:55:58.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.278+0000 7f5ffaa00640 1 -- 172.21.15.6:0/2511264542 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5ff40617d0 con 0x7f600406fd50 2024-09-10T20:55:58.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.282+0000 7f5fefe00640 1 -- 172.21.15.6:0/2511264542 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5fe40781a0 msgr2=0x7f5fe407a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:58.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.282+0000 7f5fefe00640 1 --2- 172.21.15.6:0/2511264542 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5fe40781a0 0x7f5fe407a660 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5ff0000c00 tx=0x7f5ff0004730 comp rx=0 tx=0).stop 2024-09-10T20:55:58.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.282+0000 7f5fefe00640 1 -- 172.21.15.6:0/2511264542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f600406fd50 msgr2=0x7f6004155210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:58.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.282+0000 7f5fefe00640 1 --2- 172.21.15.6:0/2511264542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f600406fd50 0x7f6004155210 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5ff400c730 tx=0x7f5ff400cbf0 comp rx=0 tx=0).stop 2024-09-10T20:55:58.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.283+0000 7f5fefe00640 1 -- 172.21.15.6:0/2511264542 shutdown_connections 2024-09-10T20:55:58.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.283+0000 7f5fefe00640 1 --2- 172.21.15.6:0/2511264542 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5fe40781a0 0x7f5fe407a660 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:58.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.283+0000 7f5fefe00640 1 --2- 172.21.15.6:0/2511264542 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6004154020 0x7f60040c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:58.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.283+0000 7f5fefe00640 1 --2- 172.21.15.6:0/2511264542 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60040cc090 0x7f60040c81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:58.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.283+0000 7f5fefe00640 1 --2- 172.21.15.6:0/2511264542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f600406fd50 0x7f6004155210 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:58.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.283+0000 7f5fefe00640 1 -- 172.21.15.6:0/2511264542 >> 172.21.15.6:0/2511264542 conn(0x7f600406d230 msgr2=0x7f600415caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:58.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.283+0000 7f5fefe00640 1 -- 172.21.15.6:0/2511264542 shutdown_connections 2024-09-10T20:55:58.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.286+0000 7f5fefe00640 1 -- 172.21.15.6:0/2511264542 wait complete. 2024-09-10T20:55:58.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.304+0000 7f8daaa00640 1 -- 172.21.15.6:0/1436294210 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f8d9c0540b0 con 0x7f8d8c003440 2024-09-10T20:55:58.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.305+0000 7f8da1600640 1 -- 172.21.15.6:0/1436294210 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8d90063520 con 0x7f8d8c003440 2024-09-10T20:55:58.310 INFO:teuthology.orchestra.run.smithi006.stdout:64424509446 2024-09-10T20:55:58.310 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.1 2024-09-10T20:55:58.311 DEBUG:teuthology.parallel:result is None 2024-09-10T20:55:58.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.310+0000 7f8daaa00640 1 -- 172.21.15.6:0/1436294210 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f8d84078070 msgr2=0x7f8d8407a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:58.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.310+0000 7f8daaa00640 1 --2- 172.21.15.6:0/1436294210 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f8d84078070 0x7f8d8407a530 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c04e460 tx=0x7f8d98006040 comp rx=0 tx=0).stop 2024-09-10T20:55:58.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.310+0000 7f8daaa00640 1 -- 172.21.15.6:0/1436294210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d8c003440 msgr2=0x7f8d9c16d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:58.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.310+0000 7f8daaa00640 1 --2- 172.21.15.6:0/1436294210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d8c003440 0x7f8d9c16d3b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8d90003e60 tx=0x7f8d90001620 comp rx=0 tx=0).stop 2024-09-10T20:55:58.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.310+0000 7f8daaa00640 1 -- 172.21.15.6:0/1436294210 shutdown_connections 2024-09-10T20:55:58.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.310+0000 7f8daaa00640 1 --2- 172.21.15.6:0/1436294210 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f8d84078070 0x7f8d8407a530 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:58.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.310+0000 7f8daaa00640 1 --2- 172.21.15.6:0/1436294210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d9c04d140 0x7f8d9c04d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:58.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.310+0000 7f8daaa00640 1 --2- 172.21.15.6:0/1436294210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d9c021c30 0x7f8d9c0dca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:58.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.310+0000 7f8daaa00640 1 --2- 172.21.15.6:0/1436294210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d8c003440 0x7f8d9c16d3b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:58.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.310+0000 7f8daaa00640 1 -- 172.21.15.6:0/1436294210 >> 172.21.15.6:0/1436294210 conn(0x7f8d9c054560 msgr2=0x7f8d9c052de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:58.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.310+0000 7f8daaa00640 1 -- 172.21.15.6:0/1436294210 shutdown_connections 2024-09-10T20:55:58.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.310+0000 7f8daaa00640 1 -- 172.21.15.6:0/1436294210 wait complete. 2024-09-10T20:55:58.317 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.0 2024-09-10T20:55:58.317 DEBUG:teuthology.parallel:result is None 2024-09-10T20:55:58.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.317+0000 7fd867e00640 1 -- 172.21.15.6:0/3122140203 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fd8680c8cf0 con 0x7fd868157d70 2024-09-10T20:55:58.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.318+0000 7fd85ea00640 1 -- 172.21.15.6:0/3122140203 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd8680c8cf0 con 0x7fd868157d70 2024-09-10T20:55:58.322 INFO:teuthology.orchestra.run.smithi006.stdout:64424509447 2024-09-10T20:55:58.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.322+0000 7fd867e00640 1 -- 172.21.15.6:0/3122140203 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd848078040 msgr2=0x7fd84807a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:58.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.322+0000 7fd867e00640 1 --2- 172.21.15.6:0/3122140203 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd848078040 0x7fd84807a500 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd858033000 tx=0x7fd8680d17d0 comp rx=0 tx=0).stop 2024-09-10T20:55:58.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.322+0000 7fd867e00640 1 -- 172.21.15.6:0/3122140203 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd868157d70 msgr2=0x7fd8681f72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:58.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.322+0000 7fd867e00640 1 --2- 172.21.15.6:0/3122140203 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd868157d70 0x7fd8681f72e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd8680d3270 tx=0x7fd86000f790 comp rx=0 tx=0).stop 2024-09-10T20:55:58.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.322+0000 7fd867e00640 1 -- 172.21.15.6:0/3122140203 shutdown_connections 2024-09-10T20:55:58.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.322+0000 7fd867e00640 1 --2- 172.21.15.6:0/3122140203 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd848078040 0x7fd84807a500 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:58.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.322+0000 7fd867e00640 1 --2- 172.21.15.6:0/3122140203 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd868157d70 0x7fd8681f72e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:58.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.322+0000 7fd867e00640 1 --2- 172.21.15.6:0/3122140203 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd868159e10 0x7fd868157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:58.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.322+0000 7fd867e00640 1 --2- 172.21.15.6:0/3122140203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd84c003bc0 0x7fd8681598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:58.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.322+0000 7fd867e00640 1 -- 172.21.15.6:0/3122140203 >> 172.21.15.6:0/3122140203 conn(0x7fd86809d100 msgr2=0x7fd8680b56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:58.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.322+0000 7fd867e00640 1 -- 172.21.15.6:0/3122140203 shutdown_connections 2024-09-10T20:55:58.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.322+0000 7fd867e00640 1 -- 172.21.15.6:0/3122140203 wait complete. 2024-09-10T20:55:58.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.327+0000 7fb8f3200640 1 -- 172.21.15.6:0/626438864 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fb8ec0b9d70 con 0x7fb8ec162400 2024-09-10T20:55:58.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.328+0000 7fb8e3e00640 1 -- 172.21.15.6:0/626438864 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb8d8061e90 con 0x7fb8ec162400 2024-09-10T20:55:58.332 INFO:teuthology.orchestra.run.smithi006.stdout:60129542152 2024-09-10T20:55:58.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.330+0000 7fb8f3200640 1 -- 172.21.15.6:0/626438864 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb8cc078040 msgr2=0x7fb8cc07a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:58.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.330+0000 7fb8f3200640 1 --2- 172.21.15.6:0/626438864 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb8cc078040 0x7fb8cc07a500 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc009ab0 tx=0x7fb8dc005f90 comp rx=0 tx=0).stop 2024-09-10T20:55:58.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.330+0000 7fb8f3200640 1 -- 172.21.15.6:0/626438864 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8ec162400 msgr2=0x7fb8ec1569d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:58.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.330+0000 7fb8f3200640 1 --2- 172.21.15.6:0/626438864 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8ec162400 0x7fb8ec1569d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb8d800c760 tx=0x7fb8d800cc20 comp rx=0 tx=0).stop 2024-09-10T20:55:58.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.331+0000 7fb8f3200640 1 -- 172.21.15.6:0/626438864 shutdown_connections 2024-09-10T20:55:58.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.331+0000 7fb8f3200640 1 --2- 172.21.15.6:0/626438864 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb8cc078040 0x7fb8cc07a500 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:58.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.331+0000 7fb8f3200640 1 --2- 172.21.15.6:0/626438864 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8ec0d0cb0 0x7fb8ec0cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:58.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.331+0000 7fb8f3200640 1 --2- 172.21.15.6:0/626438864 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8ec162400 0x7fb8ec1569d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:58.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.331+0000 7fb8f3200640 1 --2- 172.21.15.6:0/626438864 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8ec0d0330 0x7fb8ec15a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:58.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.331+0000 7fb8f3200640 1 -- 172.21.15.6:0/626438864 >> 172.21.15.6:0/626438864 conn(0x7fb8ec09d0c0 msgr2=0x7fb8ec0d1760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:58.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.331+0000 7fb8f3200640 1 -- 172.21.15.6:0/626438864 shutdown_connections 2024-09-10T20:55:58.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.331+0000 7fb8f3200640 1 -- 172.21.15.6:0/626438864 wait complete. 2024-09-10T20:55:58.340 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.2 2024-09-10T20:55:58.341 DEBUG:teuthology.parallel:result is None 2024-09-10T20:55:58.352 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.5 2024-09-10T20:55:58.353 DEBUG:teuthology.parallel:result is None 2024-09-10T20:55:58.354 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542152 for osd.3 2024-09-10T20:55:58.354 DEBUG:teuthology.parallel:result is None 2024-09-10T20:55:58.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.353+0000 7fd036200640 1 -- 172.21.15.6:0/3460630490 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fd030069d20 con 0x7fd030070450 2024-09-10T20:55:58.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.354+0000 7fd027400640 1 -- 172.21.15.6:0/3460630490 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd01c08b930 con 0x7fd030070450 2024-09-10T20:55:58.357 INFO:teuthology.orchestra.run.smithi006.stdout:64424509448 2024-09-10T20:55:58.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.356+0000 7fd036200640 1 -- 172.21.15.6:0/3460630490 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd010078040 msgr2=0x7fd01007a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:58.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.356+0000 7fd036200640 1 --2- 172.21.15.6:0/3460630490 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd010078040 0x7fd01007a500 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd0300afeb0 tx=0x7fd020009040 comp rx=0 tx=0).stop 2024-09-10T20:55:58.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.356+0000 7fd036200640 1 -- 172.21.15.6:0/3460630490 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd030070450 msgr2=0x7fd0301f44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:58.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.356+0000 7fd036200640 1 --2- 172.21.15.6:0/3460630490 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd030070450 0x7fd0301f44e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd01c036000 tx=0x7fd01c005760 comp rx=0 tx=0).stop 2024-09-10T20:55:58.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.356+0000 7fd036200640 1 -- 172.21.15.6:0/3460630490 shutdown_connections 2024-09-10T20:55:58.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.356+0000 7fd036200640 1 --2- 172.21.15.6:0/3460630490 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd010078040 0x7fd01007a500 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:58.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.356+0000 7fd036200640 1 --2- 172.21.15.6:0/3460630490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd03015c170 0x7fd03014efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:58.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.356+0000 7fd036200640 1 --2- 172.21.15.6:0/3460630490 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd030159670 0x7fd03015d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:58.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.356+0000 7fd036200640 1 --2- 172.21.15.6:0/3460630490 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd030070450 0x7fd0301f44e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:58.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.356+0000 7fd036200640 1 -- 172.21.15.6:0/3460630490 >> 172.21.15.6:0/3460630490 conn(0x7fd0300cfa20 msgr2=0x7fd0300b28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:58.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.356+0000 7fd036200640 1 -- 172.21.15.6:0/3460630490 shutdown_connections 2024-09-10T20:55:58.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.356+0000 7fd036200640 1 -- 172.21.15.6:0/3460630490 wait complete. 2024-09-10T20:55:58.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.364+0000 7f8a75800640 1 -- 172.21.15.6:0/3351563500 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f8a700cd960 con 0x7f8a700cc7b0 2024-09-10T20:55:58.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.364+0000 7f8a67e00640 1 -- 172.21.15.6:0/3351563500 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8a60062cb0 con 0x7f8a700cc7b0 2024-09-10T20:55:58.368 INFO:teuthology.orchestra.run.smithi006.stdout:64424509446 2024-09-10T20:55:58.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.367+0000 7f8a75800640 1 -- 172.21.15.6:0/3351563500 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f8a50078040 msgr2=0x7f8a5007a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:58.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.367+0000 7f8a75800640 1 --2- 172.21.15.6:0/3351563500 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f8a50078040 0x7f8a5007a500 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c033000 tx=0x7f8a5c004730 comp rx=0 tx=0).stop 2024-09-10T20:55:58.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.367+0000 7f8a75800640 1 -- 172.21.15.6:0/3351563500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a700cc7b0 msgr2=0x7f8a70153d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:58.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.367+0000 7f8a75800640 1 --2- 172.21.15.6:0/3351563500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a700cc7b0 0x7f8a70153d30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8a6000d750 tx=0x7f8a6000dc10 comp rx=0 tx=0).stop 2024-09-10T20:55:58.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.367+0000 7f8a75800640 1 -- 172.21.15.6:0/3351563500 shutdown_connections 2024-09-10T20:55:58.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.367+0000 7f8a75800640 1 --2- 172.21.15.6:0/3351563500 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f8a50078040 0x7f8a5007a500 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:58.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.367+0000 7f8a75800640 1 --2- 172.21.15.6:0/3351563500 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a70158050 0x7f8a70160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:58.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.367+0000 7f8a75800640 1 --2- 172.21.15.6:0/3351563500 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a700ce330 0x7f8a70160520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:58.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.367+0000 7f8a75800640 1 --2- 172.21.15.6:0/3351563500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a700cc7b0 0x7f8a70153d30 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:58.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.367+0000 7f8a75800640 1 -- 172.21.15.6:0/3351563500 >> 172.21.15.6:0/3351563500 conn(0x7f8a7006d230 msgr2=0x7f8a7015f480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:58.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.367+0000 7f8a75800640 1 -- 172.21.15.6:0/3351563500 shutdown_connections 2024-09-10T20:55:58.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.367+0000 7f8a75800640 1 -- 172.21.15.6:0/3351563500 wait complete. 2024-09-10T20:55:58.377 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.7 2024-09-10T20:55:58.377 DEBUG:teuthology.parallel:result is None 2024-09-10T20:55:58.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.389+0000 7fc8c6800640 1 -- 172.21.15.6:0/1581627420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fc8c0159340 con 0x7fc8a40051c0 2024-09-10T20:55:58.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.390+0000 7fc8b7400640 1 -- 172.21.15.6:0/1581627420 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc8b0069030 con 0x7fc8a40051c0 2024-09-10T20:55:58.394 INFO:teuthology.orchestra.run.smithi006.stdout:64424509446 2024-09-10T20:55:58.395 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.4 2024-09-10T20:55:58.395 DEBUG:teuthology.parallel:result is None 2024-09-10T20:55:58.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.392+0000 7fc8c6800640 1 -- 172.21.15.6:0/1581627420 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fc8a0078170 msgr2=0x7fc8a007a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:58.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.392+0000 7fc8c6800640 1 --2- 172.21.15.6:0/1581627420 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fc8a0078170 0x7fc8a007a630 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc8c00d04e0 tx=0x7fc8ac00d490 comp rx=0 tx=0).stop 2024-09-10T20:55:58.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.392+0000 7fc8c6800640 1 -- 172.21.15.6:0/1581627420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8a40051c0 msgr2=0x7fc8c00c44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:58.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.392+0000 7fc8c6800640 1 --2- 172.21.15.6:0/1581627420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8a40051c0 0x7fc8c00c44e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc8b000d920 tx=0x7fc8b000dde0 comp rx=0 tx=0).stop 2024-09-10T20:55:58.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.392+0000 7fc8c6800640 1 -- 172.21.15.6:0/1581627420 shutdown_connections 2024-09-10T20:55:58.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.392+0000 7fc8c6800640 1 --2- 172.21.15.6:0/1581627420 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fc8a0078170 0x7fc8a007a630 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:58.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.392+0000 7fc8c6800640 1 --2- 172.21.15.6:0/1581627420 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8c0156580 0x7fc8c0156a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:58.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.392+0000 7fc8c6800640 1 --2- 172.21.15.6:0/1581627420 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc8c00d00a0 0x7fc8c00b4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:58.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.392+0000 7fc8c6800640 1 --2- 172.21.15.6:0/1581627420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8a40051c0 0x7fc8c00c44e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:58.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.392+0000 7fc8c6800640 1 -- 172.21.15.6:0/1581627420 >> 172.21.15.6:0/1581627420 conn(0x7fc8c00cfa20 msgr2=0x7fc8c00afed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:58.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.392+0000 7fc8c6800640 1 -- 172.21.15.6:0/1581627420 shutdown_connections 2024-09-10T20:55:58.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.393+0000 7fc8c6800640 1 -- 172.21.15.6:0/1581627420 wait complete. 2024-09-10T20:55:58.413 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.6 2024-09-10T20:55:58.413 DEBUG:teuthology.parallel:result is None 2024-09-10T20:55:58.413 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T20:55:58.413 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T20:55:58.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.610+0000 7f5a47e00640 1 -- 172.21.15.6:0/1916397819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a28004000 msgr2=0x7f5a28004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:58.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.610+0000 7f5a47e00640 1 --2- 172.21.15.6:0/1916397819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a28004000 0x7f5a28004800 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c00c2e0 tx=0x7f5a28005830 comp rx=0 tx=0).stop 2024-09-10T20:55:58.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.610+0000 7f5a45e00640 1 -- 172.21.15.6:0/1916397819 reap_dead start 2024-09-10T20:55:58.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.610+0000 7f5a47e00640 1 -- 172.21.15.6:0/1916397819 shutdown_connections 2024-09-10T20:55:58.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.610+0000 7f5a47e00640 1 -- 172.21.15.6:0/1916397819 >> 172.21.15.6:0/1916397819 conn(0x7f5a400cfa20 msgr2=0x7f5a400cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:58.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.610+0000 7f5a47e00640 1 -- 172.21.15.6:0/1916397819 shutdown_connections 2024-09-10T20:55:58.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.611+0000 7f5a47e00640 1 -- 172.21.15.6:0/1916397819 wait complete. 2024-09-10T20:55:58.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.612+0000 7f5a47e00640 1 Processor -- start 2024-09-10T20:55:58.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.612+0000 7f5a47e00640 1 -- start start 2024-09-10T20:55:58.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.613+0000 7f5a47e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a28004000 0x7f5a400c3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:58.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.613+0000 7f5a47e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a40158d30 0x7f5a40152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:58.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.613+0000 7f5a47e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a400cdb30 0x7f5a400cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:58.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.613+0000 7f5a47e00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5a400b53b0 con 0x7f5a40158d30 2024-09-10T20:55:58.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.613+0000 7f5a47e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5a400b5230 con 0x7f5a400cdb30 2024-09-10T20:55:58.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.613+0000 7f5a47e00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f5a400743b0 con 0x7f5a28004000 2024-09-10T20:55:58.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.613+0000 7f5a44a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a40158d30 0x7f5a40152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:58.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.613+0000 7f5a44a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a40158d30 0x7f5a40152cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56172/0 (socket says 172.21.15.6:56172) 2024-09-10T20:55:58.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.613+0000 7f5a44a00640 1 -- 172.21.15.6:0/1506089043 learned_addr learned my addr 172.21.15.6:0/1506089043 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:58.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.613+0000 7f5a45400640 1 --2- 172.21.15.6:0/1506089043 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a28004000 0x7f5a400c3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:58.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.614+0000 7f5a45e00640 1 --2- 172.21.15.6:0/1506089043 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a400cdb30 0x7f5a400cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:58.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.614+0000 7f5a44a00640 1 -- 172.21.15.6:0/1506089043 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a28004000 msgr2=0x7f5a400c3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:58.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.614+0000 7f5a44a00640 1 --2- 172.21.15.6:0/1506089043 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a28004000 0x7f5a400c3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:58.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.614+0000 7f5a44a00640 1 -- 172.21.15.6:0/1506089043 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a400cdb30 msgr2=0x7f5a400cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:58.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.614+0000 7f5a44a00640 1 --2- 172.21.15.6:0/1506089043 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a400cdb30 0x7f5a400cdfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:58.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.614+0000 7f5a44a00640 1 -- 172.21.15.6:0/1506089043 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a400c6cb0 con 0x7f5a40158d30 2024-09-10T20:55:58.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.614+0000 7f5a45e00640 1 --2- 172.21.15.6:0/1506089043 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a400cdb30 0x7f5a400cdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:55:58.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.614+0000 7f5a44a00640 1 --2- 172.21.15.6:0/1506089043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a40158d30 0x7f5a40152cc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c00c400 tx=0x7f5a2c006420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:58.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.614+0000 7f5a3d600640 1 -- 172.21.15.6:0/1506089043 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c031030 con 0x7f5a40158d30 2024-09-10T20:55:58.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.614+0000 7f5a3d600640 1 -- 172.21.15.6:0/1506089043 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a2c0035f0 con 0x7f5a40158d30 2024-09-10T20:55:58.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.614+0000 7f5a3d600640 1 -- 172.21.15.6:0/1506089043 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c003a60 con 0x7f5a40158d30 2024-09-10T20:55:58.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.614+0000 7f5a47e00640 1 -- 172.21.15.6:0/1506089043 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a400c3b70 con 0x7f5a40158d30 2024-09-10T20:55:58.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.614+0000 7f5a47e00640 1 -- 172.21.15.6:0/1506089043 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a400c4130 con 0x7f5a40158d30 2024-09-10T20:55:58.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.616+0000 7f5a47e00640 1 -- 172.21.15.6:0/1506089043 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a400cd920 con 0x7f5a40158d30 2024-09-10T20:55:58.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.617+0000 7f5a3d600640 1 -- 172.21.15.6:0/1506089043 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5a2c003c00 con 0x7f5a40158d30 2024-09-10T20:55:58.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.617+0000 7f5a3d600640 1 --2- 172.21.15.6:0/1506089043 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5a20077f70 0x7f5a2007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:58.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.618+0000 7f5a3d600640 1 -- 172.21.15.6:0/1506089043 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f5a2c0b9d80 con 0x7f5a40158d30 2024-09-10T20:55:58.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.618+0000 7f5a45400640 1 --2- 172.21.15.6:0/1506089043 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5a20077f70 0x7f5a2007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:58.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.619+0000 7f5a45400640 1 --2- 172.21.15.6:0/1506089043 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5a20077f70 0x7f5a2007a430 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5a400cebc0 tx=0x7f5a34006b70 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:58.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.622+0000 7f5a3d600640 1 -- 172.21.15.6:0/1506089043 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5a2c0829f0 con 0x7f5a40158d30 2024-09-10T20:55:58.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.815+0000 7f5a47e00640 1 -- 172.21.15.6:0/1506089043 --> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5a400ce4f0 con 0x7f5a20077f70 2024-09-10T20:55:58.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.819+0000 7f5a3d600640 1 -- 172.21.15.6:0/1506089043 <== mgr.4120 v2:172.21.15.150:6800/1238179351 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251826 (secure 0 0 0) 0x7f5a400ce4f0 con 0x7f5a20077f70 2024-09-10T20:55:58.826 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:55:58.827 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-10T20:55:58.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.823+0000 7f5a47e00640 1 -- 172.21.15.6:0/1506089043 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5a20077f70 msgr2=0x7f5a2007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:58.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.823+0000 7f5a47e00640 1 --2- 172.21.15.6:0/1506089043 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5a20077f70 0x7f5a2007a430 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5a400cebc0 tx=0x7f5a34006b70 comp rx=0 tx=0).stop 2024-09-10T20:55:58.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.823+0000 7f5a47e00640 1 -- 172.21.15.6:0/1506089043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a40158d30 msgr2=0x7f5a40152cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:58.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.823+0000 7f5a47e00640 1 --2- 172.21.15.6:0/1506089043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a40158d30 0x7f5a40152cc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c00c400 tx=0x7f5a2c006420 comp rx=0 tx=0).stop 2024-09-10T20:55:58.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.823+0000 7f5a47e00640 1 -- 172.21.15.6:0/1506089043 shutdown_connections 2024-09-10T20:55:58.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.823+0000 7f5a47e00640 1 --2- 172.21.15.6:0/1506089043 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5a20077f70 0x7f5a2007a430 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:58.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.823+0000 7f5a47e00640 1 --2- 172.21.15.6:0/1506089043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a40158d30 0x7f5a40152cc0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:58.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.823+0000 7f5a47e00640 1 --2- 172.21.15.6:0/1506089043 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a400cdb30 0x7f5a400cdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:58.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.823+0000 7f5a47e00640 1 --2- 172.21.15.6:0/1506089043 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a28004000 0x7f5a400c3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:58.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.823+0000 7f5a47e00640 1 -- 172.21.15.6:0/1506089043 >> 172.21.15.6:0/1506089043 conn(0x7f5a400cfa20 msgr2=0x7f5a4015e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:58.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.823+0000 7f5a47e00640 1 -- 172.21.15.6:0/1506089043 shutdown_connections 2024-09-10T20:55:58.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:58.823+0000 7f5a47e00640 1 -- 172.21.15.6:0/1506089043 wait complete. 2024-09-10T20:55:58.842 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-09-10T20:55:57.174919+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219196,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755524,"statfs":{"total":773094113280,"available":772869656576,"internally_reserved":0,"allocated":3022848,"data_stored":1802804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.814953"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364560+0000","last_change":"2024-09-10T20:55:44.378371+0000","last_active":"2024-09-10T20:55:45.364560+0000","last_peered":"2024-09-10T20:55:45.364560+0000","last_clean":"2024-09-10T20:55:45.364560+0000","last_became_active":"2024-09-10T20:55:44.375917+0000","last_became_peered":"2024-09-10T20:55:44.375917+0000","last_unstale":"2024-09-10T20:55:45.364560+0000","last_undegraded":"2024-09-10T20:55:45.364560+0000","last_fullsized":"2024-09-10T20:55:45.364560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:55:42.603736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361499+0000","last_change":"2024-09-10T20:55:44.378072+0000","last_active":"2024-09-10T20:55:45.361499+0000","last_peered":"2024-09-10T20:55:45.361499+0000","last_clean":"2024-09-10T20:55:45.361499+0000","last_became_active":"2024-09-10T20:55:44.377702+0000","last_became_peered":"2024-09-10T20:55:44.377702+0000","last_unstale":"2024-09-10T20:55:45.361499+0000","last_undegraded":"2024-09-10T20:55:45.361499+0000","last_fullsized":"2024-09-10T20:55:45.361499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:19.756412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.619936+0000","last_change":"2024-09-10T20:55:44.373164+0000","last_active":"2024-09-10T20:55:47.619936+0000","last_peered":"2024-09-10T20:55:47.619936+0000","last_clean":"2024-09-10T20:55:47.619936+0000","last_became_active":"2024-09-10T20:55:44.370647+0000","last_became_peered":"2024-09-10T20:55:44.370647+0000","last_unstale":"2024-09-10T20:55:47.619936+0000","last_undegraded":"2024-09-10T20:55:47.619936+0000","last_fullsized":"2024-09-10T20:55:47.619936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:19.756412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364549+0000","last_change":"2024-09-10T20:55:44.383084+0000","last_active":"2024-09-10T20:55:45.364549+0000","last_peered":"2024-09-10T20:55:45.364549+0000","last_clean":"2024-09-10T20:55:45.364549+0000","last_became_active":"2024-09-10T20:55:44.382543+0000","last_became_peered":"2024-09-10T20:55:44.382543+0000","last_unstale":"2024-09-10T20:55:45.364549+0000","last_undegraded":"2024-09-10T20:55:45.364549+0000","last_fullsized":"2024-09-10T20:55:45.364549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:56.566092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362995+0000","last_change":"2024-09-10T20:55:44.373531+0000","last_active":"2024-09-10T20:55:45.362995+0000","last_peered":"2024-09-10T20:55:45.362995+0000","last_clean":"2024-09-10T20:55:45.362995+0000","last_became_active":"2024-09-10T20:55:44.373234+0000","last_became_peered":"2024-09-10T20:55:44.373234+0000","last_unstale":"2024-09-10T20:55:45.362995+0000","last_undegraded":"2024-09-10T20:55:45.362995+0000","last_fullsized":"2024-09-10T20:55:45.362995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:18:22.966502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362646+0000","last_change":"2024-09-10T20:55:44.375328+0000","last_active":"2024-09-10T20:55:45.362646+0000","last_peered":"2024-09-10T20:55:45.362646+0000","last_clean":"2024-09-10T20:55:45.362646+0000","last_became_active":"2024-09-10T20:55:44.375024+0000","last_became_peered":"2024-09-10T20:55:44.375024+0000","last_unstale":"2024-09-10T20:55:45.362646+0000","last_undegraded":"2024-09-10T20:55:45.362646+0000","last_fullsized":"2024-09-10T20:55:45.362646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:32:54.439682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362477+0000","last_change":"2024-09-10T20:55:44.385176+0000","last_active":"2024-09-10T20:55:45.362477+0000","last_peered":"2024-09-10T20:55:45.362477+0000","last_clean":"2024-09-10T20:55:45.362477+0000","last_became_active":"2024-09-10T20:55:44.384916+0000","last_became_peered":"2024-09-10T20:55:44.384916+0000","last_unstale":"2024-09-10T20:55:45.362477+0000","last_undegraded":"2024-09-10T20:55:45.362477+0000","last_fullsized":"2024-09-10T20:55:45.362477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:51:21.066719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.618773+0000","last_change":"2024-09-10T20:55:44.374342+0000","last_active":"2024-09-10T20:55:47.618773+0000","last_peered":"2024-09-10T20:55:47.618773+0000","last_clean":"2024-09-10T20:55:47.618773+0000","last_became_active":"2024-09-10T20:55:44.373477+0000","last_became_peered":"2024-09-10T20:55:44.373477+0000","last_unstale":"2024-09-10T20:55:47.618773+0000","last_undegraded":"2024-09-10T20:55:47.618773+0000","last_fullsized":"2024-09-10T20:55:47.618773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:31:28.477108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364578+0000","last_change":"2024-09-10T20:55:44.379912+0000","last_active":"2024-09-10T20:55:45.364578+0000","last_peered":"2024-09-10T20:55:45.364578+0000","last_clean":"2024-09-10T20:55:45.364578+0000","last_became_active":"2024-09-10T20:55:44.379632+0000","last_became_peered":"2024-09-10T20:55:44.379632+0000","last_unstale":"2024-09-10T20:55:45.364578+0000","last_undegraded":"2024-09-10T20:55:45.364578+0000","last_fullsized":"2024-09-10T20:55:45.364578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:31:58.187489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.356250+0000","last_change":"2024-09-10T20:55:44.379776+0000","last_active":"2024-09-10T20:55:46.356250+0000","last_peered":"2024-09-10T20:55:46.356250+0000","last_clean":"2024-09-10T20:55:46.356250+0000","last_became_active":"2024-09-10T20:55:44.379512+0000","last_became_peered":"2024-09-10T20:55:44.379512+0000","last_unstale":"2024-09-10T20:55:46.356250+0000","last_undegraded":"2024-09-10T20:55:46.356250+0000","last_fullsized":"2024-09-10T20:55:46.356250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:08.229059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.356236+0000","last_change":"2024-09-10T20:55:44.372935+0000","last_active":"2024-09-10T20:55:46.356236+0000","last_peered":"2024-09-10T20:55:46.356236+0000","last_clean":"2024-09-10T20:55:46.356236+0000","last_became_active":"2024-09-10T20:55:44.372660+0000","last_became_peered":"2024-09-10T20:55:44.372660+0000","last_unstale":"2024-09-10T20:55:46.356236+0000","last_undegraded":"2024-09-10T20:55:46.356236+0000","last_fullsized":"2024-09-10T20:55:46.356236+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:16:49.875268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.627691+0000","last_change":"2024-09-10T20:55:44.381853+0000","last_active":"2024-09-10T20:55:46.627691+0000","last_peered":"2024-09-10T20:55:46.627691+0000","last_clean":"2024-09-10T20:55:46.627691+0000","last_became_active":"2024-09-10T20:55:44.381283+0000","last_became_peered":"2024-09-10T20:55:44.381283+0000","last_unstale":"2024-09-10T20:55:46.627691+0000","last_undegraded":"2024-09-10T20:55:46.627691+0000","last_fullsized":"2024-09-10T20:55:46.627691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:01:41.450845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.619721+0000","last_change":"2024-09-10T20:55:44.380947+0000","last_active":"2024-09-10T20:55:47.619721+0000","last_peered":"2024-09-10T20:55:47.619721+0000","last_clean":"2024-09-10T20:55:47.619721+0000","last_became_active":"2024-09-10T20:55:44.380246+0000","last_became_peered":"2024-09-10T20:55:44.380246+0000","last_unstale":"2024-09-10T20:55:47.619721+0000","last_undegraded":"2024-09-10T20:55:47.619721+0000","last_fullsized":"2024-09-10T20:55:47.619721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:36:28.101716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.619064+0000","last_change":"2024-09-10T20:55:44.380329+0000","last_active":"2024-09-10T20:55:47.619064+0000","last_peered":"2024-09-10T20:55:47.619064+0000","last_clean":"2024-09-10T20:55:47.619064+0000","last_became_active":"2024-09-10T20:55:44.379878+0000","last_became_peered":"2024-09-10T20:55:44.379878+0000","last_unstale":"2024-09-10T20:55:47.619064+0000","last_undegraded":"2024-09-10T20:55:47.619064+0000","last_fullsized":"2024-09-10T20:55:47.619064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:48:38.749688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361378+0000","last_change":"2024-09-10T20:55:44.369874+0000","last_active":"2024-09-10T20:55:45.361378+0000","last_peered":"2024-09-10T20:55:45.361378+0000","last_clean":"2024-09-10T20:55:45.361378+0000","last_became_active":"2024-09-10T20:55:44.369125+0000","last_became_peered":"2024-09-10T20:55:44.369125+0000","last_unstale":"2024-09-10T20:55:45.361378+0000","last_undegraded":"2024-09-10T20:55:45.361378+0000","last_fullsized":"2024-09-10T20:55:45.361378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:48:52.277148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362575+0000","last_change":"2024-09-10T20:55:44.377717+0000","last_active":"2024-09-10T20:55:45.362575+0000","last_peered":"2024-09-10T20:55:45.362575+0000","last_clean":"2024-09-10T20:55:45.362575+0000","last_became_active":"2024-09-10T20:55:44.376176+0000","last_became_peered":"2024-09-10T20:55:44.376176+0000","last_unstale":"2024-09-10T20:55:45.362575+0000","last_undegraded":"2024-09-10T20:55:45.362575+0000","last_fullsized":"2024-09-10T20:55:45.362575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:19.756412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363854+0000","last_change":"2024-09-10T20:55:44.371382+0000","last_active":"2024-09-10T20:55:45.363854+0000","last_peered":"2024-09-10T20:55:45.363854+0000","last_clean":"2024-09-10T20:55:45.363854+0000","last_became_active":"2024-09-10T20:55:44.371044+0000","last_became_peered":"2024-09-10T20:55:44.371044+0000","last_unstale":"2024-09-10T20:55:45.363854+0000","last_undegraded":"2024-09-10T20:55:45.363854+0000","last_fullsized":"2024-09-10T20:55:45.363854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:31:48.282296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.918190+0000","last_change":"2024-09-10T20:55:44.375032+0000","last_active":"2024-09-10T20:55:45.918190+0000","last_peered":"2024-09-10T20:55:45.918190+0000","last_clean":"2024-09-10T20:55:45.918190+0000","last_became_active":"2024-09-10T20:55:44.374735+0000","last_became_peered":"2024-09-10T20:55:44.374735+0000","last_unstale":"2024-09-10T20:55:45.918190+0000","last_undegraded":"2024-09-10T20:55:45.918190+0000","last_fullsized":"2024-09-10T20:55:45.918190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:30.365247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364255+0000","last_change":"2024-09-10T20:55:44.379134+0000","last_active":"2024-09-10T20:55:45.364255+0000","last_peered":"2024-09-10T20:55:45.364255+0000","last_clean":"2024-09-10T20:55:45.364255+0000","last_became_active":"2024-09-10T20:55:44.378814+0000","last_became_peered":"2024-09-10T20:55:44.378814+0000","last_unstale":"2024-09-10T20:55:45.364255+0000","last_undegraded":"2024-09-10T20:55:45.364255+0000","last_fullsized":"2024-09-10T20:55:45.364255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:45:07.152884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.356325+0000","last_change":"2024-09-10T20:55:44.381800+0000","last_active":"2024-09-10T20:55:46.356325+0000","last_peered":"2024-09-10T20:55:46.356325+0000","last_clean":"2024-09-10T20:55:46.356325+0000","last_became_active":"2024-09-10T20:55:44.380382+0000","last_became_peered":"2024-09-10T20:55:44.380382+0000","last_unstale":"2024-09-10T20:55:46.356325+0000","last_undegraded":"2024-09-10T20:55:46.356325+0000","last_fullsized":"2024-09-10T20:55:46.356325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:58.419795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.619321+0000","last_change":"2024-09-10T20:55:44.385859+0000","last_active":"2024-09-10T20:55:47.619321+0000","last_peered":"2024-09-10T20:55:47.619321+0000","last_clean":"2024-09-10T20:55:47.619321+0000","last_became_active":"2024-09-10T20:55:44.383049+0000","last_became_peered":"2024-09-10T20:55:44.383049+0000","last_unstale":"2024-09-10T20:55:47.619321+0000","last_undegraded":"2024-09-10T20:55:47.619321+0000","last_fullsized":"2024-09-10T20:55:47.619321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:26:35.929548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362652+0000","last_change":"2024-09-10T20:55:44.373313+0000","last_active":"2024-09-10T20:55:45.362652+0000","last_peered":"2024-09-10T20:55:45.362652+0000","last_clean":"2024-09-10T20:55:45.362652+0000","last_became_active":"2024-09-10T20:55:44.372975+0000","last_became_peered":"2024-09-10T20:55:44.372975+0000","last_unstale":"2024-09-10T20:55:45.362652+0000","last_undegraded":"2024-09-10T20:55:45.362652+0000","last_fullsized":"2024-09-10T20:55:45.362652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:49:46.518440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.619157+0000","last_change":"2024-09-10T20:55:44.372460+0000","last_active":"2024-09-10T20:55:47.619157+0000","last_peered":"2024-09-10T20:55:47.619157+0000","last_clean":"2024-09-10T20:55:47.619157+0000","last_became_active":"2024-09-10T20:55:44.372166+0000","last_became_peered":"2024-09-10T20:55:44.372166+0000","last_unstale":"2024-09-10T20:55:47.619157+0000","last_undegraded":"2024-09-10T20:55:47.619157+0000","last_fullsized":"2024-09-10T20:55:47.619157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:13.189176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362773+0000","last_change":"2024-09-10T20:55:44.382439+0000","last_active":"2024-09-10T20:55:45.362773+0000","last_peered":"2024-09-10T20:55:45.362773+0000","last_clean":"2024-09-10T20:55:45.362773+0000","last_became_active":"2024-09-10T20:55:44.382157+0000","last_became_peered":"2024-09-10T20:55:44.382157+0000","last_unstale":"2024-09-10T20:55:45.362773+0000","last_undegraded":"2024-09-10T20:55:45.362773+0000","last_fullsized":"2024-09-10T20:55:45.362773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:51:21.066719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.620373+0000","last_change":"2024-09-10T20:55:44.379140+0000","last_active":"2024-09-10T20:55:47.620373+0000","last_peered":"2024-09-10T20:55:47.620373+0000","last_clean":"2024-09-10T20:55:47.620373+0000","last_became_active":"2024-09-10T20:55:44.378867+0000","last_became_peered":"2024-09-10T20:55:44.378867+0000","last_unstale":"2024-09-10T20:55:47.620373+0000","last_undegraded":"2024-09-10T20:55:47.620373+0000","last_fullsized":"2024-09-10T20:55:47.620373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:02:02.002953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.356316+0000","last_change":"2024-09-10T20:55:44.374130+0000","last_active":"2024-09-10T20:55:46.356316+0000","last_peered":"2024-09-10T20:55:46.356316+0000","last_clean":"2024-09-10T20:55:46.356316+0000","last_became_active":"2024-09-10T20:55:44.373755+0000","last_became_peered":"2024-09-10T20:55:44.373755+0000","last_unstale":"2024-09-10T20:55:46.356316+0000","last_undegraded":"2024-09-10T20:55:46.356316+0000","last_fullsized":"2024-09-10T20:55:46.356316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:19.756412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361498+0000","last_change":"2024-09-10T20:55:44.380940+0000","last_active":"2024-09-10T20:55:45.361498+0000","last_peered":"2024-09-10T20:55:45.361498+0000","last_clean":"2024-09-10T20:55:45.361498+0000","last_became_active":"2024-09-10T20:55:44.380667+0000","last_became_peered":"2024-09-10T20:55:44.380667+0000","last_unstale":"2024-09-10T20:55:45.361498+0000","last_undegraded":"2024-09-10T20:55:45.361498+0000","last_fullsized":"2024-09-10T20:55:45.361498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:08.229059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.620388+0000","last_change":"2024-09-10T20:55:44.380864+0000","last_active":"2024-09-10T20:55:47.620388+0000","last_peered":"2024-09-10T20:55:47.620388+0000","last_clean":"2024-09-10T20:55:47.620388+0000","last_became_active":"2024-09-10T20:55:44.380634+0000","last_became_peered":"2024-09-10T20:55:44.380634+0000","last_unstale":"2024-09-10T20:55:47.620388+0000","last_undegraded":"2024-09-10T20:55:47.620388+0000","last_fullsized":"2024-09-10T20:55:47.620388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:57.162069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.619406+0000","last_change":"2024-09-10T20:55:44.388198+0000","last_active":"2024-09-10T20:55:47.619406+0000","last_peered":"2024-09-10T20:55:47.619406+0000","last_clean":"2024-09-10T20:55:47.619406+0000","last_became_active":"2024-09-10T20:55:44.387343+0000","last_became_peered":"2024-09-10T20:55:44.387343+0000","last_unstale":"2024-09-10T20:55:47.619406+0000","last_undegraded":"2024-09-10T20:55:47.619406+0000","last_fullsized":"2024-09-10T20:55:47.619406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:21:11.284661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364492+0000","last_change":"2024-09-10T20:55:44.380482+0000","last_active":"2024-09-10T20:55:45.364492+0000","last_peered":"2024-09-10T20:55:45.364492+0000","last_clean":"2024-09-10T20:55:45.364492+0000","last_became_active":"2024-09-10T20:55:44.379945+0000","last_became_peered":"2024-09-10T20:55:44.379945+0000","last_unstale":"2024-09-10T20:55:45.364492+0000","last_undegraded":"2024-09-10T20:55:45.364492+0000","last_fullsized":"2024-09-10T20:55:45.364492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:15:59.746371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.918084+0000","last_change":"2024-09-10T20:55:44.369574+0000","last_active":"2024-09-10T20:55:45.918084+0000","last_peered":"2024-09-10T20:55:45.918084+0000","last_clean":"2024-09-10T20:55:45.918084+0000","last_became_active":"2024-09-10T20:55:44.365888+0000","last_became_peered":"2024-09-10T20:55:44.365888+0000","last_unstale":"2024-09-10T20:55:45.918084+0000","last_undegraded":"2024-09-10T20:55:45.918084+0000","last_fullsized":"2024-09-10T20:55:45.918084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:41:12.114462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.355892+0000","last_change":"2024-09-10T20:55:44.387588+0000","last_active":"2024-09-10T20:55:46.355892+0000","last_peered":"2024-09-10T20:55:46.355892+0000","last_clean":"2024-09-10T20:55:46.355892+0000","last_became_active":"2024-09-10T20:55:44.387293+0000","last_became_peered":"2024-09-10T20:55:44.387293+0000","last_unstale":"2024-09-10T20:55:46.355892+0000","last_undegraded":"2024-09-10T20:55:46.355892+0000","last_fullsized":"2024-09-10T20:55:46.355892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:26:35.929548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.627619+0000","last_change":"2024-09-10T20:55:44.364063+0000","last_active":"2024-09-10T20:55:46.627619+0000","last_peered":"2024-09-10T20:55:46.627619+0000","last_clean":"2024-09-10T20:55:46.627619+0000","last_became_active":"2024-09-10T20:55:44.363460+0000","last_became_peered":"2024-09-10T20:55:44.363460+0000","last_unstale":"2024-09-10T20:55:46.627619+0000","last_undegraded":"2024-09-10T20:55:46.627619+0000","last_fullsized":"2024-09-10T20:55:46.627619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:49.994707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.620144+0000","last_change":"2024-09-10T20:55:43.368822+0000","last_active":"2024-09-10T20:55:47.620144+0000","last_peered":"2024-09-10T20:55:47.620144+0000","last_clean":"2024-09-10T20:55:47.620144+0000","last_became_active":"2024-09-10T20:55:43.368565+0000","last_became_peered":"2024-09-10T20:55:43.368565+0000","last_unstale":"2024-09-10T20:55:47.620144+0000","last_undegraded":"2024-09-10T20:55:47.620144+0000","last_fullsized":"2024-09-10T20:55:47.620144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:23:19.583021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.619609+0000","last_change":"2024-09-10T20:55:44.372807+0000","last_active":"2024-09-10T20:55:47.619609+0000","last_peered":"2024-09-10T20:55:47.619609+0000","last_clean":"2024-09-10T20:55:47.619609+0000","last_became_active":"2024-09-10T20:55:44.372476+0000","last_became_peered":"2024-09-10T20:55:44.372476+0000","last_unstale":"2024-09-10T20:55:47.619609+0000","last_undegraded":"2024-09-10T20:55:47.619609+0000","last_fullsized":"2024-09-10T20:55:47.619609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:16:49.875268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.355691+0000","last_change":"2024-09-10T20:55:43.372918+0000","last_active":"2024-09-10T20:55:46.355691+0000","last_peered":"2024-09-10T20:55:46.355691+0000","last_clean":"2024-09-10T20:55:46.355691+0000","last_became_active":"2024-09-10T20:55:43.369953+0000","last_became_peered":"2024-09-10T20:55:43.369953+0000","last_unstale":"2024-09-10T20:55:46.355691+0000","last_undegraded":"2024-09-10T20:55:46.355691+0000","last_fullsized":"2024-09-10T20:55:46.355691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:51:58.280912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.619245+0000","last_change":"2024-09-10T20:55:43.370997+0000","last_active":"2024-09-10T20:55:47.619245+0000","last_peered":"2024-09-10T20:55:47.619245+0000","last_clean":"2024-09-10T20:55:47.619245+0000","last_became_active":"2024-09-10T20:55:43.370753+0000","last_became_peered":"2024-09-10T20:55:43.370753+0000","last_unstale":"2024-09-10T20:55:47.619245+0000","last_undegraded":"2024-09-10T20:55:47.619245+0000","last_fullsized":"2024-09-10T20:55:47.619245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:04:30.007942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.618843+0000","last_change":"2024-09-10T20:55:44.381520+0000","last_active":"2024-09-10T20:55:47.618843+0000","last_peered":"2024-09-10T20:55:47.618843+0000","last_clean":"2024-09-10T20:55:47.618843+0000","last_became_active":"2024-09-10T20:55:44.381184+0000","last_became_peered":"2024-09-10T20:55:44.381184+0000","last_unstale":"2024-09-10T20:55:47.618843+0000","last_undegraded":"2024-09-10T20:55:47.618843+0000","last_fullsized":"2024-09-10T20:55:47.618843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:10.680496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362827+0000","last_change":"2024-09-10T20:55:43.363749+0000","last_active":"2024-09-10T20:55:45.362827+0000","last_peered":"2024-09-10T20:55:45.362827+0000","last_clean":"2024-09-10T20:55:45.362827+0000","last_became_active":"2024-09-10T20:55:43.363070+0000","last_became_peered":"2024-09-10T20:55:43.363070+0000","last_unstale":"2024-09-10T20:55:45.362827+0000","last_undegraded":"2024-09-10T20:55:45.362827+0000","last_fullsized":"2024-09-10T20:55:45.362827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:44.779833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361364+0000","last_change":"2024-09-10T20:55:44.377537+0000","last_active":"2024-09-10T20:55:45.361364+0000","last_peered":"2024-09-10T20:55:45.361364+0000","last_clean":"2024-09-10T20:55:45.361364+0000","last_became_active":"2024-09-10T20:55:44.377261+0000","last_became_peered":"2024-09-10T20:55:44.377261+0000","last_unstale":"2024-09-10T20:55:45.361364+0000","last_undegraded":"2024-09-10T20:55:45.361364+0000","last_fullsized":"2024-09-10T20:55:45.361364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:21:11.284661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.356082+0000","last_change":"2024-09-10T20:55:43.371067+0000","last_active":"2024-09-10T20:55:46.356082+0000","last_peered":"2024-09-10T20:55:46.356082+0000","last_clean":"2024-09-10T20:55:46.356082+0000","last_became_active":"2024-09-10T20:55:43.370788+0000","last_became_peered":"2024-09-10T20:55:43.370788+0000","last_unstale":"2024-09-10T20:55:46.356082+0000","last_undegraded":"2024-09-10T20:55:46.356082+0000","last_fullsized":"2024-09-10T20:55:46.356082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:41:29.573514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363411+0000","last_change":"2024-09-10T20:55:44.378830+0000","last_active":"2024-09-10T20:55:45.363411+0000","last_peered":"2024-09-10T20:55:45.363411+0000","last_clean":"2024-09-10T20:55:45.363411+0000","last_became_active":"2024-09-10T20:55:44.378020+0000","last_became_peered":"2024-09-10T20:55:44.378020+0000","last_unstale":"2024-09-10T20:55:45.363411+0000","last_undegraded":"2024-09-10T20:55:45.363411+0000","last_fullsized":"2024-09-10T20:55:45.363411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:23:32.772228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363472+0000","last_change":"2024-09-10T20:55:43.372861+0000","last_active":"2024-09-10T20:55:45.363472+0000","last_peered":"2024-09-10T20:55:45.363472+0000","last_clean":"2024-09-10T20:55:45.363472+0000","last_became_active":"2024-09-10T20:55:43.372596+0000","last_became_peered":"2024-09-10T20:55:43.372596+0000","last_unstale":"2024-09-10T20:55:45.363472+0000","last_undegraded":"2024-09-10T20:55:45.363472+0000","last_fullsized":"2024-09-10T20:55:45.363472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:51:58.280912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.620083+0000","last_change":"2024-09-10T20:55:44.368307+0000","last_active":"2024-09-10T20:55:47.620083+0000","last_peered":"2024-09-10T20:55:47.620083+0000","last_clean":"2024-09-10T20:55:47.620083+0000","last_became_active":"2024-09-10T20:55:44.365395+0000","last_became_peered":"2024-09-10T20:55:44.365395+0000","last_unstale":"2024-09-10T20:55:47.620083+0000","last_undegraded":"2024-09-10T20:55:47.620083+0000","last_fullsized":"2024-09-10T20:55:47.620083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:32:54.439682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361560+0000","last_change":"2024-09-10T20:55:43.366971+0000","last_active":"2024-09-10T20:55:45.361560+0000","last_peered":"2024-09-10T20:55:45.361560+0000","last_clean":"2024-09-10T20:55:45.361560+0000","last_became_active":"2024-09-10T20:55:43.366692+0000","last_became_peered":"2024-09-10T20:55:43.366692+0000","last_unstale":"2024-09-10T20:55:45.361560+0000","last_undegraded":"2024-09-10T20:55:45.361560+0000","last_fullsized":"2024-09-10T20:55:45.361560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:04.606474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.627783+0000","last_change":"2024-09-10T20:55:44.368208+0000","last_active":"2024-09-10T20:55:46.627783+0000","last_peered":"2024-09-10T20:55:46.627783+0000","last_clean":"2024-09-10T20:55:46.627783+0000","last_became_active":"2024-09-10T20:55:44.367944+0000","last_became_peered":"2024-09-10T20:55:44.367944+0000","last_unstale":"2024-09-10T20:55:46.627783+0000","last_undegraded":"2024-09-10T20:55:46.627783+0000","last_fullsized":"2024-09-10T20:55:46.627783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:37:32.042518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.356052+0000","last_change":"2024-09-10T20:55:43.370938+0000","last_active":"2024-09-10T20:55:46.356052+0000","last_peered":"2024-09-10T20:55:46.356052+0000","last_clean":"2024-09-10T20:55:46.356052+0000","last_became_active":"2024-09-10T20:55:43.370674+0000","last_became_peered":"2024-09-10T20:55:43.370674+0000","last_unstale":"2024-09-10T20:55:46.356052+0000","last_undegraded":"2024-09-10T20:55:46.356052+0000","last_fullsized":"2024-09-10T20:55:46.356052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:52.212240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363966+0000","last_change":"2024-09-10T20:55:44.383665+0000","last_active":"2024-09-10T20:55:45.363966+0000","last_peered":"2024-09-10T20:55:45.363966+0000","last_clean":"2024-09-10T20:55:45.363966+0000","last_became_active":"2024-09-10T20:55:44.382473+0000","last_became_peered":"2024-09-10T20:55:44.382473+0000","last_unstale":"2024-09-10T20:55:45.363966+0000","last_undegraded":"2024-09-10T20:55:45.363966+0000","last_fullsized":"2024-09-10T20:55:45.363966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:04:31.815506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.619748+0000","last_change":"2024-09-10T20:55:43.365123+0000","last_active":"2024-09-10T20:55:47.619748+0000","last_peered":"2024-09-10T20:55:47.619748+0000","last_clean":"2024-09-10T20:55:47.619748+0000","last_became_active":"2024-09-10T20:55:43.364866+0000","last_became_peered":"2024-09-10T20:55:43.364866+0000","last_unstale":"2024-09-10T20:55:47.619748+0000","last_undegraded":"2024-09-10T20:55:47.619748+0000","last_fullsized":"2024-09-10T20:55:47.619748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:07:11.228176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.619098+0000","last_change":"2024-09-10T20:55:44.384522+0000","last_active":"2024-09-10T20:55:47.619098+0000","last_peered":"2024-09-10T20:55:47.619098+0000","last_clean":"2024-09-10T20:55:47.619098+0000","last_became_active":"2024-09-10T20:55:44.373788+0000","last_became_peered":"2024-09-10T20:55:44.373788+0000","last_unstale":"2024-09-10T20:55:47.619098+0000","last_undegraded":"2024-09-10T20:55:47.619098+0000","last_fullsized":"2024-09-10T20:55:47.619098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:52:15.023488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364231+0000","last_change":"2024-09-10T20:55:43.367632+0000","last_active":"2024-09-10T20:55:45.364231+0000","last_peered":"2024-09-10T20:55:45.364231+0000","last_clean":"2024-09-10T20:55:45.364231+0000","last_became_active":"2024-09-10T20:55:43.366886+0000","last_became_peered":"2024-09-10T20:55:43.366886+0000","last_unstale":"2024-09-10T20:55:45.364231+0000","last_undegraded":"2024-09-10T20:55:45.364231+0000","last_fullsized":"2024-09-10T20:55:45.364231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:52.212240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363214+0000","last_change":"2024-09-10T20:55:44.378167+0000","last_active":"2024-09-10T20:55:45.363214+0000","last_peered":"2024-09-10T20:55:45.363214+0000","last_clean":"2024-09-10T20:55:45.363214+0000","last_became_active":"2024-09-10T20:55:44.377891+0000","last_became_peered":"2024-09-10T20:55:44.377891+0000","last_unstale":"2024-09-10T20:55:45.363214+0000","last_undegraded":"2024-09-10T20:55:45.363214+0000","last_fullsized":"2024-09-10T20:55:45.363214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:03:40.884856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.355694+0000","last_change":"2024-09-10T20:55:43.374275+0000","last_active":"2024-09-10T20:55:46.355694+0000","last_peered":"2024-09-10T20:55:46.355694+0000","last_clean":"2024-09-10T20:55:46.355694+0000","last_became_active":"2024-09-10T20:55:43.373744+0000","last_became_peered":"2024-09-10T20:55:43.373744+0000","last_unstale":"2024-09-10T20:55:46.355694+0000","last_undegraded":"2024-09-10T20:55:46.355694+0000","last_fullsized":"2024-09-10T20:55:46.355694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:44.779833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.356079+0000","last_change":"2024-09-10T20:55:44.387669+0000","last_active":"2024-09-10T20:55:46.356079+0000","last_peered":"2024-09-10T20:55:46.356079+0000","last_clean":"2024-09-10T20:55:46.356079+0000","last_became_active":"2024-09-10T20:55:44.387385+0000","last_became_peered":"2024-09-10T20:55:44.387385+0000","last_unstale":"2024-09-10T20:55:46.356079+0000","last_undegraded":"2024-09-10T20:55:46.356079+0000","last_fullsized":"2024-09-10T20:55:46.356079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:55:40.289116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.918034+0000","last_change":"2024-09-10T20:55:43.364230+0000","last_active":"2024-09-10T20:55:45.918034+0000","last_peered":"2024-09-10T20:55:45.918034+0000","last_clean":"2024-09-10T20:55:45.918034+0000","last_became_active":"2024-09-10T20:55:43.363855+0000","last_became_peered":"2024-09-10T20:55:43.363855+0000","last_unstale":"2024-09-10T20:55:45.918034+0000","last_undegraded":"2024-09-10T20:55:45.918034+0000","last_fullsized":"2024-09-10T20:55:45.918034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:47:38.695432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362684+0000","last_change":"2024-09-10T20:55:44.377758+0000","last_active":"2024-09-10T20:55:45.362684+0000","last_peered":"2024-09-10T20:55:45.362684+0000","last_clean":"2024-09-10T20:55:45.362684+0000","last_became_active":"2024-09-10T20:55:44.376900+0000","last_became_peered":"2024-09-10T20:55:44.376900+0000","last_unstale":"2024-09-10T20:55:45.362684+0000","last_undegraded":"2024-09-10T20:55:45.362684+0000","last_fullsized":"2024-09-10T20:55:45.362684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:56.566092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.627648+0000","last_change":"2024-09-10T20:55:43.366524+0000","last_active":"2024-09-10T20:55:46.627648+0000","last_peered":"2024-09-10T20:55:46.627648+0000","last_clean":"2024-09-10T20:55:46.627648+0000","last_became_active":"2024-09-10T20:55:43.365064+0000","last_became_peered":"2024-09-10T20:55:43.365064+0000","last_unstale":"2024-09-10T20:55:46.627648+0000","last_undegraded":"2024-09-10T20:55:46.627648+0000","last_fullsized":"2024-09-10T20:55:46.627648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:35.578339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364979+0000","last_change":"2024-09-10T20:55:44.380007+0000","last_active":"2024-09-10T20:55:45.364979+0000","last_peered":"2024-09-10T20:55:45.364979+0000","last_clean":"2024-09-10T20:55:45.364979+0000","last_became_active":"2024-09-10T20:55:44.379509+0000","last_became_peered":"2024-09-10T20:55:44.379509+0000","last_unstale":"2024-09-10T20:55:45.364979+0000","last_undegraded":"2024-09-10T20:55:45.364979+0000","last_fullsized":"2024-09-10T20:55:45.364979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:19.493422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.918101+0000","last_change":"2024-09-10T20:55:43.367328+0000","last_active":"2024-09-10T20:55:45.918101+0000","last_peered":"2024-09-10T20:55:45.918101+0000","last_clean":"2024-09-10T20:55:45.918101+0000","last_became_active":"2024-09-10T20:55:43.366880+0000","last_became_peered":"2024-09-10T20:55:43.366880+0000","last_unstale":"2024-09-10T20:55:45.918101+0000","last_undegraded":"2024-09-10T20:55:45.918101+0000","last_fullsized":"2024-09-10T20:55:45.918101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:52.212240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364733+0000","last_change":"2024-09-10T20:55:44.387017+0000","last_active":"2024-09-10T20:55:45.364733+0000","last_peered":"2024-09-10T20:55:45.364733+0000","last_clean":"2024-09-10T20:55:45.364733+0000","last_became_active":"2024-09-10T20:55:44.386824+0000","last_became_peered":"2024-09-10T20:55:44.386824+0000","last_unstale":"2024-09-10T20:55:45.364733+0000","last_undegraded":"2024-09-10T20:55:45.364733+0000","last_fullsized":"2024-09-10T20:55:45.364733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:03.834745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361597+0000","last_change":"2024-09-10T20:55:43.363564+0000","last_active":"2024-09-10T20:55:45.361597+0000","last_peered":"2024-09-10T20:55:45.361597+0000","last_clean":"2024-09-10T20:55:45.361597+0000","last_became_active":"2024-09-10T20:55:43.363247+0000","last_became_peered":"2024-09-10T20:55:43.363247+0000","last_unstale":"2024-09-10T20:55:45.361597+0000","last_undegraded":"2024-09-10T20:55:45.361597+0000","last_fullsized":"2024-09-10T20:55:45.361597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:16.877259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363896+0000","last_change":"2024-09-10T20:55:44.382801+0000","last_active":"2024-09-10T20:55:45.363896+0000","last_peered":"2024-09-10T20:55:45.363896+0000","last_clean":"2024-09-10T20:55:45.363896+0000","last_became_active":"2024-09-10T20:55:44.382172+0000","last_became_peered":"2024-09-10T20:55:44.382172+0000","last_unstale":"2024-09-10T20:55:45.363896+0000","last_undegraded":"2024-09-10T20:55:45.363896+0000","last_fullsized":"2024-09-10T20:55:45.363896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:37:10.807087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.918024+0000","last_change":"2024-09-10T20:55:43.365372+0000","last_active":"2024-09-10T20:55:45.918024+0000","last_peered":"2024-09-10T20:55:45.918024+0000","last_clean":"2024-09-10T20:55:45.918024+0000","last_became_active":"2024-09-10T20:55:43.362283+0000","last_became_peered":"2024-09-10T20:55:43.362283+0000","last_unstale":"2024-09-10T20:55:45.918024+0000","last_undegraded":"2024-09-10T20:55:45.918024+0000","last_fullsized":"2024-09-10T20:55:45.918024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:51:58.280912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363976+0000","last_change":"2024-09-10T20:55:44.379042+0000","last_active":"2024-09-10T20:55:45.363976+0000","last_peered":"2024-09-10T20:55:45.363976+0000","last_clean":"2024-09-10T20:55:45.363976+0000","last_became_active":"2024-09-10T20:55:44.378742+0000","last_became_peered":"2024-09-10T20:55:44.378742+0000","last_unstale":"2024-09-10T20:55:45.363976+0000","last_undegraded":"2024-09-10T20:55:45.363976+0000","last_fullsized":"2024-09-10T20:55:45.363976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:27:25.913460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362265+0000","last_change":"2024-09-10T20:55:34.718784+0000","last_active":"2024-09-10T20:55:45.362265+0000","last_peered":"2024-09-10T20:55:45.362265+0000","last_clean":"2024-09-10T20:55:45.362265+0000","last_became_active":"2024-09-10T20:55:34.717616+0000","last_became_peered":"2024-09-10T20:55:34.717616+0000","last_unstale":"2024-09-10T20:55:45.362265+0000","last_undegraded":"2024-09-10T20:55:45.362265+0000","last_fullsized":"2024-09-10T20:55:45.362265+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:33.618098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:33.618098+0000","last_clean_scrub_stamp":"2024-09-10T20:55:33.618098+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:17.442729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362978+0000","last_change":"2024-09-10T20:55:43.364591+0000","last_active":"2024-09-10T20:55:45.362978+0000","last_peered":"2024-09-10T20:55:45.362978+0000","last_clean":"2024-09-10T20:55:45.362978+0000","last_became_active":"2024-09-10T20:55:43.363372+0000","last_became_peered":"2024-09-10T20:55:43.363372+0000","last_unstale":"2024-09-10T20:55:45.362978+0000","last_undegraded":"2024-09-10T20:55:45.362978+0000","last_fullsized":"2024-09-10T20:55:45.362978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:04.606474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.619744+0000","last_change":"2024-09-10T20:55:44.373563+0000","last_active":"2024-09-10T20:55:47.619744+0000","last_peered":"2024-09-10T20:55:47.619744+0000","last_clean":"2024-09-10T20:55:47.619744+0000","last_became_active":"2024-09-10T20:55:44.373244+0000","last_became_peered":"2024-09-10T20:55:44.373244+0000","last_unstale":"2024-09-10T20:55:47.619744+0000","last_undegraded":"2024-09-10T20:55:47.619744+0000","last_fullsized":"2024-09-10T20:55:47.619744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:57:35.324429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362107+0000","last_change":"2024-09-10T20:55:43.376868+0000","last_active":"2024-09-10T20:55:45.362107+0000","last_peered":"2024-09-10T20:55:45.362107+0000","last_clean":"2024-09-10T20:55:45.362107+0000","last_became_active":"2024-09-10T20:55:43.376616+0000","last_became_peered":"2024-09-10T20:55:43.376616+0000","last_unstale":"2024-09-10T20:55:45.362107+0000","last_undegraded":"2024-09-10T20:55:45.362107+0000","last_fullsized":"2024-09-10T20:55:45.362107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:04.606474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.618795+0000","last_change":"2024-09-10T20:55:44.370871+0000","last_active":"2024-09-10T20:55:47.618795+0000","last_peered":"2024-09-10T20:55:47.618795+0000","last_clean":"2024-09-10T20:55:47.618795+0000","last_became_active":"2024-09-10T20:55:44.370595+0000","last_became_peered":"2024-09-10T20:55:44.370595+0000","last_unstale":"2024-09-10T20:55:47.618795+0000","last_undegraded":"2024-09-10T20:55:47.618795+0000","last_fullsized":"2024-09-10T20:55:47.618795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:29:13.258273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.917992+0000","last_change":"2024-09-10T20:55:43.367129+0000","last_active":"2024-09-10T20:55:45.917992+0000","last_peered":"2024-09-10T20:55:45.917992+0000","last_clean":"2024-09-10T20:55:45.917992+0000","last_became_active":"2024-09-10T20:55:43.366825+0000","last_became_peered":"2024-09-10T20:55:43.366825+0000","last_unstale":"2024-09-10T20:55:45.917992+0000","last_undegraded":"2024-09-10T20:55:45.917992+0000","last_fullsized":"2024-09-10T20:55:45.917992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:44.779833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361375+0000","last_change":"2024-09-10T20:55:44.362975+0000","last_active":"2024-09-10T20:55:45.361375+0000","last_peered":"2024-09-10T20:55:45.361375+0000","last_clean":"2024-09-10T20:55:45.361375+0000","last_became_active":"2024-09-10T20:55:44.362495+0000","last_became_peered":"2024-09-10T20:55:44.362495+0000","last_unstale":"2024-09-10T20:55:45.361375+0000","last_undegraded":"2024-09-10T20:55:45.361375+0000","last_fullsized":"2024-09-10T20:55:45.361375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:01:47.424436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364336+0000","last_change":"2024-09-10T20:55:43.364574+0000","last_active":"2024-09-10T20:55:45.364336+0000","last_peered":"2024-09-10T20:55:45.364336+0000","last_clean":"2024-09-10T20:55:45.364336+0000","last_became_active":"2024-09-10T20:55:43.363895+0000","last_became_peered":"2024-09-10T20:55:43.363895+0000","last_unstale":"2024-09-10T20:55:45.364336+0000","last_undegraded":"2024-09-10T20:55:45.364336+0000","last_fullsized":"2024-09-10T20:55:45.364336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:41:29.573514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.627706+0000","last_change":"2024-09-10T20:55:44.377780+0000","last_active":"2024-09-10T20:55:46.627706+0000","last_peered":"2024-09-10T20:55:46.627706+0000","last_clean":"2024-09-10T20:55:46.627706+0000","last_became_active":"2024-09-10T20:55:44.377120+0000","last_became_peered":"2024-09-10T20:55:44.377120+0000","last_unstale":"2024-09-10T20:55:46.627706+0000","last_undegraded":"2024-09-10T20:55:46.627706+0000","last_fullsized":"2024-09-10T20:55:46.627706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:29.923800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361762+0000","last_change":"2024-09-10T20:55:43.374091+0000","last_active":"2024-09-10T20:55:45.361762+0000","last_peered":"2024-09-10T20:55:45.361762+0000","last_clean":"2024-09-10T20:55:45.361762+0000","last_became_active":"2024-09-10T20:55:43.373736+0000","last_became_peered":"2024-09-10T20:55:43.373736+0000","last_unstale":"2024-09-10T20:55:45.361762+0000","last_undegraded":"2024-09-10T20:55:45.361762+0000","last_fullsized":"2024-09-10T20:55:45.361762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:41:11.107382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364317+0000","last_change":"2024-09-10T20:55:44.382414+0000","last_active":"2024-09-10T20:55:45.364317+0000","last_peered":"2024-09-10T20:55:45.364317+0000","last_clean":"2024-09-10T20:55:45.364317+0000","last_became_active":"2024-09-10T20:55:44.382087+0000","last_became_peered":"2024-09-10T20:55:44.382087+0000","last_unstale":"2024-09-10T20:55:45.364317+0000","last_undegraded":"2024-09-10T20:55:45.364317+0000","last_fullsized":"2024-09-10T20:55:45.364317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:57.600887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364206+0000","last_change":"2024-09-10T20:55:43.380057+0000","last_active":"2024-09-10T20:55:45.364206+0000","last_peered":"2024-09-10T20:55:45.364206+0000","last_clean":"2024-09-10T20:55:45.364206+0000","last_became_active":"2024-09-10T20:55:43.379881+0000","last_became_peered":"2024-09-10T20:55:43.379881+0000","last_unstale":"2024-09-10T20:55:45.364206+0000","last_undegraded":"2024-09-10T20:55:45.364206+0000","last_fullsized":"2024-09-10T20:55:45.364206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:35:50.441609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361728+0000","last_change":"2024-09-10T20:55:44.362979+0000","last_active":"2024-09-10T20:55:45.361728+0000","last_peered":"2024-09-10T20:55:45.361728+0000","last_clean":"2024-09-10T20:55:45.361728+0000","last_became_active":"2024-09-10T20:55:44.362472+0000","last_became_peered":"2024-09-10T20:55:44.362472+0000","last_unstale":"2024-09-10T20:55:45.361728+0000","last_undegraded":"2024-09-10T20:55:45.361728+0000","last_fullsized":"2024-09-10T20:55:45.361728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:32:54.439682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361567+0000","last_change":"2024-09-10T20:55:43.372848+0000","last_active":"2024-09-10T20:55:45.361567+0000","last_peered":"2024-09-10T20:55:45.361567+0000","last_clean":"2024-09-10T20:55:45.361567+0000","last_became_active":"2024-09-10T20:55:43.372619+0000","last_became_peered":"2024-09-10T20:55:43.372619+0000","last_unstale":"2024-09-10T20:55:45.361567+0000","last_undegraded":"2024-09-10T20:55:45.361567+0000","last_fullsized":"2024-09-10T20:55:45.361567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:32.519717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.619659+0000","last_change":"2024-09-10T20:55:44.378521+0000","last_active":"2024-09-10T20:55:47.619659+0000","last_peered":"2024-09-10T20:55:47.619659+0000","last_clean":"2024-09-10T20:55:47.619659+0000","last_became_active":"2024-09-10T20:55:44.378187+0000","last_became_peered":"2024-09-10T20:55:44.378187+0000","last_unstale":"2024-09-10T20:55:47.619659+0000","last_undegraded":"2024-09-10T20:55:47.619659+0000","last_fullsized":"2024-09-10T20:55:47.619659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:10:30.574948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.356149+0000","last_change":"2024-09-10T20:55:43.374477+0000","last_active":"2024-09-10T20:55:46.356149+0000","last_peered":"2024-09-10T20:55:46.356149+0000","last_clean":"2024-09-10T20:55:46.356149+0000","last_became_active":"2024-09-10T20:55:43.373960+0000","last_became_peered":"2024-09-10T20:55:43.373960+0000","last_unstale":"2024-09-10T20:55:46.356149+0000","last_undegraded":"2024-09-10T20:55:46.356149+0000","last_fullsized":"2024-09-10T20:55:46.356149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:04.606474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.619460+0000","last_change":"2024-09-10T20:55:44.377264+0000","last_active":"2024-09-10T20:55:47.619460+0000","last_peered":"2024-09-10T20:55:47.619460+0000","last_clean":"2024-09-10T20:55:47.619460+0000","last_became_active":"2024-09-10T20:55:44.376997+0000","last_became_peered":"2024-09-10T20:55:44.376997+0000","last_unstale":"2024-09-10T20:55:47.619460+0000","last_undegraded":"2024-09-10T20:55:47.619460+0000","last_fullsized":"2024-09-10T20:55:47.619460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:55:40.289116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362099+0000","last_change":"2024-09-10T20:55:43.376292+0000","last_active":"2024-09-10T20:55:45.362099+0000","last_peered":"2024-09-10T20:55:45.362099+0000","last_clean":"2024-09-10T20:55:45.362099+0000","last_became_active":"2024-09-10T20:55:43.375988+0000","last_became_peered":"2024-09-10T20:55:43.375988+0000","last_unstale":"2024-09-10T20:55:45.362099+0000","last_undegraded":"2024-09-10T20:55:45.362099+0000","last_fullsized":"2024-09-10T20:55:45.362099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:41:29.573514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.627612+0000","last_change":"2024-09-10T20:55:44.372839+0000","last_active":"2024-09-10T20:55:46.627612+0000","last_peered":"2024-09-10T20:55:46.627612+0000","last_clean":"2024-09-10T20:55:46.627612+0000","last_became_active":"2024-09-10T20:55:44.372410+0000","last_became_peered":"2024-09-10T20:55:44.372410+0000","last_unstale":"2024-09-10T20:55:46.627612+0000","last_undegraded":"2024-09-10T20:55:46.627612+0000","last_fullsized":"2024-09-10T20:55:46.627612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:27:56.155122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361430+0000","last_change":"2024-09-10T20:55:43.376634+0000","last_active":"2024-09-10T20:55:45.361430+0000","last_peered":"2024-09-10T20:55:45.361430+0000","last_clean":"2024-09-10T20:55:45.361430+0000","last_became_active":"2024-09-10T20:55:43.376322+0000","last_became_peered":"2024-09-10T20:55:43.376322+0000","last_unstale":"2024-09-10T20:55:45.361430+0000","last_undegraded":"2024-09-10T20:55:45.361430+0000","last_fullsized":"2024-09-10T20:55:45.361430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:51:58.280912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.618996+0000","last_change":"2024-09-10T20:55:44.368404+0000","last_active":"2024-09-10T20:55:47.618996+0000","last_peered":"2024-09-10T20:55:47.618996+0000","last_clean":"2024-09-10T20:55:47.618996+0000","last_became_active":"2024-09-10T20:55:44.368024+0000","last_became_peered":"2024-09-10T20:55:44.368024+0000","last_unstale":"2024-09-10T20:55:47.618996+0000","last_undegraded":"2024-09-10T20:55:47.618996+0000","last_fullsized":"2024-09-10T20:55:47.618996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:18:57.908039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361426+0000","last_change":"2024-09-10T20:55:43.362895+0000","last_active":"2024-09-10T20:55:45.361426+0000","last_peered":"2024-09-10T20:55:45.361426+0000","last_clean":"2024-09-10T20:55:45.361426+0000","last_became_active":"2024-09-10T20:55:43.362589+0000","last_became_peered":"2024-09-10T20:55:43.362589+0000","last_unstale":"2024-09-10T20:55:45.361426+0000","last_undegraded":"2024-09-10T20:55:45.361426+0000","last_fullsized":"2024-09-10T20:55:45.361426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:52.212240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.620008+0000","last_change":"2024-09-10T20:55:44.390140+0000","last_active":"2024-09-10T20:55:47.620008+0000","last_peered":"2024-09-10T20:55:47.620008+0000","last_clean":"2024-09-10T20:55:47.620008+0000","last_became_active":"2024-09-10T20:55:44.389852+0000","last_became_peered":"2024-09-10T20:55:44.389852+0000","last_unstale":"2024-09-10T20:55:47.620008+0000","last_undegraded":"2024-09-10T20:55:47.620008+0000","last_fullsized":"2024-09-10T20:55:47.620008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:21:31.573395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363357+0000","last_change":"2024-09-10T20:55:43.376815+0000","last_active":"2024-09-10T20:55:45.363357+0000","last_peered":"2024-09-10T20:55:45.363357+0000","last_clean":"2024-09-10T20:55:45.363357+0000","last_became_active":"2024-09-10T20:55:43.376465+0000","last_became_peered":"2024-09-10T20:55:43.376465+0000","last_unstale":"2024-09-10T20:55:45.363357+0000","last_undegraded":"2024-09-10T20:55:45.363357+0000","last_fullsized":"2024-09-10T20:55:45.363357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:29.358166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.355895+0000","last_change":"2024-09-10T20:55:44.372811+0000","last_active":"2024-09-10T20:55:46.355895+0000","last_peered":"2024-09-10T20:55:46.355895+0000","last_clean":"2024-09-10T20:55:46.355895+0000","last_became_active":"2024-09-10T20:55:44.372498+0000","last_became_peered":"2024-09-10T20:55:44.372498+0000","last_unstale":"2024-09-10T20:55:46.355895+0000","last_undegraded":"2024-09-10T20:55:46.355895+0000","last_fullsized":"2024-09-10T20:55:46.355895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:03:43.922684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364096+0000","last_change":"2024-09-10T20:55:44.356261+0000","last_active":"2024-09-10T20:55:45.364096+0000","last_peered":"2024-09-10T20:55:45.364096+0000","last_clean":"2024-09-10T20:55:45.364096+0000","last_became_active":"2024-09-10T20:55:44.355918+0000","last_became_peered":"2024-09-10T20:55:44.355918+0000","last_unstale":"2024-09-10T20:55:45.364096+0000","last_undegraded":"2024-09-10T20:55:45.364096+0000","last_fullsized":"2024-09-10T20:55:45.364096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:57:27.229133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363650+0000","last_change":"2024-09-10T20:55:43.379354+0000","last_active":"2024-09-10T20:55:45.363650+0000","last_peered":"2024-09-10T20:55:45.363650+0000","last_clean":"2024-09-10T20:55:45.363650+0000","last_became_active":"2024-09-10T20:55:43.378912+0000","last_became_peered":"2024-09-10T20:55:43.378912+0000","last_unstale":"2024-09-10T20:55:45.363650+0000","last_undegraded":"2024-09-10T20:55:45.363650+0000","last_fullsized":"2024-09-10T20:55:45.363650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:16.877259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363676+0000","last_change":"2024-09-10T20:55:44.355826+0000","last_active":"2024-09-10T20:55:45.363676+0000","last_peered":"2024-09-10T20:55:45.363676+0000","last_clean":"2024-09-10T20:55:45.363676+0000","last_became_active":"2024-09-10T20:55:44.355502+0000","last_became_peered":"2024-09-10T20:55:44.355502+0000","last_unstale":"2024-09-10T20:55:45.363676+0000","last_undegraded":"2024-09-10T20:55:45.363676+0000","last_fullsized":"2024-09-10T20:55:45.363676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:46:20.226511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364080+0000","last_change":"2024-09-10T20:55:43.379688+0000","last_active":"2024-09-10T20:55:45.364080+0000","last_peered":"2024-09-10T20:55:45.364080+0000","last_clean":"2024-09-10T20:55:45.364080+0000","last_became_active":"2024-09-10T20:55:43.379480+0000","last_became_peered":"2024-09-10T20:55:43.379480+0000","last_unstale":"2024-09-10T20:55:45.364080+0000","last_undegraded":"2024-09-10T20:55:45.364080+0000","last_fullsized":"2024-09-10T20:55:45.364080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:41:11.107382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.619842+0000","last_change":"2024-09-10T20:55:44.381645+0000","last_active":"2024-09-10T20:55:47.619842+0000","last_peered":"2024-09-10T20:55:47.619842+0000","last_clean":"2024-09-10T20:55:47.619842+0000","last_became_active":"2024-09-10T20:55:44.376799+0000","last_became_peered":"2024-09-10T20:55:44.376799+0000","last_unstale":"2024-09-10T20:55:47.619842+0000","last_undegraded":"2024-09-10T20:55:47.619842+0000","last_fullsized":"2024-09-10T20:55:47.619842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:08.229059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.620479+0000","last_change":"2024-09-10T20:55:43.361529+0000","last_active":"2024-09-10T20:55:47.620479+0000","last_peered":"2024-09-10T20:55:47.620479+0000","last_clean":"2024-09-10T20:55:47.620479+0000","last_became_active":"2024-09-10T20:55:43.361270+0000","last_became_peered":"2024-09-10T20:55:43.361270+0000","last_unstale":"2024-09-10T20:55:47.620479+0000","last_undegraded":"2024-09-10T20:55:47.620479+0000","last_fullsized":"2024-09-10T20:55:47.620479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:26:10.795588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.619676+0000","last_change":"2024-09-10T20:55:44.378339+0000","last_active":"2024-09-10T20:55:47.619676+0000","last_peered":"2024-09-10T20:55:47.619676+0000","last_clean":"2024-09-10T20:55:47.619676+0000","last_became_active":"2024-09-10T20:55:44.378051+0000","last_became_peered":"2024-09-10T20:55:44.378051+0000","last_unstale":"2024-09-10T20:55:47.619676+0000","last_undegraded":"2024-09-10T20:55:47.619676+0000","last_fullsized":"2024-09-10T20:55:47.619676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:36.033123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.620088+0000","last_change":"2024-09-10T20:55:43.370516+0000","last_active":"2024-09-10T20:55:47.620088+0000","last_peered":"2024-09-10T20:55:47.620088+0000","last_clean":"2024-09-10T20:55:47.620088+0000","last_became_active":"2024-09-10T20:55:43.370211+0000","last_became_peered":"2024-09-10T20:55:43.370211+0000","last_unstale":"2024-09-10T20:55:47.620088+0000","last_undegraded":"2024-09-10T20:55:47.620088+0000","last_fullsized":"2024-09-10T20:55:47.620088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:53.823889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":819200,"data_stored":668106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":78768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":77246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":233472,"data_stored":77282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":77156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":77316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":827392,"data_stored":668162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":78768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T20:55:58.846 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T20:55:59.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.038+0000 7fc2e3200640 1 -- 172.21.15.6:0/2963294352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2e4073d50 msgr2=0x7fc2e415c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:59.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.038+0000 7fc2e3200640 1 --2- 172.21.15.6:0/2963294352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2e4073d50 0x7fc2e415c990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4072580 tx=0x7fc2cc02a530 comp rx=0 tx=0).stop 2024-09-10T20:55:59.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.039+0000 7fc2e3200640 1 -- 172.21.15.6:0/2963294352 shutdown_connections 2024-09-10T20:55:59.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.039+0000 7fc2e3200640 1 --2- 172.21.15.6:0/2963294352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2e4073d50 0x7fc2e415c990 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:59.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.039+0000 7fc2e3200640 1 -- 172.21.15.6:0/2963294352 >> 172.21.15.6:0/2963294352 conn(0x7fc2e406cf90 msgr2=0x7fc2e406d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:59.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.039+0000 7fc2e3200640 1 -- 172.21.15.6:0/2963294352 shutdown_connections 2024-09-10T20:55:59.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.039+0000 7fc2e3200640 1 -- 172.21.15.6:0/2963294352 wait complete. 2024-09-10T20:55:59.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.040+0000 7fc2e3200640 1 Processor -- start 2024-09-10T20:55:59.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.040+0000 7fc2e3200640 1 -- start start 2024-09-10T20:55:59.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.041+0000 7fc2e3200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2e406e180 0x7fc2e4145520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:59.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.041+0000 7fc2e3200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2e4073d50 0x7fc2e414cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:59.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.041+0000 7fc2e3200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2e40cfd30 0x7fc2e40cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:59.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.041+0000 7fc2e3200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e406e5f0 con 0x7fc2e4073d50 2024-09-10T20:55:59.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.041+0000 7fc2e3200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e4073490 con 0x7fc2e40cfd30 2024-09-10T20:55:59.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.041+0000 7fc2e3200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fc2e406e770 con 0x7fc2e406e180 2024-09-10T20:55:59.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.041+0000 7fc2dbe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2e4073d50 0x7fc2e414cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:59.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.041+0000 7fc2dbe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2e4073d50 0x7fc2e414cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56198/0 (socket says 172.21.15.6:56198) 2024-09-10T20:55:59.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.041+0000 7fc2dbe00640 1 -- 172.21.15.6:0/2866603424 learned_addr learned my addr 172.21.15.6:0/2866603424 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:59.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.042+0000 7fc2e1e00640 1 --2- 172.21.15.6:0/2866603424 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2e406e180 0x7fc2e4145520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:59.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.042+0000 7fc2e2800640 1 --2- 172.21.15.6:0/2866603424 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2e40cfd30 0x7fc2e40cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:59.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.042+0000 7fc2dbe00640 1 -- 172.21.15.6:0/2866603424 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2e406e180 msgr2=0x7fc2e4145520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:59.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.042+0000 7fc2dbe00640 1 --2- 172.21.15.6:0/2866603424 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2e406e180 0x7fc2e4145520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:59.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.042+0000 7fc2dbe00640 1 -- 172.21.15.6:0/2866603424 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2e40cfd30 msgr2=0x7fc2e40cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:59.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.042+0000 7fc2dbe00640 1 --2- 172.21.15.6:0/2866603424 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2e40cfd30 0x7fc2e40cdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:59.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.042+0000 7fc2dbe00640 1 -- 172.21.15.6:0/2866603424 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2e4152b60 con 0x7fc2e4073d50 2024-09-10T20:55:59.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.042+0000 7fc2dbe00640 1 --2- 172.21.15.6:0/2866603424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2e4073d50 0x7fc2e414cf90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc009850 tx=0x7fc2cc0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:59.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.042+0000 7fc2da000640 1 -- 172.21.15.6:0/2866603424 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc03f070 con 0x7fc2e4073d50 2024-09-10T20:55:59.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.042+0000 7fc2da000640 1 -- 172.21.15.6:0/2866603424 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc2cc004890 con 0x7fc2e4073d50 2024-09-10T20:55:59.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.042+0000 7fc2da000640 1 -- 172.21.15.6:0/2866603424 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc035030 con 0x7fc2e4073d50 2024-09-10T20:55:59.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.042+0000 7fc2e3200640 1 -- 172.21.15.6:0/2866603424 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2e4146cc0 con 0x7fc2e4073d50 2024-09-10T20:55:59.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.043+0000 7fc2e3200640 1 -- 172.21.15.6:0/2866603424 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2e4147280 con 0x7fc2e4073d50 2024-09-10T20:55:59.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.044+0000 7fc2e3200640 1 -- 172.21.15.6:0/2866603424 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2e415c990 con 0x7fc2e4073d50 2024-09-10T20:55:59.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.045+0000 7fc2da000640 1 -- 172.21.15.6:0/2866603424 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc2cc004ca0 con 0x7fc2e4073d50 2024-09-10T20:55:59.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.046+0000 7fc2da000640 1 --2- 172.21.15.6:0/2866603424 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fc2c0077f70 0x7fc2c007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:59.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.046+0000 7fc2da000640 1 -- 172.21.15.6:0/2866603424 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fc2cc0bafd0 con 0x7fc2e4073d50 2024-09-10T20:55:59.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.046+0000 7fc2e1e00640 1 --2- 172.21.15.6:0/2866603424 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fc2c0077f70 0x7fc2c007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:59.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.047+0000 7fc2e1e00640 1 --2- 172.21.15.6:0/2866603424 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fc2c0077f70 0x7fc2c007a430 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4007fd0 tx=0x7fc2d4009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:59.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.050+0000 7fc2da000640 1 -- 172.21.15.6:0/2866603424 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc2cc0833e0 con 0x7fc2e4073d50 2024-09-10T20:55:59.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.241+0000 7fc2e3200640 1 -- 172.21.15.6:0/2866603424 --> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc2e406fdf0 con 0x7fc2c0077f70 2024-09-10T20:55:59.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.246+0000 7fc2da000640 1 -- 172.21.15.6:0/2866603424 <== mgr.4120 v2:172.21.15.150:6800/1238179351 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251826 (secure 0 0 0) 0x7fc2e406fdf0 con 0x7fc2c0077f70 2024-09-10T20:55:59.253 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:55:59.254 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-10T20:55:59.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.250+0000 7fc2e3200640 1 -- 172.21.15.6:0/2866603424 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fc2c0077f70 msgr2=0x7fc2c007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:59.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.250+0000 7fc2e3200640 1 --2- 172.21.15.6:0/2866603424 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fc2c0077f70 0x7fc2c007a430 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4007fd0 tx=0x7fc2d4009040 comp rx=0 tx=0).stop 2024-09-10T20:55:59.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.250+0000 7fc2e3200640 1 -- 172.21.15.6:0/2866603424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2e4073d50 msgr2=0x7fc2e414cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:59.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.250+0000 7fc2e3200640 1 --2- 172.21.15.6:0/2866603424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2e4073d50 0x7fc2e414cf90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc009850 tx=0x7fc2cc0039e0 comp rx=0 tx=0).stop 2024-09-10T20:55:59.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.250+0000 7fc2e3200640 1 -- 172.21.15.6:0/2866603424 shutdown_connections 2024-09-10T20:55:59.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.250+0000 7fc2e3200640 1 --2- 172.21.15.6:0/2866603424 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fc2c0077f70 0x7fc2c007a430 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:59.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.250+0000 7fc2e3200640 1 --2- 172.21.15.6:0/2866603424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2e4073d50 0x7fc2e414cf90 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:59.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.250+0000 7fc2e3200640 1 --2- 172.21.15.6:0/2866603424 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2e40cfd30 0x7fc2e40cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:59.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.250+0000 7fc2e3200640 1 --2- 172.21.15.6:0/2866603424 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2e406e180 0x7fc2e4145520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:59.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.250+0000 7fc2e3200640 1 -- 172.21.15.6:0/2866603424 >> 172.21.15.6:0/2866603424 conn(0x7fc2e406cf90 msgr2=0x7fc2e415d560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:59.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.250+0000 7fc2e3200640 1 -- 172.21.15.6:0/2866603424 shutdown_connections 2024-09-10T20:55:59.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.250+0000 7fc2e3200640 1 -- 172.21.15.6:0/2866603424 wait complete. 2024-09-10T20:55:59.269 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-09-10T20:55:59.175687+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219196,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755524,"statfs":{"total":773094113280,"available":772869656576,"internally_reserved":0,"allocated":3022848,"data_stored":1802804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003781"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364560+0000","last_change":"2024-09-10T20:55:44.378371+0000","last_active":"2024-09-10T20:55:45.364560+0000","last_peered":"2024-09-10T20:55:45.364560+0000","last_clean":"2024-09-10T20:55:45.364560+0000","last_became_active":"2024-09-10T20:55:44.375917+0000","last_became_peered":"2024-09-10T20:55:44.375917+0000","last_unstale":"2024-09-10T20:55:45.364560+0000","last_undegraded":"2024-09-10T20:55:45.364560+0000","last_fullsized":"2024-09-10T20:55:45.364560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:55:42.603736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361499+0000","last_change":"2024-09-10T20:55:44.378072+0000","last_active":"2024-09-10T20:55:45.361499+0000","last_peered":"2024-09-10T20:55:45.361499+0000","last_clean":"2024-09-10T20:55:45.361499+0000","last_became_active":"2024-09-10T20:55:44.377702+0000","last_became_peered":"2024-09-10T20:55:44.377702+0000","last_unstale":"2024-09-10T20:55:45.361499+0000","last_undegraded":"2024-09-10T20:55:45.361499+0000","last_fullsized":"2024-09-10T20:55:45.361499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:19.756412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.619936+0000","last_change":"2024-09-10T20:55:44.373164+0000","last_active":"2024-09-10T20:55:47.619936+0000","last_peered":"2024-09-10T20:55:47.619936+0000","last_clean":"2024-09-10T20:55:47.619936+0000","last_became_active":"2024-09-10T20:55:44.370647+0000","last_became_peered":"2024-09-10T20:55:44.370647+0000","last_unstale":"2024-09-10T20:55:47.619936+0000","last_undegraded":"2024-09-10T20:55:47.619936+0000","last_fullsized":"2024-09-10T20:55:47.619936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:19.756412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364549+0000","last_change":"2024-09-10T20:55:44.383084+0000","last_active":"2024-09-10T20:55:45.364549+0000","last_peered":"2024-09-10T20:55:45.364549+0000","last_clean":"2024-09-10T20:55:45.364549+0000","last_became_active":"2024-09-10T20:55:44.382543+0000","last_became_peered":"2024-09-10T20:55:44.382543+0000","last_unstale":"2024-09-10T20:55:45.364549+0000","last_undegraded":"2024-09-10T20:55:45.364549+0000","last_fullsized":"2024-09-10T20:55:45.364549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:56.566092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362995+0000","last_change":"2024-09-10T20:55:44.373531+0000","last_active":"2024-09-10T20:55:45.362995+0000","last_peered":"2024-09-10T20:55:45.362995+0000","last_clean":"2024-09-10T20:55:45.362995+0000","last_became_active":"2024-09-10T20:55:44.373234+0000","last_became_peered":"2024-09-10T20:55:44.373234+0000","last_unstale":"2024-09-10T20:55:45.362995+0000","last_undegraded":"2024-09-10T20:55:45.362995+0000","last_fullsized":"2024-09-10T20:55:45.362995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:18:22.966502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362646+0000","last_change":"2024-09-10T20:55:44.375328+0000","last_active":"2024-09-10T20:55:45.362646+0000","last_peered":"2024-09-10T20:55:45.362646+0000","last_clean":"2024-09-10T20:55:45.362646+0000","last_became_active":"2024-09-10T20:55:44.375024+0000","last_became_peered":"2024-09-10T20:55:44.375024+0000","last_unstale":"2024-09-10T20:55:45.362646+0000","last_undegraded":"2024-09-10T20:55:45.362646+0000","last_fullsized":"2024-09-10T20:55:45.362646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:32:54.439682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362477+0000","last_change":"2024-09-10T20:55:44.385176+0000","last_active":"2024-09-10T20:55:45.362477+0000","last_peered":"2024-09-10T20:55:45.362477+0000","last_clean":"2024-09-10T20:55:45.362477+0000","last_became_active":"2024-09-10T20:55:44.384916+0000","last_became_peered":"2024-09-10T20:55:44.384916+0000","last_unstale":"2024-09-10T20:55:45.362477+0000","last_undegraded":"2024-09-10T20:55:45.362477+0000","last_fullsized":"2024-09-10T20:55:45.362477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:51:21.066719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.618773+0000","last_change":"2024-09-10T20:55:44.374342+0000","last_active":"2024-09-10T20:55:47.618773+0000","last_peered":"2024-09-10T20:55:47.618773+0000","last_clean":"2024-09-10T20:55:47.618773+0000","last_became_active":"2024-09-10T20:55:44.373477+0000","last_became_peered":"2024-09-10T20:55:44.373477+0000","last_unstale":"2024-09-10T20:55:47.618773+0000","last_undegraded":"2024-09-10T20:55:47.618773+0000","last_fullsized":"2024-09-10T20:55:47.618773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:31:28.477108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364578+0000","last_change":"2024-09-10T20:55:44.379912+0000","last_active":"2024-09-10T20:55:45.364578+0000","last_peered":"2024-09-10T20:55:45.364578+0000","last_clean":"2024-09-10T20:55:45.364578+0000","last_became_active":"2024-09-10T20:55:44.379632+0000","last_became_peered":"2024-09-10T20:55:44.379632+0000","last_unstale":"2024-09-10T20:55:45.364578+0000","last_undegraded":"2024-09-10T20:55:45.364578+0000","last_fullsized":"2024-09-10T20:55:45.364578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:31:58.187489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.356250+0000","last_change":"2024-09-10T20:55:44.379776+0000","last_active":"2024-09-10T20:55:46.356250+0000","last_peered":"2024-09-10T20:55:46.356250+0000","last_clean":"2024-09-10T20:55:46.356250+0000","last_became_active":"2024-09-10T20:55:44.379512+0000","last_became_peered":"2024-09-10T20:55:44.379512+0000","last_unstale":"2024-09-10T20:55:46.356250+0000","last_undegraded":"2024-09-10T20:55:46.356250+0000","last_fullsized":"2024-09-10T20:55:46.356250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:08.229059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.356236+0000","last_change":"2024-09-10T20:55:44.372935+0000","last_active":"2024-09-10T20:55:46.356236+0000","last_peered":"2024-09-10T20:55:46.356236+0000","last_clean":"2024-09-10T20:55:46.356236+0000","last_became_active":"2024-09-10T20:55:44.372660+0000","last_became_peered":"2024-09-10T20:55:44.372660+0000","last_unstale":"2024-09-10T20:55:46.356236+0000","last_undegraded":"2024-09-10T20:55:46.356236+0000","last_fullsized":"2024-09-10T20:55:46.356236+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:16:49.875268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.627691+0000","last_change":"2024-09-10T20:55:44.381853+0000","last_active":"2024-09-10T20:55:46.627691+0000","last_peered":"2024-09-10T20:55:46.627691+0000","last_clean":"2024-09-10T20:55:46.627691+0000","last_became_active":"2024-09-10T20:55:44.381283+0000","last_became_peered":"2024-09-10T20:55:44.381283+0000","last_unstale":"2024-09-10T20:55:46.627691+0000","last_undegraded":"2024-09-10T20:55:46.627691+0000","last_fullsized":"2024-09-10T20:55:46.627691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:01:41.450845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.619721+0000","last_change":"2024-09-10T20:55:44.380947+0000","last_active":"2024-09-10T20:55:47.619721+0000","last_peered":"2024-09-10T20:55:47.619721+0000","last_clean":"2024-09-10T20:55:47.619721+0000","last_became_active":"2024-09-10T20:55:44.380246+0000","last_became_peered":"2024-09-10T20:55:44.380246+0000","last_unstale":"2024-09-10T20:55:47.619721+0000","last_undegraded":"2024-09-10T20:55:47.619721+0000","last_fullsized":"2024-09-10T20:55:47.619721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:36:28.101716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.619064+0000","last_change":"2024-09-10T20:55:44.380329+0000","last_active":"2024-09-10T20:55:47.619064+0000","last_peered":"2024-09-10T20:55:47.619064+0000","last_clean":"2024-09-10T20:55:47.619064+0000","last_became_active":"2024-09-10T20:55:44.379878+0000","last_became_peered":"2024-09-10T20:55:44.379878+0000","last_unstale":"2024-09-10T20:55:47.619064+0000","last_undegraded":"2024-09-10T20:55:47.619064+0000","last_fullsized":"2024-09-10T20:55:47.619064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:48:38.749688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361378+0000","last_change":"2024-09-10T20:55:44.369874+0000","last_active":"2024-09-10T20:55:45.361378+0000","last_peered":"2024-09-10T20:55:45.361378+0000","last_clean":"2024-09-10T20:55:45.361378+0000","last_became_active":"2024-09-10T20:55:44.369125+0000","last_became_peered":"2024-09-10T20:55:44.369125+0000","last_unstale":"2024-09-10T20:55:45.361378+0000","last_undegraded":"2024-09-10T20:55:45.361378+0000","last_fullsized":"2024-09-10T20:55:45.361378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:48:52.277148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362575+0000","last_change":"2024-09-10T20:55:44.377717+0000","last_active":"2024-09-10T20:55:45.362575+0000","last_peered":"2024-09-10T20:55:45.362575+0000","last_clean":"2024-09-10T20:55:45.362575+0000","last_became_active":"2024-09-10T20:55:44.376176+0000","last_became_peered":"2024-09-10T20:55:44.376176+0000","last_unstale":"2024-09-10T20:55:45.362575+0000","last_undegraded":"2024-09-10T20:55:45.362575+0000","last_fullsized":"2024-09-10T20:55:45.362575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:19.756412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363854+0000","last_change":"2024-09-10T20:55:44.371382+0000","last_active":"2024-09-10T20:55:45.363854+0000","last_peered":"2024-09-10T20:55:45.363854+0000","last_clean":"2024-09-10T20:55:45.363854+0000","last_became_active":"2024-09-10T20:55:44.371044+0000","last_became_peered":"2024-09-10T20:55:44.371044+0000","last_unstale":"2024-09-10T20:55:45.363854+0000","last_undegraded":"2024-09-10T20:55:45.363854+0000","last_fullsized":"2024-09-10T20:55:45.363854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:31:48.282296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.918190+0000","last_change":"2024-09-10T20:55:44.375032+0000","last_active":"2024-09-10T20:55:45.918190+0000","last_peered":"2024-09-10T20:55:45.918190+0000","last_clean":"2024-09-10T20:55:45.918190+0000","last_became_active":"2024-09-10T20:55:44.374735+0000","last_became_peered":"2024-09-10T20:55:44.374735+0000","last_unstale":"2024-09-10T20:55:45.918190+0000","last_undegraded":"2024-09-10T20:55:45.918190+0000","last_fullsized":"2024-09-10T20:55:45.918190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:30.365247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364255+0000","last_change":"2024-09-10T20:55:44.379134+0000","last_active":"2024-09-10T20:55:45.364255+0000","last_peered":"2024-09-10T20:55:45.364255+0000","last_clean":"2024-09-10T20:55:45.364255+0000","last_became_active":"2024-09-10T20:55:44.378814+0000","last_became_peered":"2024-09-10T20:55:44.378814+0000","last_unstale":"2024-09-10T20:55:45.364255+0000","last_undegraded":"2024-09-10T20:55:45.364255+0000","last_fullsized":"2024-09-10T20:55:45.364255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:45:07.152884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.356325+0000","last_change":"2024-09-10T20:55:44.381800+0000","last_active":"2024-09-10T20:55:46.356325+0000","last_peered":"2024-09-10T20:55:46.356325+0000","last_clean":"2024-09-10T20:55:46.356325+0000","last_became_active":"2024-09-10T20:55:44.380382+0000","last_became_peered":"2024-09-10T20:55:44.380382+0000","last_unstale":"2024-09-10T20:55:46.356325+0000","last_undegraded":"2024-09-10T20:55:46.356325+0000","last_fullsized":"2024-09-10T20:55:46.356325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:58.419795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.619321+0000","last_change":"2024-09-10T20:55:44.385859+0000","last_active":"2024-09-10T20:55:47.619321+0000","last_peered":"2024-09-10T20:55:47.619321+0000","last_clean":"2024-09-10T20:55:47.619321+0000","last_became_active":"2024-09-10T20:55:44.383049+0000","last_became_peered":"2024-09-10T20:55:44.383049+0000","last_unstale":"2024-09-10T20:55:47.619321+0000","last_undegraded":"2024-09-10T20:55:47.619321+0000","last_fullsized":"2024-09-10T20:55:47.619321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:26:35.929548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362652+0000","last_change":"2024-09-10T20:55:44.373313+0000","last_active":"2024-09-10T20:55:45.362652+0000","last_peered":"2024-09-10T20:55:45.362652+0000","last_clean":"2024-09-10T20:55:45.362652+0000","last_became_active":"2024-09-10T20:55:44.372975+0000","last_became_peered":"2024-09-10T20:55:44.372975+0000","last_unstale":"2024-09-10T20:55:45.362652+0000","last_undegraded":"2024-09-10T20:55:45.362652+0000","last_fullsized":"2024-09-10T20:55:45.362652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:49:46.518440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.619157+0000","last_change":"2024-09-10T20:55:44.372460+0000","last_active":"2024-09-10T20:55:47.619157+0000","last_peered":"2024-09-10T20:55:47.619157+0000","last_clean":"2024-09-10T20:55:47.619157+0000","last_became_active":"2024-09-10T20:55:44.372166+0000","last_became_peered":"2024-09-10T20:55:44.372166+0000","last_unstale":"2024-09-10T20:55:47.619157+0000","last_undegraded":"2024-09-10T20:55:47.619157+0000","last_fullsized":"2024-09-10T20:55:47.619157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:13.189176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362773+0000","last_change":"2024-09-10T20:55:44.382439+0000","last_active":"2024-09-10T20:55:45.362773+0000","last_peered":"2024-09-10T20:55:45.362773+0000","last_clean":"2024-09-10T20:55:45.362773+0000","last_became_active":"2024-09-10T20:55:44.382157+0000","last_became_peered":"2024-09-10T20:55:44.382157+0000","last_unstale":"2024-09-10T20:55:45.362773+0000","last_undegraded":"2024-09-10T20:55:45.362773+0000","last_fullsized":"2024-09-10T20:55:45.362773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:51:21.066719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.620373+0000","last_change":"2024-09-10T20:55:44.379140+0000","last_active":"2024-09-10T20:55:47.620373+0000","last_peered":"2024-09-10T20:55:47.620373+0000","last_clean":"2024-09-10T20:55:47.620373+0000","last_became_active":"2024-09-10T20:55:44.378867+0000","last_became_peered":"2024-09-10T20:55:44.378867+0000","last_unstale":"2024-09-10T20:55:47.620373+0000","last_undegraded":"2024-09-10T20:55:47.620373+0000","last_fullsized":"2024-09-10T20:55:47.620373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:02:02.002953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.356316+0000","last_change":"2024-09-10T20:55:44.374130+0000","last_active":"2024-09-10T20:55:46.356316+0000","last_peered":"2024-09-10T20:55:46.356316+0000","last_clean":"2024-09-10T20:55:46.356316+0000","last_became_active":"2024-09-10T20:55:44.373755+0000","last_became_peered":"2024-09-10T20:55:44.373755+0000","last_unstale":"2024-09-10T20:55:46.356316+0000","last_undegraded":"2024-09-10T20:55:46.356316+0000","last_fullsized":"2024-09-10T20:55:46.356316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:19.756412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361498+0000","last_change":"2024-09-10T20:55:44.380940+0000","last_active":"2024-09-10T20:55:45.361498+0000","last_peered":"2024-09-10T20:55:45.361498+0000","last_clean":"2024-09-10T20:55:45.361498+0000","last_became_active":"2024-09-10T20:55:44.380667+0000","last_became_peered":"2024-09-10T20:55:44.380667+0000","last_unstale":"2024-09-10T20:55:45.361498+0000","last_undegraded":"2024-09-10T20:55:45.361498+0000","last_fullsized":"2024-09-10T20:55:45.361498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:08.229059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.620388+0000","last_change":"2024-09-10T20:55:44.380864+0000","last_active":"2024-09-10T20:55:47.620388+0000","last_peered":"2024-09-10T20:55:47.620388+0000","last_clean":"2024-09-10T20:55:47.620388+0000","last_became_active":"2024-09-10T20:55:44.380634+0000","last_became_peered":"2024-09-10T20:55:44.380634+0000","last_unstale":"2024-09-10T20:55:47.620388+0000","last_undegraded":"2024-09-10T20:55:47.620388+0000","last_fullsized":"2024-09-10T20:55:47.620388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:57.162069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.619406+0000","last_change":"2024-09-10T20:55:44.388198+0000","last_active":"2024-09-10T20:55:47.619406+0000","last_peered":"2024-09-10T20:55:47.619406+0000","last_clean":"2024-09-10T20:55:47.619406+0000","last_became_active":"2024-09-10T20:55:44.387343+0000","last_became_peered":"2024-09-10T20:55:44.387343+0000","last_unstale":"2024-09-10T20:55:47.619406+0000","last_undegraded":"2024-09-10T20:55:47.619406+0000","last_fullsized":"2024-09-10T20:55:47.619406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:21:11.284661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364492+0000","last_change":"2024-09-10T20:55:44.380482+0000","last_active":"2024-09-10T20:55:45.364492+0000","last_peered":"2024-09-10T20:55:45.364492+0000","last_clean":"2024-09-10T20:55:45.364492+0000","last_became_active":"2024-09-10T20:55:44.379945+0000","last_became_peered":"2024-09-10T20:55:44.379945+0000","last_unstale":"2024-09-10T20:55:45.364492+0000","last_undegraded":"2024-09-10T20:55:45.364492+0000","last_fullsized":"2024-09-10T20:55:45.364492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:15:59.746371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.918084+0000","last_change":"2024-09-10T20:55:44.369574+0000","last_active":"2024-09-10T20:55:45.918084+0000","last_peered":"2024-09-10T20:55:45.918084+0000","last_clean":"2024-09-10T20:55:45.918084+0000","last_became_active":"2024-09-10T20:55:44.365888+0000","last_became_peered":"2024-09-10T20:55:44.365888+0000","last_unstale":"2024-09-10T20:55:45.918084+0000","last_undegraded":"2024-09-10T20:55:45.918084+0000","last_fullsized":"2024-09-10T20:55:45.918084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:41:12.114462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.355892+0000","last_change":"2024-09-10T20:55:44.387588+0000","last_active":"2024-09-10T20:55:46.355892+0000","last_peered":"2024-09-10T20:55:46.355892+0000","last_clean":"2024-09-10T20:55:46.355892+0000","last_became_active":"2024-09-10T20:55:44.387293+0000","last_became_peered":"2024-09-10T20:55:44.387293+0000","last_unstale":"2024-09-10T20:55:46.355892+0000","last_undegraded":"2024-09-10T20:55:46.355892+0000","last_fullsized":"2024-09-10T20:55:46.355892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:26:35.929548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.627619+0000","last_change":"2024-09-10T20:55:44.364063+0000","last_active":"2024-09-10T20:55:46.627619+0000","last_peered":"2024-09-10T20:55:46.627619+0000","last_clean":"2024-09-10T20:55:46.627619+0000","last_became_active":"2024-09-10T20:55:44.363460+0000","last_became_peered":"2024-09-10T20:55:44.363460+0000","last_unstale":"2024-09-10T20:55:46.627619+0000","last_undegraded":"2024-09-10T20:55:46.627619+0000","last_fullsized":"2024-09-10T20:55:46.627619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:49.994707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.620144+0000","last_change":"2024-09-10T20:55:43.368822+0000","last_active":"2024-09-10T20:55:47.620144+0000","last_peered":"2024-09-10T20:55:47.620144+0000","last_clean":"2024-09-10T20:55:47.620144+0000","last_became_active":"2024-09-10T20:55:43.368565+0000","last_became_peered":"2024-09-10T20:55:43.368565+0000","last_unstale":"2024-09-10T20:55:47.620144+0000","last_undegraded":"2024-09-10T20:55:47.620144+0000","last_fullsized":"2024-09-10T20:55:47.620144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:23:19.583021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.619609+0000","last_change":"2024-09-10T20:55:44.372807+0000","last_active":"2024-09-10T20:55:47.619609+0000","last_peered":"2024-09-10T20:55:47.619609+0000","last_clean":"2024-09-10T20:55:47.619609+0000","last_became_active":"2024-09-10T20:55:44.372476+0000","last_became_peered":"2024-09-10T20:55:44.372476+0000","last_unstale":"2024-09-10T20:55:47.619609+0000","last_undegraded":"2024-09-10T20:55:47.619609+0000","last_fullsized":"2024-09-10T20:55:47.619609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:16:49.875268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.355691+0000","last_change":"2024-09-10T20:55:43.372918+0000","last_active":"2024-09-10T20:55:46.355691+0000","last_peered":"2024-09-10T20:55:46.355691+0000","last_clean":"2024-09-10T20:55:46.355691+0000","last_became_active":"2024-09-10T20:55:43.369953+0000","last_became_peered":"2024-09-10T20:55:43.369953+0000","last_unstale":"2024-09-10T20:55:46.355691+0000","last_undegraded":"2024-09-10T20:55:46.355691+0000","last_fullsized":"2024-09-10T20:55:46.355691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:51:58.280912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.619245+0000","last_change":"2024-09-10T20:55:43.370997+0000","last_active":"2024-09-10T20:55:47.619245+0000","last_peered":"2024-09-10T20:55:47.619245+0000","last_clean":"2024-09-10T20:55:47.619245+0000","last_became_active":"2024-09-10T20:55:43.370753+0000","last_became_peered":"2024-09-10T20:55:43.370753+0000","last_unstale":"2024-09-10T20:55:47.619245+0000","last_undegraded":"2024-09-10T20:55:47.619245+0000","last_fullsized":"2024-09-10T20:55:47.619245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:04:30.007942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.618843+0000","last_change":"2024-09-10T20:55:44.381520+0000","last_active":"2024-09-10T20:55:47.618843+0000","last_peered":"2024-09-10T20:55:47.618843+0000","last_clean":"2024-09-10T20:55:47.618843+0000","last_became_active":"2024-09-10T20:55:44.381184+0000","last_became_peered":"2024-09-10T20:55:44.381184+0000","last_unstale":"2024-09-10T20:55:47.618843+0000","last_undegraded":"2024-09-10T20:55:47.618843+0000","last_fullsized":"2024-09-10T20:55:47.618843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:10.680496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362827+0000","last_change":"2024-09-10T20:55:43.363749+0000","last_active":"2024-09-10T20:55:45.362827+0000","last_peered":"2024-09-10T20:55:45.362827+0000","last_clean":"2024-09-10T20:55:45.362827+0000","last_became_active":"2024-09-10T20:55:43.363070+0000","last_became_peered":"2024-09-10T20:55:43.363070+0000","last_unstale":"2024-09-10T20:55:45.362827+0000","last_undegraded":"2024-09-10T20:55:45.362827+0000","last_fullsized":"2024-09-10T20:55:45.362827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:44.779833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361364+0000","last_change":"2024-09-10T20:55:44.377537+0000","last_active":"2024-09-10T20:55:45.361364+0000","last_peered":"2024-09-10T20:55:45.361364+0000","last_clean":"2024-09-10T20:55:45.361364+0000","last_became_active":"2024-09-10T20:55:44.377261+0000","last_became_peered":"2024-09-10T20:55:44.377261+0000","last_unstale":"2024-09-10T20:55:45.361364+0000","last_undegraded":"2024-09-10T20:55:45.361364+0000","last_fullsized":"2024-09-10T20:55:45.361364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:21:11.284661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.356082+0000","last_change":"2024-09-10T20:55:43.371067+0000","last_active":"2024-09-10T20:55:46.356082+0000","last_peered":"2024-09-10T20:55:46.356082+0000","last_clean":"2024-09-10T20:55:46.356082+0000","last_became_active":"2024-09-10T20:55:43.370788+0000","last_became_peered":"2024-09-10T20:55:43.370788+0000","last_unstale":"2024-09-10T20:55:46.356082+0000","last_undegraded":"2024-09-10T20:55:46.356082+0000","last_fullsized":"2024-09-10T20:55:46.356082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:41:29.573514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363411+0000","last_change":"2024-09-10T20:55:44.378830+0000","last_active":"2024-09-10T20:55:45.363411+0000","last_peered":"2024-09-10T20:55:45.363411+0000","last_clean":"2024-09-10T20:55:45.363411+0000","last_became_active":"2024-09-10T20:55:44.378020+0000","last_became_peered":"2024-09-10T20:55:44.378020+0000","last_unstale":"2024-09-10T20:55:45.363411+0000","last_undegraded":"2024-09-10T20:55:45.363411+0000","last_fullsized":"2024-09-10T20:55:45.363411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:23:32.772228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363472+0000","last_change":"2024-09-10T20:55:43.372861+0000","last_active":"2024-09-10T20:55:45.363472+0000","last_peered":"2024-09-10T20:55:45.363472+0000","last_clean":"2024-09-10T20:55:45.363472+0000","last_became_active":"2024-09-10T20:55:43.372596+0000","last_became_peered":"2024-09-10T20:55:43.372596+0000","last_unstale":"2024-09-10T20:55:45.363472+0000","last_undegraded":"2024-09-10T20:55:45.363472+0000","last_fullsized":"2024-09-10T20:55:45.363472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:51:58.280912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.620083+0000","last_change":"2024-09-10T20:55:44.368307+0000","last_active":"2024-09-10T20:55:47.620083+0000","last_peered":"2024-09-10T20:55:47.620083+0000","last_clean":"2024-09-10T20:55:47.620083+0000","last_became_active":"2024-09-10T20:55:44.365395+0000","last_became_peered":"2024-09-10T20:55:44.365395+0000","last_unstale":"2024-09-10T20:55:47.620083+0000","last_undegraded":"2024-09-10T20:55:47.620083+0000","last_fullsized":"2024-09-10T20:55:47.620083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:32:54.439682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361560+0000","last_change":"2024-09-10T20:55:43.366971+0000","last_active":"2024-09-10T20:55:45.361560+0000","last_peered":"2024-09-10T20:55:45.361560+0000","last_clean":"2024-09-10T20:55:45.361560+0000","last_became_active":"2024-09-10T20:55:43.366692+0000","last_became_peered":"2024-09-10T20:55:43.366692+0000","last_unstale":"2024-09-10T20:55:45.361560+0000","last_undegraded":"2024-09-10T20:55:45.361560+0000","last_fullsized":"2024-09-10T20:55:45.361560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:04.606474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.627783+0000","last_change":"2024-09-10T20:55:44.368208+0000","last_active":"2024-09-10T20:55:46.627783+0000","last_peered":"2024-09-10T20:55:46.627783+0000","last_clean":"2024-09-10T20:55:46.627783+0000","last_became_active":"2024-09-10T20:55:44.367944+0000","last_became_peered":"2024-09-10T20:55:44.367944+0000","last_unstale":"2024-09-10T20:55:46.627783+0000","last_undegraded":"2024-09-10T20:55:46.627783+0000","last_fullsized":"2024-09-10T20:55:46.627783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:37:32.042518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.356052+0000","last_change":"2024-09-10T20:55:43.370938+0000","last_active":"2024-09-10T20:55:46.356052+0000","last_peered":"2024-09-10T20:55:46.356052+0000","last_clean":"2024-09-10T20:55:46.356052+0000","last_became_active":"2024-09-10T20:55:43.370674+0000","last_became_peered":"2024-09-10T20:55:43.370674+0000","last_unstale":"2024-09-10T20:55:46.356052+0000","last_undegraded":"2024-09-10T20:55:46.356052+0000","last_fullsized":"2024-09-10T20:55:46.356052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:52.212240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363966+0000","last_change":"2024-09-10T20:55:44.383665+0000","last_active":"2024-09-10T20:55:45.363966+0000","last_peered":"2024-09-10T20:55:45.363966+0000","last_clean":"2024-09-10T20:55:45.363966+0000","last_became_active":"2024-09-10T20:55:44.382473+0000","last_became_peered":"2024-09-10T20:55:44.382473+0000","last_unstale":"2024-09-10T20:55:45.363966+0000","last_undegraded":"2024-09-10T20:55:45.363966+0000","last_fullsized":"2024-09-10T20:55:45.363966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:04:31.815506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.619748+0000","last_change":"2024-09-10T20:55:43.365123+0000","last_active":"2024-09-10T20:55:47.619748+0000","last_peered":"2024-09-10T20:55:47.619748+0000","last_clean":"2024-09-10T20:55:47.619748+0000","last_became_active":"2024-09-10T20:55:43.364866+0000","last_became_peered":"2024-09-10T20:55:43.364866+0000","last_unstale":"2024-09-10T20:55:47.619748+0000","last_undegraded":"2024-09-10T20:55:47.619748+0000","last_fullsized":"2024-09-10T20:55:47.619748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:07:11.228176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.619098+0000","last_change":"2024-09-10T20:55:44.384522+0000","last_active":"2024-09-10T20:55:47.619098+0000","last_peered":"2024-09-10T20:55:47.619098+0000","last_clean":"2024-09-10T20:55:47.619098+0000","last_became_active":"2024-09-10T20:55:44.373788+0000","last_became_peered":"2024-09-10T20:55:44.373788+0000","last_unstale":"2024-09-10T20:55:47.619098+0000","last_undegraded":"2024-09-10T20:55:47.619098+0000","last_fullsized":"2024-09-10T20:55:47.619098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:52:15.023488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364231+0000","last_change":"2024-09-10T20:55:43.367632+0000","last_active":"2024-09-10T20:55:45.364231+0000","last_peered":"2024-09-10T20:55:45.364231+0000","last_clean":"2024-09-10T20:55:45.364231+0000","last_became_active":"2024-09-10T20:55:43.366886+0000","last_became_peered":"2024-09-10T20:55:43.366886+0000","last_unstale":"2024-09-10T20:55:45.364231+0000","last_undegraded":"2024-09-10T20:55:45.364231+0000","last_fullsized":"2024-09-10T20:55:45.364231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:52.212240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363214+0000","last_change":"2024-09-10T20:55:44.378167+0000","last_active":"2024-09-10T20:55:45.363214+0000","last_peered":"2024-09-10T20:55:45.363214+0000","last_clean":"2024-09-10T20:55:45.363214+0000","last_became_active":"2024-09-10T20:55:44.377891+0000","last_became_peered":"2024-09-10T20:55:44.377891+0000","last_unstale":"2024-09-10T20:55:45.363214+0000","last_undegraded":"2024-09-10T20:55:45.363214+0000","last_fullsized":"2024-09-10T20:55:45.363214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:03:40.884856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.355694+0000","last_change":"2024-09-10T20:55:43.374275+0000","last_active":"2024-09-10T20:55:46.355694+0000","last_peered":"2024-09-10T20:55:46.355694+0000","last_clean":"2024-09-10T20:55:46.355694+0000","last_became_active":"2024-09-10T20:55:43.373744+0000","last_became_peered":"2024-09-10T20:55:43.373744+0000","last_unstale":"2024-09-10T20:55:46.355694+0000","last_undegraded":"2024-09-10T20:55:46.355694+0000","last_fullsized":"2024-09-10T20:55:46.355694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:44.779833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.356079+0000","last_change":"2024-09-10T20:55:44.387669+0000","last_active":"2024-09-10T20:55:46.356079+0000","last_peered":"2024-09-10T20:55:46.356079+0000","last_clean":"2024-09-10T20:55:46.356079+0000","last_became_active":"2024-09-10T20:55:44.387385+0000","last_became_peered":"2024-09-10T20:55:44.387385+0000","last_unstale":"2024-09-10T20:55:46.356079+0000","last_undegraded":"2024-09-10T20:55:46.356079+0000","last_fullsized":"2024-09-10T20:55:46.356079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:55:40.289116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.918034+0000","last_change":"2024-09-10T20:55:43.364230+0000","last_active":"2024-09-10T20:55:45.918034+0000","last_peered":"2024-09-10T20:55:45.918034+0000","last_clean":"2024-09-10T20:55:45.918034+0000","last_became_active":"2024-09-10T20:55:43.363855+0000","last_became_peered":"2024-09-10T20:55:43.363855+0000","last_unstale":"2024-09-10T20:55:45.918034+0000","last_undegraded":"2024-09-10T20:55:45.918034+0000","last_fullsized":"2024-09-10T20:55:45.918034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:47:38.695432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362684+0000","last_change":"2024-09-10T20:55:44.377758+0000","last_active":"2024-09-10T20:55:45.362684+0000","last_peered":"2024-09-10T20:55:45.362684+0000","last_clean":"2024-09-10T20:55:45.362684+0000","last_became_active":"2024-09-10T20:55:44.376900+0000","last_became_peered":"2024-09-10T20:55:44.376900+0000","last_unstale":"2024-09-10T20:55:45.362684+0000","last_undegraded":"2024-09-10T20:55:45.362684+0000","last_fullsized":"2024-09-10T20:55:45.362684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:56.566092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.627648+0000","last_change":"2024-09-10T20:55:43.366524+0000","last_active":"2024-09-10T20:55:46.627648+0000","last_peered":"2024-09-10T20:55:46.627648+0000","last_clean":"2024-09-10T20:55:46.627648+0000","last_became_active":"2024-09-10T20:55:43.365064+0000","last_became_peered":"2024-09-10T20:55:43.365064+0000","last_unstale":"2024-09-10T20:55:46.627648+0000","last_undegraded":"2024-09-10T20:55:46.627648+0000","last_fullsized":"2024-09-10T20:55:46.627648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:35.578339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364979+0000","last_change":"2024-09-10T20:55:44.380007+0000","last_active":"2024-09-10T20:55:45.364979+0000","last_peered":"2024-09-10T20:55:45.364979+0000","last_clean":"2024-09-10T20:55:45.364979+0000","last_became_active":"2024-09-10T20:55:44.379509+0000","last_became_peered":"2024-09-10T20:55:44.379509+0000","last_unstale":"2024-09-10T20:55:45.364979+0000","last_undegraded":"2024-09-10T20:55:45.364979+0000","last_fullsized":"2024-09-10T20:55:45.364979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:19.493422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.918101+0000","last_change":"2024-09-10T20:55:43.367328+0000","last_active":"2024-09-10T20:55:45.918101+0000","last_peered":"2024-09-10T20:55:45.918101+0000","last_clean":"2024-09-10T20:55:45.918101+0000","last_became_active":"2024-09-10T20:55:43.366880+0000","last_became_peered":"2024-09-10T20:55:43.366880+0000","last_unstale":"2024-09-10T20:55:45.918101+0000","last_undegraded":"2024-09-10T20:55:45.918101+0000","last_fullsized":"2024-09-10T20:55:45.918101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:52.212240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364733+0000","last_change":"2024-09-10T20:55:44.387017+0000","last_active":"2024-09-10T20:55:45.364733+0000","last_peered":"2024-09-10T20:55:45.364733+0000","last_clean":"2024-09-10T20:55:45.364733+0000","last_became_active":"2024-09-10T20:55:44.386824+0000","last_became_peered":"2024-09-10T20:55:44.386824+0000","last_unstale":"2024-09-10T20:55:45.364733+0000","last_undegraded":"2024-09-10T20:55:45.364733+0000","last_fullsized":"2024-09-10T20:55:45.364733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:03.834745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361597+0000","last_change":"2024-09-10T20:55:43.363564+0000","last_active":"2024-09-10T20:55:45.361597+0000","last_peered":"2024-09-10T20:55:45.361597+0000","last_clean":"2024-09-10T20:55:45.361597+0000","last_became_active":"2024-09-10T20:55:43.363247+0000","last_became_peered":"2024-09-10T20:55:43.363247+0000","last_unstale":"2024-09-10T20:55:45.361597+0000","last_undegraded":"2024-09-10T20:55:45.361597+0000","last_fullsized":"2024-09-10T20:55:45.361597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:16.877259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363896+0000","last_change":"2024-09-10T20:55:44.382801+0000","last_active":"2024-09-10T20:55:45.363896+0000","last_peered":"2024-09-10T20:55:45.363896+0000","last_clean":"2024-09-10T20:55:45.363896+0000","last_became_active":"2024-09-10T20:55:44.382172+0000","last_became_peered":"2024-09-10T20:55:44.382172+0000","last_unstale":"2024-09-10T20:55:45.363896+0000","last_undegraded":"2024-09-10T20:55:45.363896+0000","last_fullsized":"2024-09-10T20:55:45.363896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:37:10.807087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.918024+0000","last_change":"2024-09-10T20:55:43.365372+0000","last_active":"2024-09-10T20:55:45.918024+0000","last_peered":"2024-09-10T20:55:45.918024+0000","last_clean":"2024-09-10T20:55:45.918024+0000","last_became_active":"2024-09-10T20:55:43.362283+0000","last_became_peered":"2024-09-10T20:55:43.362283+0000","last_unstale":"2024-09-10T20:55:45.918024+0000","last_undegraded":"2024-09-10T20:55:45.918024+0000","last_fullsized":"2024-09-10T20:55:45.918024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:51:58.280912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363976+0000","last_change":"2024-09-10T20:55:44.379042+0000","last_active":"2024-09-10T20:55:45.363976+0000","last_peered":"2024-09-10T20:55:45.363976+0000","last_clean":"2024-09-10T20:55:45.363976+0000","last_became_active":"2024-09-10T20:55:44.378742+0000","last_became_peered":"2024-09-10T20:55:44.378742+0000","last_unstale":"2024-09-10T20:55:45.363976+0000","last_undegraded":"2024-09-10T20:55:45.363976+0000","last_fullsized":"2024-09-10T20:55:45.363976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:27:25.913460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362265+0000","last_change":"2024-09-10T20:55:34.718784+0000","last_active":"2024-09-10T20:55:45.362265+0000","last_peered":"2024-09-10T20:55:45.362265+0000","last_clean":"2024-09-10T20:55:45.362265+0000","last_became_active":"2024-09-10T20:55:34.717616+0000","last_became_peered":"2024-09-10T20:55:34.717616+0000","last_unstale":"2024-09-10T20:55:45.362265+0000","last_undegraded":"2024-09-10T20:55:45.362265+0000","last_fullsized":"2024-09-10T20:55:45.362265+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:33.618098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:33.618098+0000","last_clean_scrub_stamp":"2024-09-10T20:55:33.618098+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:17.442729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362978+0000","last_change":"2024-09-10T20:55:43.364591+0000","last_active":"2024-09-10T20:55:45.362978+0000","last_peered":"2024-09-10T20:55:45.362978+0000","last_clean":"2024-09-10T20:55:45.362978+0000","last_became_active":"2024-09-10T20:55:43.363372+0000","last_became_peered":"2024-09-10T20:55:43.363372+0000","last_unstale":"2024-09-10T20:55:45.362978+0000","last_undegraded":"2024-09-10T20:55:45.362978+0000","last_fullsized":"2024-09-10T20:55:45.362978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:04.606474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.619744+0000","last_change":"2024-09-10T20:55:44.373563+0000","last_active":"2024-09-10T20:55:47.619744+0000","last_peered":"2024-09-10T20:55:47.619744+0000","last_clean":"2024-09-10T20:55:47.619744+0000","last_became_active":"2024-09-10T20:55:44.373244+0000","last_became_peered":"2024-09-10T20:55:44.373244+0000","last_unstale":"2024-09-10T20:55:47.619744+0000","last_undegraded":"2024-09-10T20:55:47.619744+0000","last_fullsized":"2024-09-10T20:55:47.619744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:57:35.324429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362107+0000","last_change":"2024-09-10T20:55:43.376868+0000","last_active":"2024-09-10T20:55:45.362107+0000","last_peered":"2024-09-10T20:55:45.362107+0000","last_clean":"2024-09-10T20:55:45.362107+0000","last_became_active":"2024-09-10T20:55:43.376616+0000","last_became_peered":"2024-09-10T20:55:43.376616+0000","last_unstale":"2024-09-10T20:55:45.362107+0000","last_undegraded":"2024-09-10T20:55:45.362107+0000","last_fullsized":"2024-09-10T20:55:45.362107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:04.606474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.618795+0000","last_change":"2024-09-10T20:55:44.370871+0000","last_active":"2024-09-10T20:55:47.618795+0000","last_peered":"2024-09-10T20:55:47.618795+0000","last_clean":"2024-09-10T20:55:47.618795+0000","last_became_active":"2024-09-10T20:55:44.370595+0000","last_became_peered":"2024-09-10T20:55:44.370595+0000","last_unstale":"2024-09-10T20:55:47.618795+0000","last_undegraded":"2024-09-10T20:55:47.618795+0000","last_fullsized":"2024-09-10T20:55:47.618795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:29:13.258273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.917992+0000","last_change":"2024-09-10T20:55:43.367129+0000","last_active":"2024-09-10T20:55:45.917992+0000","last_peered":"2024-09-10T20:55:45.917992+0000","last_clean":"2024-09-10T20:55:45.917992+0000","last_became_active":"2024-09-10T20:55:43.366825+0000","last_became_peered":"2024-09-10T20:55:43.366825+0000","last_unstale":"2024-09-10T20:55:45.917992+0000","last_undegraded":"2024-09-10T20:55:45.917992+0000","last_fullsized":"2024-09-10T20:55:45.917992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:44.779833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361375+0000","last_change":"2024-09-10T20:55:44.362975+0000","last_active":"2024-09-10T20:55:45.361375+0000","last_peered":"2024-09-10T20:55:45.361375+0000","last_clean":"2024-09-10T20:55:45.361375+0000","last_became_active":"2024-09-10T20:55:44.362495+0000","last_became_peered":"2024-09-10T20:55:44.362495+0000","last_unstale":"2024-09-10T20:55:45.361375+0000","last_undegraded":"2024-09-10T20:55:45.361375+0000","last_fullsized":"2024-09-10T20:55:45.361375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:01:47.424436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364336+0000","last_change":"2024-09-10T20:55:43.364574+0000","last_active":"2024-09-10T20:55:45.364336+0000","last_peered":"2024-09-10T20:55:45.364336+0000","last_clean":"2024-09-10T20:55:45.364336+0000","last_became_active":"2024-09-10T20:55:43.363895+0000","last_became_peered":"2024-09-10T20:55:43.363895+0000","last_unstale":"2024-09-10T20:55:45.364336+0000","last_undegraded":"2024-09-10T20:55:45.364336+0000","last_fullsized":"2024-09-10T20:55:45.364336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:41:29.573514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.627706+0000","last_change":"2024-09-10T20:55:44.377780+0000","last_active":"2024-09-10T20:55:46.627706+0000","last_peered":"2024-09-10T20:55:46.627706+0000","last_clean":"2024-09-10T20:55:46.627706+0000","last_became_active":"2024-09-10T20:55:44.377120+0000","last_became_peered":"2024-09-10T20:55:44.377120+0000","last_unstale":"2024-09-10T20:55:46.627706+0000","last_undegraded":"2024-09-10T20:55:46.627706+0000","last_fullsized":"2024-09-10T20:55:46.627706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:29.923800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361762+0000","last_change":"2024-09-10T20:55:43.374091+0000","last_active":"2024-09-10T20:55:45.361762+0000","last_peered":"2024-09-10T20:55:45.361762+0000","last_clean":"2024-09-10T20:55:45.361762+0000","last_became_active":"2024-09-10T20:55:43.373736+0000","last_became_peered":"2024-09-10T20:55:43.373736+0000","last_unstale":"2024-09-10T20:55:45.361762+0000","last_undegraded":"2024-09-10T20:55:45.361762+0000","last_fullsized":"2024-09-10T20:55:45.361762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:41:11.107382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364317+0000","last_change":"2024-09-10T20:55:44.382414+0000","last_active":"2024-09-10T20:55:45.364317+0000","last_peered":"2024-09-10T20:55:45.364317+0000","last_clean":"2024-09-10T20:55:45.364317+0000","last_became_active":"2024-09-10T20:55:44.382087+0000","last_became_peered":"2024-09-10T20:55:44.382087+0000","last_unstale":"2024-09-10T20:55:45.364317+0000","last_undegraded":"2024-09-10T20:55:45.364317+0000","last_fullsized":"2024-09-10T20:55:45.364317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:57.600887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364206+0000","last_change":"2024-09-10T20:55:43.380057+0000","last_active":"2024-09-10T20:55:45.364206+0000","last_peered":"2024-09-10T20:55:45.364206+0000","last_clean":"2024-09-10T20:55:45.364206+0000","last_became_active":"2024-09-10T20:55:43.379881+0000","last_became_peered":"2024-09-10T20:55:43.379881+0000","last_unstale":"2024-09-10T20:55:45.364206+0000","last_undegraded":"2024-09-10T20:55:45.364206+0000","last_fullsized":"2024-09-10T20:55:45.364206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:35:50.441609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361728+0000","last_change":"2024-09-10T20:55:44.362979+0000","last_active":"2024-09-10T20:55:45.361728+0000","last_peered":"2024-09-10T20:55:45.361728+0000","last_clean":"2024-09-10T20:55:45.361728+0000","last_became_active":"2024-09-10T20:55:44.362472+0000","last_became_peered":"2024-09-10T20:55:44.362472+0000","last_unstale":"2024-09-10T20:55:45.361728+0000","last_undegraded":"2024-09-10T20:55:45.361728+0000","last_fullsized":"2024-09-10T20:55:45.361728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:32:54.439682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361567+0000","last_change":"2024-09-10T20:55:43.372848+0000","last_active":"2024-09-10T20:55:45.361567+0000","last_peered":"2024-09-10T20:55:45.361567+0000","last_clean":"2024-09-10T20:55:45.361567+0000","last_became_active":"2024-09-10T20:55:43.372619+0000","last_became_peered":"2024-09-10T20:55:43.372619+0000","last_unstale":"2024-09-10T20:55:45.361567+0000","last_undegraded":"2024-09-10T20:55:45.361567+0000","last_fullsized":"2024-09-10T20:55:45.361567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:32.519717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.619659+0000","last_change":"2024-09-10T20:55:44.378521+0000","last_active":"2024-09-10T20:55:47.619659+0000","last_peered":"2024-09-10T20:55:47.619659+0000","last_clean":"2024-09-10T20:55:47.619659+0000","last_became_active":"2024-09-10T20:55:44.378187+0000","last_became_peered":"2024-09-10T20:55:44.378187+0000","last_unstale":"2024-09-10T20:55:47.619659+0000","last_undegraded":"2024-09-10T20:55:47.619659+0000","last_fullsized":"2024-09-10T20:55:47.619659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:10:30.574948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.356149+0000","last_change":"2024-09-10T20:55:43.374477+0000","last_active":"2024-09-10T20:55:46.356149+0000","last_peered":"2024-09-10T20:55:46.356149+0000","last_clean":"2024-09-10T20:55:46.356149+0000","last_became_active":"2024-09-10T20:55:43.373960+0000","last_became_peered":"2024-09-10T20:55:43.373960+0000","last_unstale":"2024-09-10T20:55:46.356149+0000","last_undegraded":"2024-09-10T20:55:46.356149+0000","last_fullsized":"2024-09-10T20:55:46.356149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:04.606474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.619460+0000","last_change":"2024-09-10T20:55:44.377264+0000","last_active":"2024-09-10T20:55:47.619460+0000","last_peered":"2024-09-10T20:55:47.619460+0000","last_clean":"2024-09-10T20:55:47.619460+0000","last_became_active":"2024-09-10T20:55:44.376997+0000","last_became_peered":"2024-09-10T20:55:44.376997+0000","last_unstale":"2024-09-10T20:55:47.619460+0000","last_undegraded":"2024-09-10T20:55:47.619460+0000","last_fullsized":"2024-09-10T20:55:47.619460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:55:40.289116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.362099+0000","last_change":"2024-09-10T20:55:43.376292+0000","last_active":"2024-09-10T20:55:45.362099+0000","last_peered":"2024-09-10T20:55:45.362099+0000","last_clean":"2024-09-10T20:55:45.362099+0000","last_became_active":"2024-09-10T20:55:43.375988+0000","last_became_peered":"2024-09-10T20:55:43.375988+0000","last_unstale":"2024-09-10T20:55:45.362099+0000","last_undegraded":"2024-09-10T20:55:45.362099+0000","last_fullsized":"2024-09-10T20:55:45.362099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:41:29.573514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.627612+0000","last_change":"2024-09-10T20:55:44.372839+0000","last_active":"2024-09-10T20:55:46.627612+0000","last_peered":"2024-09-10T20:55:46.627612+0000","last_clean":"2024-09-10T20:55:46.627612+0000","last_became_active":"2024-09-10T20:55:44.372410+0000","last_became_peered":"2024-09-10T20:55:44.372410+0000","last_unstale":"2024-09-10T20:55:46.627612+0000","last_undegraded":"2024-09-10T20:55:46.627612+0000","last_fullsized":"2024-09-10T20:55:46.627612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:27:56.155122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361430+0000","last_change":"2024-09-10T20:55:43.376634+0000","last_active":"2024-09-10T20:55:45.361430+0000","last_peered":"2024-09-10T20:55:45.361430+0000","last_clean":"2024-09-10T20:55:45.361430+0000","last_became_active":"2024-09-10T20:55:43.376322+0000","last_became_peered":"2024-09-10T20:55:43.376322+0000","last_unstale":"2024-09-10T20:55:45.361430+0000","last_undegraded":"2024-09-10T20:55:45.361430+0000","last_fullsized":"2024-09-10T20:55:45.361430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:51:58.280912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.618996+0000","last_change":"2024-09-10T20:55:44.368404+0000","last_active":"2024-09-10T20:55:47.618996+0000","last_peered":"2024-09-10T20:55:47.618996+0000","last_clean":"2024-09-10T20:55:47.618996+0000","last_became_active":"2024-09-10T20:55:44.368024+0000","last_became_peered":"2024-09-10T20:55:44.368024+0000","last_unstale":"2024-09-10T20:55:47.618996+0000","last_undegraded":"2024-09-10T20:55:47.618996+0000","last_fullsized":"2024-09-10T20:55:47.618996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:18:57.908039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.361426+0000","last_change":"2024-09-10T20:55:43.362895+0000","last_active":"2024-09-10T20:55:45.361426+0000","last_peered":"2024-09-10T20:55:45.361426+0000","last_clean":"2024-09-10T20:55:45.361426+0000","last_became_active":"2024-09-10T20:55:43.362589+0000","last_became_peered":"2024-09-10T20:55:43.362589+0000","last_unstale":"2024-09-10T20:55:45.361426+0000","last_undegraded":"2024-09-10T20:55:45.361426+0000","last_fullsized":"2024-09-10T20:55:45.361426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:52.212240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.620008+0000","last_change":"2024-09-10T20:55:44.390140+0000","last_active":"2024-09-10T20:55:47.620008+0000","last_peered":"2024-09-10T20:55:47.620008+0000","last_clean":"2024-09-10T20:55:47.620008+0000","last_became_active":"2024-09-10T20:55:44.389852+0000","last_became_peered":"2024-09-10T20:55:44.389852+0000","last_unstale":"2024-09-10T20:55:47.620008+0000","last_undegraded":"2024-09-10T20:55:47.620008+0000","last_fullsized":"2024-09-10T20:55:47.620008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:21:31.573395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363357+0000","last_change":"2024-09-10T20:55:43.376815+0000","last_active":"2024-09-10T20:55:45.363357+0000","last_peered":"2024-09-10T20:55:45.363357+0000","last_clean":"2024-09-10T20:55:45.363357+0000","last_became_active":"2024-09-10T20:55:43.376465+0000","last_became_peered":"2024-09-10T20:55:43.376465+0000","last_unstale":"2024-09-10T20:55:45.363357+0000","last_undegraded":"2024-09-10T20:55:45.363357+0000","last_fullsized":"2024-09-10T20:55:45.363357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:29.358166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:46.355895+0000","last_change":"2024-09-10T20:55:44.372811+0000","last_active":"2024-09-10T20:55:46.355895+0000","last_peered":"2024-09-10T20:55:46.355895+0000","last_clean":"2024-09-10T20:55:46.355895+0000","last_became_active":"2024-09-10T20:55:44.372498+0000","last_became_peered":"2024-09-10T20:55:44.372498+0000","last_unstale":"2024-09-10T20:55:46.355895+0000","last_undegraded":"2024-09-10T20:55:46.355895+0000","last_fullsized":"2024-09-10T20:55:46.355895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:03:43.922684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364096+0000","last_change":"2024-09-10T20:55:44.356261+0000","last_active":"2024-09-10T20:55:45.364096+0000","last_peered":"2024-09-10T20:55:45.364096+0000","last_clean":"2024-09-10T20:55:45.364096+0000","last_became_active":"2024-09-10T20:55:44.355918+0000","last_became_peered":"2024-09-10T20:55:44.355918+0000","last_unstale":"2024-09-10T20:55:45.364096+0000","last_undegraded":"2024-09-10T20:55:45.364096+0000","last_fullsized":"2024-09-10T20:55:45.364096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:57:27.229133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363650+0000","last_change":"2024-09-10T20:55:43.379354+0000","last_active":"2024-09-10T20:55:45.363650+0000","last_peered":"2024-09-10T20:55:45.363650+0000","last_clean":"2024-09-10T20:55:45.363650+0000","last_became_active":"2024-09-10T20:55:43.378912+0000","last_became_peered":"2024-09-10T20:55:43.378912+0000","last_unstale":"2024-09-10T20:55:45.363650+0000","last_undegraded":"2024-09-10T20:55:45.363650+0000","last_fullsized":"2024-09-10T20:55:45.363650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:16.877259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.363676+0000","last_change":"2024-09-10T20:55:44.355826+0000","last_active":"2024-09-10T20:55:45.363676+0000","last_peered":"2024-09-10T20:55:45.363676+0000","last_clean":"2024-09-10T20:55:45.363676+0000","last_became_active":"2024-09-10T20:55:44.355502+0000","last_became_peered":"2024-09-10T20:55:44.355502+0000","last_unstale":"2024-09-10T20:55:45.363676+0000","last_undegraded":"2024-09-10T20:55:45.363676+0000","last_fullsized":"2024-09-10T20:55:45.363676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:46:20.226511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:45.364080+0000","last_change":"2024-09-10T20:55:43.379688+0000","last_active":"2024-09-10T20:55:45.364080+0000","last_peered":"2024-09-10T20:55:45.364080+0000","last_clean":"2024-09-10T20:55:45.364080+0000","last_became_active":"2024-09-10T20:55:43.379480+0000","last_became_peered":"2024-09-10T20:55:43.379480+0000","last_unstale":"2024-09-10T20:55:45.364080+0000","last_undegraded":"2024-09-10T20:55:45.364080+0000","last_fullsized":"2024-09-10T20:55:45.364080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:41:11.107382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.619842+0000","last_change":"2024-09-10T20:55:44.381645+0000","last_active":"2024-09-10T20:55:47.619842+0000","last_peered":"2024-09-10T20:55:47.619842+0000","last_clean":"2024-09-10T20:55:47.619842+0000","last_became_active":"2024-09-10T20:55:44.376799+0000","last_became_peered":"2024-09-10T20:55:44.376799+0000","last_unstale":"2024-09-10T20:55:47.619842+0000","last_undegraded":"2024-09-10T20:55:47.619842+0000","last_fullsized":"2024-09-10T20:55:47.619842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:08.229059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.620479+0000","last_change":"2024-09-10T20:55:43.361529+0000","last_active":"2024-09-10T20:55:47.620479+0000","last_peered":"2024-09-10T20:55:47.620479+0000","last_clean":"2024-09-10T20:55:47.620479+0000","last_became_active":"2024-09-10T20:55:43.361270+0000","last_became_peered":"2024-09-10T20:55:43.361270+0000","last_unstale":"2024-09-10T20:55:47.620479+0000","last_undegraded":"2024-09-10T20:55:47.620479+0000","last_fullsized":"2024-09-10T20:55:47.620479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:26:10.795588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.619676+0000","last_change":"2024-09-10T20:55:44.378339+0000","last_active":"2024-09-10T20:55:47.619676+0000","last_peered":"2024-09-10T20:55:47.619676+0000","last_clean":"2024-09-10T20:55:47.619676+0000","last_became_active":"2024-09-10T20:55:44.378051+0000","last_became_peered":"2024-09-10T20:55:44.378051+0000","last_unstale":"2024-09-10T20:55:47.619676+0000","last_undegraded":"2024-09-10T20:55:47.619676+0000","last_fullsized":"2024-09-10T20:55:47.619676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:43.336062+0000","last_clean_scrub_stamp":"2024-09-10T20:55:43.336062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:36.033123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T20:55:47.620088+0000","last_change":"2024-09-10T20:55:43.370516+0000","last_active":"2024-09-10T20:55:47.620088+0000","last_peered":"2024-09-10T20:55:47.620088+0000","last_clean":"2024-09-10T20:55:47.620088+0000","last_became_active":"2024-09-10T20:55:43.370211+0000","last_became_peered":"2024-09-10T20:55:43.370211+0000","last_unstale":"2024-09-10T20:55:47.620088+0000","last_undegraded":"2024-09-10T20:55:47.620088+0000","last_fullsized":"2024-09-10T20:55:47.620088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:42.328981+0000","last_clean_scrub_stamp":"2024-09-10T20:55:42.328981+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:53.823889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":819200,"data_stored":668106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":78768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":77246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":233472,"data_stored":77282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":77156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":77316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":827392,"data_stored":668162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":78768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T20:55:59.273 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T20:55:59.273 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-10T20:55:59.273 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-10T20:55:59.273 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T20:55:59.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.467+0000 7ffbc9800640 1 -- 172.21.15.6:0/3781964690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbc4070450 msgr2=0x7ffbc40cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:59.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.467+0000 7ffbc9800640 1 --2- 172.21.15.6:0/3781964690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbc4070450 0x7ffbc40cd920 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4051860 tx=0x7ffbbc02a820 comp rx=0 tx=0).stop 2024-09-10T20:55:59.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.468+0000 7ffbc9800640 1 -- 172.21.15.6:0/3781964690 shutdown_connections 2024-09-10T20:55:59.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.468+0000 7ffbc9800640 1 --2- 172.21.15.6:0/3781964690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbc4070450 0x7ffbc40cd920 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:59.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.468+0000 7ffbc9800640 1 --2- 172.21.15.6:0/3781964690 >> v2:172.21.15.150:3300/0 conn(0x7ffbc4159670 0x7ffbc40743b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:59.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.468+0000 7ffbc9800640 1 -- 172.21.15.6:0/3781964690 >> 172.21.15.6:0/3781964690 conn(0x7ffbc40cfa20 msgr2=0x7ffbc40cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:59.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.468+0000 7ffbc9800640 1 -- 172.21.15.6:0/3781964690 shutdown_connections 2024-09-10T20:55:59.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.468+0000 7ffbc9800640 1 -- 172.21.15.6:0/3781964690 wait complete. 2024-09-10T20:55:59.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.469+0000 7ffbc9800640 1 Processor -- start 2024-09-10T20:55:59.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.469+0000 7ffbc9800640 1 -- start start 2024-09-10T20:55:59.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.470+0000 7ffbc9800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbc4070450 0x7ffbc40adaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:59.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.470+0000 7ffbc9800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffbc4159670 0x7ffbc41f7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:59.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.470+0000 7ffbc9800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffbc415c170 0x7ffbc4157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:59.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.470+0000 7ffbc9800640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc40b4a90 con 0x7ffbc4070450 2024-09-10T20:55:59.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.470+0000 7ffbc9800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc40b4910 con 0x7ffbc4159670 2024-09-10T20:55:59.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.470+0000 7ffbc9800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ffbc40b4c10 con 0x7ffbc415c170 2024-09-10T20:55:59.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.470+0000 7ffbc2a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbc4070450 0x7ffbc40adaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:59.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.471+0000 7ffbc2a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbc4070450 0x7ffbc40adaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56220/0 (socket says 172.21.15.6:56220) 2024-09-10T20:55:59.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.471+0000 7ffbc2a00640 1 -- 172.21.15.6:0/1682787790 learned_addr learned my addr 172.21.15.6:0/1682787790 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:59.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.471+0000 7ffbba000640 1 --2- 172.21.15.6:0/1682787790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffbc4159670 0x7ffbc41f7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:59.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.471+0000 7ffbc3400640 1 --2- 172.21.15.6:0/1682787790 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffbc415c170 0x7ffbc4157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:59.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.471+0000 7ffbc2a00640 1 -- 172.21.15.6:0/1682787790 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffbc415c170 msgr2=0x7ffbc4157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:59.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.471+0000 7ffbc2a00640 1 --2- 172.21.15.6:0/1682787790 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffbc415c170 0x7ffbc4157c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:59.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.471+0000 7ffbc2a00640 1 -- 172.21.15.6:0/1682787790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffbc4159670 msgr2=0x7ffbc41f7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:59.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.471+0000 7ffbc2a00640 1 --2- 172.21.15.6:0/1682787790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffbc4159670 0x7ffbc41f7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:59.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.471+0000 7ffbc2a00640 1 -- 172.21.15.6:0/1682787790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc41f88c0 con 0x7ffbc4070450 2024-09-10T20:55:59.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.471+0000 7ffbc2a00640 1 --2- 172.21.15.6:0/1682787790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbc4070450 0x7ffbc40adaf0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ffbb400d980 tx=0x7ffbb400de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:59.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.471+0000 7ffbbb400640 1 -- 172.21.15.6:0/1682787790 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb4017070 con 0x7ffbc4070450 2024-09-10T20:55:59.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.471+0000 7ffbbb400640 1 -- 172.21.15.6:0/1682787790 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffbb4009d20 con 0x7ffbc4070450 2024-09-10T20:55:59.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.471+0000 7ffbbb400640 1 -- 172.21.15.6:0/1682787790 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb40106c0 con 0x7ffbc4070450 2024-09-10T20:55:59.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.471+0000 7ffbc9800640 1 -- 172.21.15.6:0/1682787790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbc41f8ba0 con 0x7ffbc4070450 2024-09-10T20:55:59.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.472+0000 7ffbc9800640 1 -- 172.21.15.6:0/1682787790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbc40cab60 con 0x7ffbc4070450 2024-09-10T20:55:59.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.473+0000 7ffbc9800640 1 -- 172.21.15.6:0/1682787790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbc406eac0 con 0x7ffbc4070450 2024-09-10T20:55:59.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.474+0000 7ffbbb400640 1 -- 172.21.15.6:0/1682787790 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ffbb4010860 con 0x7ffbc4070450 2024-09-10T20:55:59.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.475+0000 7ffbbb400640 1 --2- 172.21.15.6:0/1682787790 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ffba0077f70 0x7ffba007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:59.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.475+0000 7ffbbb400640 1 -- 172.21.15.6:0/1682787790 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ffbb409a1f0 con 0x7ffbc4070450 2024-09-10T20:55:59.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.476+0000 7ffbba000640 1 --2- 172.21.15.6:0/1682787790 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ffba0077f70 0x7ffba007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:59.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.476+0000 7ffbba000640 1 --2- 172.21.15.6:0/1682787790 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ffba0077f70 0x7ffba007a430 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ffbc40ca400 tx=0x7ffbac009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:59.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.480+0000 7ffbbb400640 1 -- 172.21.15.6:0/1682787790 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ffbc406eac0 con 0x7ffbc4070450 2024-09-10T20:55:59.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.714+0000 7ffbc9800640 1 -- 172.21.15.6:0/1682787790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ffbc40b50c0 con 0x7ffbc4070450 2024-09-10T20:55:59.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.715+0000 7ffbbb400640 1 -- 172.21.15.6:0/1682787790 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7ffbb4062c50 con 0x7ffbc4070450 2024-09-10T20:55:59.719 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:55:59.719 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-10T20:55:59.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.717+0000 7ffbc9800640 1 -- 172.21.15.6:0/1682787790 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ffba0077f70 msgr2=0x7ffba007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:59.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.717+0000 7ffbc9800640 1 --2- 172.21.15.6:0/1682787790 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ffba0077f70 0x7ffba007a430 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ffbc40ca400 tx=0x7ffbac009040 comp rx=0 tx=0).stop 2024-09-10T20:55:59.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.717+0000 7ffbc9800640 1 -- 172.21.15.6:0/1682787790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbc4070450 msgr2=0x7ffbc40adaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:59.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.717+0000 7ffbc9800640 1 --2- 172.21.15.6:0/1682787790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbc4070450 0x7ffbc40adaf0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ffbb400d980 tx=0x7ffbb400de40 comp rx=0 tx=0).stop 2024-09-10T20:55:59.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.717+0000 7ffbc9800640 1 -- 172.21.15.6:0/1682787790 shutdown_connections 2024-09-10T20:55:59.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.717+0000 7ffbc9800640 1 --2- 172.21.15.6:0/1682787790 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ffba0077f70 0x7ffba007a430 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:59.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.717+0000 7ffbc9800640 1 --2- 172.21.15.6:0/1682787790 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffbc415c170 0x7ffbc4157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:59.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.717+0000 7ffbc9800640 1 --2- 172.21.15.6:0/1682787790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffbc4159670 0x7ffbc41f7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:59.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.717+0000 7ffbc9800640 1 --2- 172.21.15.6:0/1682787790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbc4070450 0x7ffbc40adaf0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:59.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.717+0000 7ffbc9800640 1 -- 172.21.15.6:0/1682787790 >> 172.21.15.6:0/1682787790 conn(0x7ffbc40cfa20 msgr2=0x7ffbc40739e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:59.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.717+0000 7ffbc9800640 1 -- 172.21.15.6:0/1682787790 shutdown_connections 2024-09-10T20:55:59.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.717+0000 7ffbc9800640 1 -- 172.21.15.6:0/1682787790 wait complete. 2024-09-10T20:55:59.736 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-10T20:55:59.737 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:55:59.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.892+0000 7f5d6cc00640 1 -- 172.21.15.6:0/3809260969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d68159670 msgr2=0x7f5d680743b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:59.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.892+0000 7f5d6cc00640 1 --2- 172.21.15.6:0/3809260969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d68159670 0x7f5d680743b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5d680cc450 tx=0x7f5d5802a560 comp rx=0 tx=0).stop 2024-09-10T20:55:59.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.892+0000 7f5d6cc00640 1 -- 172.21.15.6:0/3809260969 shutdown_connections 2024-09-10T20:55:59.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.892+0000 7f5d6cc00640 1 --2- 172.21.15.6:0/3809260969 >> v2:172.21.15.150:3300/0 conn(0x7f5d6815c170 0x7f5d680cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:59.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.892+0000 7f5d6cc00640 1 --2- 172.21.15.6:0/3809260969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d68159670 0x7f5d680743b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:59.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.892+0000 7f5d6cc00640 1 -- 172.21.15.6:0/3809260969 >> 172.21.15.6:0/3809260969 conn(0x7f5d680cfa20 msgr2=0x7f5d680cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:59.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.892+0000 7f5d6cc00640 1 -- 172.21.15.6:0/3809260969 shutdown_connections 2024-09-10T20:55:59.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.892+0000 7f5d6cc00640 1 -- 172.21.15.6:0/3809260969 wait complete. 2024-09-10T20:55:59.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.894+0000 7f5d6cc00640 1 Processor -- start 2024-09-10T20:55:59.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.894+0000 7f5d6cc00640 1 -- start start 2024-09-10T20:55:59.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.895+0000 7f5d6cc00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d6806fd40 0x7f5d681580d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:59.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.895+0000 7f5d6cc00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d68159670 0x7f5d680b0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:59.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.895+0000 7f5d6cc00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d6815c170 0x7f5d680b09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:59.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.895+0000 7f5d6cc00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5d680b4a90 con 0x7f5d6815c170 2024-09-10T20:55:59.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.895+0000 7f5d6cc00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5d680b4910 con 0x7f5d6806fd40 2024-09-10T20:55:59.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.895+0000 7f5d6cc00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f5d680b4c10 con 0x7f5d68159670 2024-09-10T20:55:59.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.895+0000 7f5d65e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d6806fd40 0x7f5d681580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:59.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.895+0000 7f5d5d400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d68159670 0x7f5d680b0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:59.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.895+0000 7f5d65e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d6806fd40 0x7f5d681580d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.6:34816/0 (socket says 172.21.15.6:34816) 2024-09-10T20:55:59.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.895+0000 7f5d65e00640 1 -- 172.21.15.6:0/1586873620 learned_addr learned my addr 172.21.15.6:0/1586873620 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:55:59.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.895+0000 7f5d66800640 1 --2- 172.21.15.6:0/1586873620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d6815c170 0x7f5d680b09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:59.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.896+0000 7f5d65e00640 1 -- 172.21.15.6:0/1586873620 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d68159670 msgr2=0x7f5d680b0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:59.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.896+0000 7f5d65e00640 1 --2- 172.21.15.6:0/1586873620 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d68159670 0x7f5d680b0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:59.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.896+0000 7f5d65e00640 1 -- 172.21.15.6:0/1586873620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d6815c170 msgr2=0x7f5d680b09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:59.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.896+0000 7f5d65e00640 1 --2- 172.21.15.6:0/1586873620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d6815c170 0x7f5d680b09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:59.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.896+0000 7f5d65e00640 1 -- 172.21.15.6:0/1586873620 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d680ca200 con 0x7f5d6806fd40 2024-09-10T20:55:59.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.896+0000 7f5d5d400640 1 --2- 172.21.15.6:0/1586873620 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d68159670 0x7f5d680b0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:55:59.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.896+0000 7f5d66800640 1 --2- 172.21.15.6:0/1586873620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d6815c170 0x7f5d680b09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:55:59.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.896+0000 7f5d65e00640 1 --2- 172.21.15.6:0/1586873620 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d6806fd40 0x7f5d681580d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5d58009850 tx=0x7f5d580038a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:59.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.897+0000 7f5d5ea00640 1 -- 172.21.15.6:0/1586873620 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d5803f070 con 0x7f5d6806fd40 2024-09-10T20:55:59.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.897+0000 7f5d5ea00640 1 -- 172.21.15.6:0/1586873620 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d580047a0 con 0x7f5d6806fd40 2024-09-10T20:55:59.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.897+0000 7f5d6cc00640 1 -- 172.21.15.6:0/1586873620 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d681f4bc0 con 0x7f5d6806fd40 2024-09-10T20:55:59.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.897+0000 7f5d5ea00640 1 -- 172.21.15.6:0/1586873620 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d58035030 con 0x7f5d6806fd40 2024-09-10T20:55:59.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.897+0000 7f5d6cc00640 1 -- 172.21.15.6:0/1586873620 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d6815ac50 con 0x7f5d6806fd40 2024-09-10T20:55:59.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.898+0000 7f5d6cc00640 1 -- 172.21.15.6:0/1586873620 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d680b50c0 con 0x7f5d6806fd40 2024-09-10T20:55:59.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.899+0000 7f5d5ea00640 1 -- 172.21.15.6:0/1586873620 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5d58004bf0 con 0x7f5d6806fd40 2024-09-10T20:55:59.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.900+0000 7f5d5ea00640 1 --2- 172.21.15.6:0/1586873620 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5d44077f70 0x7f5d4407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:59.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.900+0000 7f5d5ea00640 1 -- 172.21.15.6:0/1586873620 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f5d580bb360 con 0x7f5d6806fd40 2024-09-10T20:55:59.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.900+0000 7f5d5d400640 1 --2- 172.21.15.6:0/1586873620 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5d44077f70 0x7f5d4407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:59.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.901+0000 7f5d5d400640 1 --2- 172.21.15.6:0/1586873620 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5d44077f70 0x7f5d4407a430 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5d680cd060 tx=0x7f5d50005f90 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:59.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:55:59.903+0000 7f5d5ea00640 1 -- 172.21.15.6:0/1586873620 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5d680ca200 con 0x7f5d6806fd40 2024-09-10T20:56:00.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.136+0000 7f5d6cc00640 1 -- 172.21.15.6:0/1586873620 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5d68069d20 con 0x7f5d6806fd40 2024-09-10T20:56:00.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.138+0000 7f5d5ea00640 1 -- 172.21.15.6:0/1586873620 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5211 (secure 0 0 0) 0x7f5d58083770 con 0x7f5d6806fd40 2024-09-10T20:56:00.142 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:56:00.142 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"btime":"2024-09-10T20:55:47:367368+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4329,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/77885972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":77885972},{"type":"v1","addr":"172.21.15.6:6834","nonce":77885972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4341,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/1181849476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1181849476},{"type":"v1","addr":"172.21.15.150:6836","nonce":1181849476}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4344,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/3860565837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":3860565837},{"type":"v1","addr":"172.21.15.150:6837","nonce":3860565837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:55:43.801792+0000","modified":"2024-09-10T20:55:46.798409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4375},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4375":{"gid":4375,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/3230367141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3230367141},{"type":"v1","addr":"172.21.15.6:6835","nonce":3230367141}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4375,"qdb_cluster":[4375]},"id":1}]} 2024-09-10T20:56:00.142 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2024-09-10T20:56:00.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.140+0000 7f5d6cc00640 1 -- 172.21.15.6:0/1586873620 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5d44077f70 msgr2=0x7f5d4407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:00.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.140+0000 7f5d6cc00640 1 --2- 172.21.15.6:0/1586873620 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5d44077f70 0x7f5d4407a430 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5d680cd060 tx=0x7f5d50005f90 comp rx=0 tx=0).stop 2024-09-10T20:56:00.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.140+0000 7f5d6cc00640 1 -- 172.21.15.6:0/1586873620 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d6806fd40 msgr2=0x7f5d681580d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:00.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.140+0000 7f5d6cc00640 1 --2- 172.21.15.6:0/1586873620 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d6806fd40 0x7f5d681580d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5d58009850 tx=0x7f5d580038a0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.140+0000 7f5d6cc00640 1 -- 172.21.15.6:0/1586873620 shutdown_connections 2024-09-10T20:56:00.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.140+0000 7f5d6cc00640 1 --2- 172.21.15.6:0/1586873620 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5d44077f70 0x7f5d4407a430 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.140+0000 7f5d6cc00640 1 --2- 172.21.15.6:0/1586873620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d6815c170 0x7f5d680b09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.140+0000 7f5d6cc00640 1 --2- 172.21.15.6:0/1586873620 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d68159670 0x7f5d680b0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.140+0000 7f5d6cc00640 1 --2- 172.21.15.6:0/1586873620 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d6806fd40 0x7f5d681580d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.140+0000 7f5d6cc00640 1 -- 172.21.15.6:0/1586873620 >> 172.21.15.6:0/1586873620 conn(0x7f5d680cfa20 msgr2=0x7f5d68072940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:00.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.140+0000 7f5d6cc00640 1 -- 172.21.15.6:0/1586873620 shutdown_connections 2024-09-10T20:56:00.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.140+0000 7f5d6cc00640 1 -- 172.21.15.6:0/1586873620 wait complete. 2024-09-10T20:56:00.160 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:56:00.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.316+0000 7fa22ee00640 1 -- 172.21.15.6:0/886303172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa22815c170 msgr2=0x7fa2280cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:00.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.316+0000 7fa22ee00640 1 --2- 172.21.15.6:0/886303172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa22815c170 0x7fa2280cd920 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa228051860 tx=0x7fa21402a4d0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.316+0000 7fa22ee00640 1 -- 172.21.15.6:0/886303172 shutdown_connections 2024-09-10T20:56:00.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.316+0000 7fa22ee00640 1 --2- 172.21.15.6:0/886303172 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa22806fd40 0x7fa228070170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.316+0000 7fa22ee00640 1 --2- 172.21.15.6:0/886303172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa22815c170 0x7fa2280cd920 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.316+0000 7fa22ee00640 1 --2- 172.21.15.6:0/886303172 >> v2:172.21.15.150:3300/0 conn(0x7fa228159670 0x7fa2280743b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.316+0000 7fa22ee00640 1 -- 172.21.15.6:0/886303172 >> 172.21.15.6:0/886303172 conn(0x7fa2280cfa20 msgr2=0x7fa2280cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:00.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.316+0000 7fa22ee00640 1 -- 172.21.15.6:0/886303172 shutdown_connections 2024-09-10T20:56:00.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.316+0000 7fa22ee00640 1 -- 172.21.15.6:0/886303172 wait complete. 2024-09-10T20:56:00.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.318+0000 7fa22ee00640 1 Processor -- start 2024-09-10T20:56:00.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.318+0000 7fa22ee00640 1 -- start start 2024-09-10T20:56:00.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.319+0000 7fa22ee00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa22806fd40 0x7fa2280c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:00.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.319+0000 7fa22ee00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa228159670 0x7fa228150da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:00.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.319+0000 7fa22ee00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa22815c170 0x7fa2280ad880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:00.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.319+0000 7fa22ee00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa2280b4a90 con 0x7fa22815c170 2024-09-10T20:56:00.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.319+0000 7fa22ee00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa2280b4910 con 0x7fa22806fd40 2024-09-10T20:56:00.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.319+0000 7fa22ee00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa2280b4c10 con 0x7fa228159670 2024-09-10T20:56:00.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.319+0000 7fa22ce00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa22815c170 0x7fa2280ad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:00.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.319+0000 7fa22ce00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa22815c170 0x7fa2280ad880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56262/0 (socket says 172.21.15.6:56262) 2024-09-10T20:56:00.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.319+0000 7fa22ce00640 1 -- 172.21.15.6:0/838695833 learned_addr learned my addr 172.21.15.6:0/838695833 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:00.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.319+0000 7fa227400640 1 --2- 172.21.15.6:0/838695833 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa228159670 0x7fa228150da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:00.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.319+0000 7fa227e00640 1 --2- 172.21.15.6:0/838695833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa22806fd40 0x7fa2280c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:00.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.319+0000 7fa22ce00640 1 -- 172.21.15.6:0/838695833 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa228159670 msgr2=0x7fa228150da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:00.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.319+0000 7fa22ce00640 1 --2- 172.21.15.6:0/838695833 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa228159670 0x7fa228150da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.319+0000 7fa22ce00640 1 -- 172.21.15.6:0/838695833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa22806fd40 msgr2=0x7fa2280c4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:00.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.319+0000 7fa22ce00640 1 --2- 172.21.15.6:0/838695833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa22806fd40 0x7fa2280c4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.319+0000 7fa22ce00640 1 -- 172.21.15.6:0/838695833 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2280c3a10 con 0x7fa22815c170 2024-09-10T20:56:00.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.320+0000 7fa22ce00640 1 --2- 172.21.15.6:0/838695833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa22815c170 0x7fa2280ad880 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa22000eab0 tx=0x7fa220009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:00.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.320+0000 7fa21fe00640 1 -- 172.21.15.6:0/838695833 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa22000ce40 con 0x7fa22815c170 2024-09-10T20:56:00.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.320+0000 7fa21fe00640 1 -- 172.21.15.6:0/838695833 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa220004c10 con 0x7fa22815c170 2024-09-10T20:56:00.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.320+0000 7fa21fe00640 1 -- 172.21.15.6:0/838695833 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa220005020 con 0x7fa22815c170 2024-09-10T20:56:00.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.320+0000 7fa22ee00640 1 -- 172.21.15.6:0/838695833 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2280c3cf0 con 0x7fa22815c170 2024-09-10T20:56:00.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.320+0000 7fa22ee00640 1 -- 172.21.15.6:0/838695833 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2280c42b0 con 0x7fa22815c170 2024-09-10T20:56:00.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.321+0000 7fa22ee00640 1 -- 172.21.15.6:0/838695833 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2280b51a0 con 0x7fa22815c170 2024-09-10T20:56:00.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.322+0000 7fa21fe00640 1 -- 172.21.15.6:0/838695833 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa2200051c0 con 0x7fa22815c170 2024-09-10T20:56:00.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.323+0000 7fa21fe00640 1 --2- 172.21.15.6:0/838695833 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa208077f70 0x7fa20807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:00.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.323+0000 7fa21fe00640 1 -- 172.21.15.6:0/838695833 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fa22009aa20 con 0x7fa22815c170 2024-09-10T20:56:00.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.324+0000 7fa227e00640 1 --2- 172.21.15.6:0/838695833 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa208077f70 0x7fa20807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:00.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.324+0000 7fa227e00640 1 --2- 172.21.15.6:0/838695833 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa208077f70 0x7fa20807a430 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa218009bd0 tx=0x7fa218005f90 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:00.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.327+0000 7fa21fe00640 1 -- 172.21.15.6:0/838695833 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fa220062ec0 con 0x7fa22815c170 2024-09-10T20:56:00.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.563+0000 7fa22ee00640 1 -- 172.21.15.6:0/838695833 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa228069d20 con 0x7fa22815c170 2024-09-10T20:56:00.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.564+0000 7fa21fe00640 1 -- 172.21.15.6:0/838695833 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5211 (secure 0 0 0) 0x7fa2200678f0 con 0x7fa22815c170 2024-09-10T20:56:00.568 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:56:00.568 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"btime":"2024-09-10T20:55:47:367368+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4329,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/77885972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":77885972},{"type":"v1","addr":"172.21.15.6:6834","nonce":77885972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4341,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/1181849476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1181849476},{"type":"v1","addr":"172.21.15.150:6836","nonce":1181849476}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4344,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/3860565837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":3860565837},{"type":"v1","addr":"172.21.15.150:6837","nonce":3860565837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:55:43.801792+0000","modified":"2024-09-10T20:55:46.798409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4375},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4375":{"gid":4375,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/3230367141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3230367141},{"type":"v1","addr":"172.21.15.6:6835","nonce":3230367141}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4375,"qdb_cluster":[4375]},"id":1}]} 2024-09-10T20:56:00.568 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2024-09-10T20:56:00.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.566+0000 7fa22ee00640 1 -- 172.21.15.6:0/838695833 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa208077f70 msgr2=0x7fa20807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:00.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.566+0000 7fa22ee00640 1 --2- 172.21.15.6:0/838695833 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa208077f70 0x7fa20807a430 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa218009bd0 tx=0x7fa218005f90 comp rx=0 tx=0).stop 2024-09-10T20:56:00.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.566+0000 7fa22ee00640 1 -- 172.21.15.6:0/838695833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa22815c170 msgr2=0x7fa2280ad880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:00.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.566+0000 7fa22ee00640 1 --2- 172.21.15.6:0/838695833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa22815c170 0x7fa2280ad880 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa22000eab0 tx=0x7fa220009f70 comp rx=0 tx=0).stop 2024-09-10T20:56:00.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.566+0000 7fa22ee00640 1 -- 172.21.15.6:0/838695833 shutdown_connections 2024-09-10T20:56:00.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.566+0000 7fa22ee00640 1 --2- 172.21.15.6:0/838695833 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa208077f70 0x7fa20807a430 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.566+0000 7fa22ee00640 1 --2- 172.21.15.6:0/838695833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa22815c170 0x7fa2280ad880 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.566+0000 7fa22ee00640 1 --2- 172.21.15.6:0/838695833 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa228159670 0x7fa228150da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.566+0000 7fa22ee00640 1 --2- 172.21.15.6:0/838695833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa22806fd40 0x7fa2280c4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.566+0000 7fa22ee00640 1 -- 172.21.15.6:0/838695833 >> 172.21.15.6:0/838695833 conn(0x7fa2280cfa20 msgr2=0x7fa2280b28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:00.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.566+0000 7fa22ee00640 1 -- 172.21.15.6:0/838695833 shutdown_connections 2024-09-10T20:56:00.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.566+0000 7fa22ee00640 1 -- 172.21.15.6:0/838695833 wait complete. 2024-09-10T20:56:00.585 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T20:56:00.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.740+0000 7f3ad3200640 1 -- 172.21.15.6:0/739043848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3acc0cef40 msgr2=0x7f3acc0cce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:00.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.740+0000 7f3ad3200640 1 --2- 172.21.15.6:0/739043848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3acc0cef40 0x7f3acc0cce30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8005fd0 tx=0x7f3ac802aa90 comp rx=0 tx=0).stop 2024-09-10T20:56:00.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.740+0000 7f3ad3200640 1 -- 172.21.15.6:0/739043848 shutdown_connections 2024-09-10T20:56:00.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.740+0000 7f3ad3200640 1 --2- 172.21.15.6:0/739043848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3acc0cef40 0x7f3acc0cce30 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.740+0000 7f3ad3200640 1 --2- 172.21.15.6:0/739043848 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3acc0ce5c0 0x7f3acc0cc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.740+0000 7f3ad3200640 1 -- 172.21.15.6:0/739043848 >> 172.21.15.6:0/739043848 conn(0x7f3acc0d0960 msgr2=0x7f3acc0d0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:00.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.740+0000 7f3ad3200640 1 -- 172.21.15.6:0/739043848 shutdown_connections 2024-09-10T20:56:00.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.741+0000 7f3ad3200640 1 -- 172.21.15.6:0/739043848 wait complete. 2024-09-10T20:56:00.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.742+0000 7f3ad3200640 1 Processor -- start 2024-09-10T20:56:00.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.742+0000 7f3ad3200640 1 -- start start 2024-09-10T20:56:00.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.743+0000 7f3ad3200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3acc0ce5c0 0x7f3acc0b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:00.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.743+0000 7f3ad3200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3acc0cef40 0x7f3acc149a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:00.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.743+0000 7f3ad3200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3acc15a8b0 0x7f3acc0b5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:00.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.743+0000 7f3ad3200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3acc074410 con 0x7f3acc0cef40 2024-09-10T20:56:00.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.743+0000 7f3ad3200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3acc074290 con 0x7f3acc15a8b0 2024-09-10T20:56:00.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.743+0000 7f3ad3200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3acc0734a0 con 0x7f3acc0ce5c0 2024-09-10T20:56:00.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.743+0000 7f3ad1400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3acc0cef40 0x7f3acc149a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:00.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.743+0000 7f3ad1400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3acc0cef40 0x7f3acc149a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56274/0 (socket says 172.21.15.6:56274) 2024-09-10T20:56:00.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.743+0000 7f3ad1400640 1 -- 172.21.15.6:0/704898501 learned_addr learned my addr 172.21.15.6:0/704898501 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:00.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.743+0000 7f3ad2800640 1 --2- 172.21.15.6:0/704898501 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3acc15a8b0 0x7f3acc0b5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:00.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.743+0000 7f3ad1e00640 1 --2- 172.21.15.6:0/704898501 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3acc0ce5c0 0x7f3acc0b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:00.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.744+0000 7f3ad1400640 1 -- 172.21.15.6:0/704898501 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3acc0ce5c0 msgr2=0x7f3acc0b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:00.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.744+0000 7f3ad1400640 1 --2- 172.21.15.6:0/704898501 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3acc0ce5c0 0x7f3acc0b42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.744+0000 7f3ad1400640 1 -- 172.21.15.6:0/704898501 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3acc15a8b0 msgr2=0x7f3acc0b5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:00.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.744+0000 7f3ad1400640 1 --2- 172.21.15.6:0/704898501 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3acc15a8b0 0x7f3acc0b5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.744+0000 7f3ad1400640 1 -- 172.21.15.6:0/704898501 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3acc15ca90 con 0x7f3acc0cef40 2024-09-10T20:56:00.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.744+0000 7f3ad1400640 1 --2- 172.21.15.6:0/704898501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3acc0cef40 0x7f3acc149a40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3abc00d740 tx=0x7f3abc00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:00.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.744+0000 7f3ac6000640 1 -- 172.21.15.6:0/704898501 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3abc017070 con 0x7f3acc0cef40 2024-09-10T20:56:00.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.744+0000 7f3ac6000640 1 -- 172.21.15.6:0/704898501 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3abc00de50 con 0x7f3acc0cef40 2024-09-10T20:56:00.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.744+0000 7f3ac6000640 1 -- 172.21.15.6:0/704898501 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3abc010460 con 0x7f3acc0cef40 2024-09-10T20:56:00.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.744+0000 7f3ad3200640 1 -- 172.21.15.6:0/704898501 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3acc149f80 con 0x7f3acc0cef40 2024-09-10T20:56:00.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.745+0000 7f3ad3200640 1 -- 172.21.15.6:0/704898501 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3acc15d010 con 0x7f3acc0cef40 2024-09-10T20:56:00.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.746+0000 7f3ad3200640 1 -- 172.21.15.6:0/704898501 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3acc073980 con 0x7f3acc0cef40 2024-09-10T20:56:00.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.747+0000 7f3ac6000640 1 -- 172.21.15.6:0/704898501 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3abc010600 con 0x7f3acc0cef40 2024-09-10T20:56:00.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.747+0000 7f3ac6000640 1 --2- 172.21.15.6:0/704898501 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3ab0077fa0 0x7f3ab007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:00.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.748+0000 7f3ac6000640 1 -- 172.21.15.6:0/704898501 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f3abc09a260 con 0x7f3acc0cef40 2024-09-10T20:56:00.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.748+0000 7f3ad1e00640 1 --2- 172.21.15.6:0/704898501 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3ab0077fa0 0x7f3ab007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:00.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.749+0000 7f3ad1e00640 1 --2- 172.21.15.6:0/704898501 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3ab0077fa0 0x7f3ab007a460 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0001720 tx=0x7f3ac0009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:00.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.751+0000 7f3ac6000640 1 -- 172.21.15.6:0/704898501 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f3abc062670 con 0x7f3acc0cef40 2024-09-10T20:56:00.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.946+0000 7f3ad3200640 1 -- 172.21.15.6:0/704898501 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3acc06d800 con 0x7f3acc0cef40 2024-09-10T20:56:00.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.947+0000 7f3ac6000640 1 -- 172.21.15.6:0/704898501 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16605 (secure 0 0 0) 0x7f3abc0670a0 con 0x7f3acc0cef40 2024-09-10T20:56:00.951 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:56:00.952 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":22,"fsid":"9e04309e-61c3-4c78-82db-9576e465d98a","created":"2024-09-10T20:55:17.972466+0000","modified":"2024-09-10T20:55:45.353614+0000","last_up_change":"2024-09-10T20:55:32.392769+0000","last_in_change":"2024-09-10T20:55:22.232252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:55:33.196464+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:55:41.833420+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T20:55:42.749182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0918c5c8-a028-4987-bad2-406c412ec3f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6801","nonce":895515615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6803","nonce":895515615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6807","nonce":895515615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6805","nonce":895515615}]},"public_addr":"172.21.15.6:6801/895515615","cluster_addr":"172.21.15.6:6803/895515615","heartbeat_back_addr":"172.21.15.6:6807/895515615","heartbeat_front_addr":"172.21.15.6:6805/895515615","state":["exists","up"]},{"osd":1,"uuid":"415e9c78-c3d9-46d6-b277-348453f42155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6809","nonce":1129113250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6811","nonce":1129113250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6815","nonce":1129113250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6813","nonce":1129113250}]},"public_addr":"172.21.15.6:6809/1129113250","cluster_addr":"172.21.15.6:6811/1129113250","heartbeat_back_addr":"172.21.15.6:6815/1129113250","heartbeat_front_addr":"172.21.15.6:6813/1129113250","state":["exists","up"]},{"osd":2,"uuid":"763c1cf2-a43d-4c10-815d-eaf4a32afc1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6825","nonce":3847470051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6827","nonce":3847470051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6831","nonce":3847470051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6829","nonce":3847470051}]},"public_addr":"172.21.15.6:6825/3847470051","cluster_addr":"172.21.15.6:6827/3847470051","heartbeat_back_addr":"172.21.15.6:6831/3847470051","heartbeat_front_addr":"172.21.15.6:6829/3847470051","state":["exists","up"]},{"osd":3,"uuid":"877b1cc1-2434-4b32-af66-9c2485eac9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6817","nonce":3911674247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6819","nonce":3911674247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6823","nonce":3911674247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6821","nonce":3911674247}]},"public_addr":"172.21.15.6:6817/3911674247","cluster_addr":"172.21.15.6:6819/3911674247","heartbeat_back_addr":"172.21.15.6:6823/3911674247","heartbeat_front_addr":"172.21.15.6:6821/3911674247","state":["exists","up"]},{"osd":4,"uuid":"e0b27501-dfdc-4e7f-b73a-9573c869267a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6827","nonce":2568527750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6829","nonce":2568527750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6833","nonce":2568527750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6831","nonce":2568527750}]},"public_addr":"172.21.15.150:6827/2568527750","cluster_addr":"172.21.15.150:6829/2568527750","heartbeat_back_addr":"172.21.15.150:6833/2568527750","heartbeat_front_addr":"172.21.15.150:6831/2568527750","state":["exists","up"]},{"osd":5,"uuid":"67e48053-4f15-44fd-a30c-c9522f86d169","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6811","nonce":371417736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6813","nonce":371417736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6817","nonce":371417736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6815","nonce":371417736}]},"public_addr":"172.21.15.150:6811/371417736","cluster_addr":"172.21.15.150:6813/371417736","heartbeat_back_addr":"172.21.15.150:6817/371417736","heartbeat_front_addr":"172.21.15.150:6815/371417736","state":["exists","up"]},{"osd":6,"uuid":"1456df2e-ae91-45a4-bc3a-a06c753092af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6819","nonce":2329248366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6821","nonce":2329248366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6825","nonce":2329248366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6823","nonce":2329248366}]},"public_addr":"172.21.15.150:6819/2329248366","cluster_addr":"172.21.15.150:6821/2329248366","heartbeat_back_addr":"172.21.15.150:6825/2329248366","heartbeat_front_addr":"172.21.15.150:6823/2329248366","state":["exists","up"]},{"osd":7,"uuid":"a9daafcb-5ecd-43bd-ab0a-dc4b480cfc2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6803","nonce":527018351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6805","nonce":527018351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6809","nonce":527018351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6807","nonce":527018351}]},"public_addr":"172.21.15.150:6803/527018351","cluster_addr":"172.21.15.150:6805/527018351","heartbeat_back_addr":"172.21.15.150:6809/527018351","heartbeat_front_addr":"172.21.15.150:6807/527018351","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.710061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.024506+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.824320+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.431608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.637032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.054828+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.333290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.358875+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:56:00.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.949+0000 7f3ad3200640 1 -- 172.21.15.6:0/704898501 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3ab0077fa0 msgr2=0x7f3ab007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:00.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.949+0000 7f3ad3200640 1 --2- 172.21.15.6:0/704898501 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3ab0077fa0 0x7f3ab007a460 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0001720 tx=0x7f3ac0009040 comp rx=0 tx=0).stop 2024-09-10T20:56:00.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.949+0000 7f3ad3200640 1 -- 172.21.15.6:0/704898501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3acc0cef40 msgr2=0x7f3acc149a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:00.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.949+0000 7f3ad3200640 1 --2- 172.21.15.6:0/704898501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3acc0cef40 0x7f3acc149a40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3abc00d740 tx=0x7f3abc00dc00 comp rx=0 tx=0).stop 2024-09-10T20:56:00.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.950+0000 7f3ad3200640 1 -- 172.21.15.6:0/704898501 shutdown_connections 2024-09-10T20:56:00.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.950+0000 7f3ad3200640 1 --2- 172.21.15.6:0/704898501 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3ab0077fa0 0x7f3ab007a460 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.950+0000 7f3ad3200640 1 --2- 172.21.15.6:0/704898501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3acc0cef40 0x7f3acc149a40 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.950+0000 7f3ad3200640 1 --2- 172.21.15.6:0/704898501 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3acc15a8b0 0x7f3acc0b5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.950+0000 7f3ad3200640 1 --2- 172.21.15.6:0/704898501 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3acc0ce5c0 0x7f3acc0b42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.950+0000 7f3ad3200640 1 -- 172.21.15.6:0/704898501 >> 172.21.15.6:0/704898501 conn(0x7f3acc0d0960 msgr2=0x7f3acc1585a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:00.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.950+0000 7f3ad3200640 1 -- 172.21.15.6:0/704898501 shutdown_connections 2024-09-10T20:56:00.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:00.950+0000 7f3ad3200640 1 -- 172.21.15.6:0/704898501 wait complete. 2024-09-10T20:56:00.969 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:56:01.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.125+0000 7f5bb2a00640 1 -- 172.21.15.6:0/3482594851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bac15dc90 msgr2=0x7f5bac0d46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:01.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.125+0000 7f5bb2a00640 1 --2- 172.21.15.6:0/3482594851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bac15dc90 0x7f5bac0d46a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5bac08e5a0 tx=0x7f5ba002a530 comp rx=0 tx=0).stop 2024-09-10T20:56:01.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.125+0000 7f5bb2a00640 1 -- 172.21.15.6:0/3482594851 shutdown_connections 2024-09-10T20:56:01.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.125+0000 7f5bb2a00640 1 --2- 172.21.15.6:0/3482594851 >> v2:172.21.15.150:3300/0 conn(0x7f5bac0cf380 0x7f5bac0d2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:01.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.125+0000 7f5bb2a00640 1 --2- 172.21.15.6:0/3482594851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bac15dc90 0x7f5bac0d46a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:01.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.125+0000 7f5bb2a00640 1 -- 172.21.15.6:0/3482594851 >> 172.21.15.6:0/3482594851 conn(0x7f5bac09d0a0 msgr2=0x7f5bac0d3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:01.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.126+0000 7f5bb2a00640 1 -- 172.21.15.6:0/3482594851 shutdown_connections 2024-09-10T20:56:01.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.126+0000 7f5bb2a00640 1 -- 172.21.15.6:0/3482594851 wait complete. 2024-09-10T20:56:01.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.127+0000 7f5bb2a00640 1 Processor -- start 2024-09-10T20:56:01.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.127+0000 7f5bb2a00640 1 -- start start 2024-09-10T20:56:01.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.128+0000 7f5bb2a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bac0cf380 0x7f5bac1f40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:01.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.128+0000 7f5bb2a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bac0d2a60 0x7f5bac14cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:01.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.128+0000 7f5bb2a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bac15dc90 0x7f5bac14d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:01.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.128+0000 7f5bb2a00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5bac15e270 con 0x7f5bac15dc90 2024-09-10T20:56:01.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.128+0000 7f5bb2a00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5bac162250 con 0x7f5bac0cf380 2024-09-10T20:56:01.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.128+0000 7f5bb2a00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f5bac0b3350 con 0x7f5bac0d2a60 2024-09-10T20:56:01.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.128+0000 7f5bb2000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bac15dc90 0x7f5bac14d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:01.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.128+0000 7f5bb2000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bac15dc90 0x7f5bac14d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56302/0 (socket says 172.21.15.6:56302) 2024-09-10T20:56:01.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.128+0000 7f5bb2000640 1 -- 172.21.15.6:0/2475963157 learned_addr learned my addr 172.21.15.6:0/2475963157 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:01.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.128+0000 7f5bb1600640 1 --2- 172.21.15.6:0/2475963157 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bac0cf380 0x7f5bac1f40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:01.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.129+0000 7f5bb0c00640 1 --2- 172.21.15.6:0/2475963157 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bac0d2a60 0x7f5bac14cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:01.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.129+0000 7f5bb2000640 1 -- 172.21.15.6:0/2475963157 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bac0d2a60 msgr2=0x7f5bac14cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:01.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.129+0000 7f5bb2000640 1 --2- 172.21.15.6:0/2475963157 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bac0d2a60 0x7f5bac14cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:01.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.129+0000 7f5bb2000640 1 -- 172.21.15.6:0/2475963157 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bac0cf380 msgr2=0x7f5bac1f40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:01.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.129+0000 7f5bb2000640 1 --2- 172.21.15.6:0/2475963157 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bac0cf380 0x7f5bac1f40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:01.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.129+0000 7f5bb2000640 1 -- 172.21.15.6:0/2475963157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bac1510a0 con 0x7f5bac15dc90 2024-09-10T20:56:01.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.129+0000 7f5bb2000640 1 --2- 172.21.15.6:0/2475963157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bac15dc90 0x7f5bac14d310 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5ba400cbc0 tx=0x7f5ba400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:01.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.129+0000 7f5ba9600640 1 -- 172.21.15.6:0/2475963157 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4016020 con 0x7f5bac15dc90 2024-09-10T20:56:01.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.129+0000 7f5ba9600640 1 -- 172.21.15.6:0/2475963157 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ba400ae30 con 0x7f5bac15dc90 2024-09-10T20:56:01.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.129+0000 7f5ba9600640 1 -- 172.21.15.6:0/2475963157 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4012660 con 0x7f5bac15dc90 2024-09-10T20:56:01.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.129+0000 7f5bb2a00640 1 -- 172.21.15.6:0/2475963157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bac0b59e0 con 0x7f5bac15dc90 2024-09-10T20:56:01.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.130+0000 7f5bb2a00640 1 -- 172.21.15.6:0/2475963157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bac0b5fa0 con 0x7f5bac15dc90 2024-09-10T20:56:01.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.131+0000 7f5bb2a00640 1 -- 172.21.15.6:0/2475963157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bac14aa60 con 0x7f5bac15dc90 2024-09-10T20:56:01.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.132+0000 7f5ba9600640 1 -- 172.21.15.6:0/2475963157 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5ba401a3b0 con 0x7f5bac15dc90 2024-09-10T20:56:01.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.133+0000 7f5ba9600640 1 --2- 172.21.15.6:0/2475963157 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5b8c077f70 0x7f5b8c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:01.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.133+0000 7f5ba9600640 1 -- 172.21.15.6:0/2475963157 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f5ba409a340 con 0x7f5bac15dc90 2024-09-10T20:56:01.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.133+0000 7f5bb1600640 1 --2- 172.21.15.6:0/2475963157 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5b8c077f70 0x7f5b8c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:01.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.134+0000 7f5bb1600640 1 --2- 172.21.15.6:0/2475963157 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5b8c077f70 0x7f5b8c07a430 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0034000 tx=0x7f5ba0004730 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:01.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.137+0000 7f5ba9600640 1 -- 172.21.15.6:0/2475963157 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5bac14aa60 con 0x7f5bac15dc90 2024-09-10T20:56:01.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.366+0000 7f5bb2a00640 1 -- 172.21.15.6:0/2475963157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5bac069d10 con 0x7f5bac15dc90 2024-09-10T20:56:01.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.367+0000 7f5ba9600640 1 -- 172.21.15.6:0/2475963157 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5211 (secure 0 0 0) 0x7f5ba4020030 con 0x7f5bac15dc90 2024-09-10T20:56:01.371 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:56:01.371 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"btime":"2024-09-10T20:55:47:367368+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4329,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/77885972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":77885972},{"type":"v1","addr":"172.21.15.6:6834","nonce":77885972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4341,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/1181849476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1181849476},{"type":"v1","addr":"172.21.15.150:6836","nonce":1181849476}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4344,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/3860565837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":3860565837},{"type":"v1","addr":"172.21.15.150:6837","nonce":3860565837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:55:43.801792+0000","modified":"2024-09-10T20:55:46.798409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4375},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4375":{"gid":4375,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/3230367141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3230367141},{"type":"v1","addr":"172.21.15.6:6835","nonce":3230367141}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4375,"qdb_cluster":[4375]},"id":1}]} 2024-09-10T20:56:01.371 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2024-09-10T20:56:01.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.369+0000 7f5bb2a00640 1 -- 172.21.15.6:0/2475963157 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5b8c077f70 msgr2=0x7f5b8c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:01.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.369+0000 7f5bb2a00640 1 --2- 172.21.15.6:0/2475963157 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5b8c077f70 0x7f5b8c07a430 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0034000 tx=0x7f5ba0004730 comp rx=0 tx=0).stop 2024-09-10T20:56:01.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.369+0000 7f5bb2a00640 1 -- 172.21.15.6:0/2475963157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bac15dc90 msgr2=0x7f5bac14d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:01.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.369+0000 7f5bb2a00640 1 --2- 172.21.15.6:0/2475963157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bac15dc90 0x7f5bac14d310 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5ba400cbc0 tx=0x7f5ba400a430 comp rx=0 tx=0).stop 2024-09-10T20:56:01.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.369+0000 7f5bb2a00640 1 -- 172.21.15.6:0/2475963157 shutdown_connections 2024-09-10T20:56:01.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.369+0000 7f5bb2a00640 1 --2- 172.21.15.6:0/2475963157 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5b8c077f70 0x7f5b8c07a430 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:01.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.369+0000 7f5bb2a00640 1 --2- 172.21.15.6:0/2475963157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bac15dc90 0x7f5bac14d310 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:01.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.369+0000 7f5bb2a00640 1 --2- 172.21.15.6:0/2475963157 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bac0d2a60 0x7f5bac14cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:01.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.369+0000 7f5bb2a00640 1 --2- 172.21.15.6:0/2475963157 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bac0cf380 0x7f5bac1f40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:01.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.369+0000 7f5bb2a00640 1 -- 172.21.15.6:0/2475963157 >> 172.21.15.6:0/2475963157 conn(0x7f5bac09d0a0 msgr2=0x7f5bac161460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:01.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.369+0000 7f5bb2a00640 1 -- 172.21.15.6:0/2475963157 shutdown_connections 2024-09-10T20:56:01.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.369+0000 7f5bb2a00640 1 -- 172.21.15.6:0/2475963157 wait complete. 2024-09-10T20:56:01.793 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T20:55:43.801792+0000', 'modified': '2024-09-10T20:55:46.798409+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4375}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4375': {'gid': 4375, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6835/3230367141', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6833', 'nonce': 3230367141}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 3230367141}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4375, 'qdb_cluster': [4375]} 2024-09-10T20:56:01.793 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T20:56:01.793 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-10T20:56:01.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.952+0000 7ffad5000640 1 -- 172.21.15.6:0/2547372620 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffad015c170 msgr2=0x7ffad00cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:01.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.952+0000 7ffad5000640 1 --2- 172.21.15.6:0/2547372620 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffad015c170 0x7ffad00cd920 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ffab8009830 tx=0x7ffab802a480 comp rx=0 tx=0).stop 2024-09-10T20:56:01.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.953+0000 7ffad5000640 1 -- 172.21.15.6:0/2547372620 shutdown_connections 2024-09-10T20:56:01.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.953+0000 7ffad5000640 1 --2- 172.21.15.6:0/2547372620 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffad015c170 0x7ffad00cd920 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:01.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.953+0000 7ffad5000640 1 --2- 172.21.15.6:0/2547372620 >> v2:172.21.15.150:3300/0 conn(0x7ffad0159670 0x7ffad00743b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:01.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.953+0000 7ffad5000640 1 -- 172.21.15.6:0/2547372620 >> 172.21.15.6:0/2547372620 conn(0x7ffad00cfa20 msgr2=0x7ffad00cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:01.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.953+0000 7ffad5000640 1 -- 172.21.15.6:0/2547372620 shutdown_connections 2024-09-10T20:56:01.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.953+0000 7ffad5000640 1 -- 172.21.15.6:0/2547372620 wait complete. 2024-09-10T20:56:01.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.954+0000 7ffad5000640 1 Processor -- start 2024-09-10T20:56:01.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.954+0000 7ffad5000640 1 -- start start 2024-09-10T20:56:01.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.955+0000 7ffad5000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffad006fd40 0x7ffad0156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:01.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.955+0000 7ffad5000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffad0159670 0x7ffad014a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:01.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.955+0000 7ffad5000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffad015c170 0x7ffad01f3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:01.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.955+0000 7ffad5000640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ffad00b4ca0 con 0x7ffad006fd40 2024-09-10T20:56:01.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.955+0000 7ffad5000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ffad00b4b20 con 0x7ffad0159670 2024-09-10T20:56:01.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.955+0000 7ffad5000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ffad00b4e20 con 0x7ffad015c170 2024-09-10T20:56:01.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.955+0000 7ffacde00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffad006fd40 0x7ffad0156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:01.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.956+0000 7ffacde00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffad006fd40 0x7ffad0156d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56306/0 (socket says 172.21.15.6:56306) 2024-09-10T20:56:01.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.956+0000 7ffacde00640 1 -- 172.21.15.6:0/1663645488 learned_addr learned my addr 172.21.15.6:0/1663645488 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:01.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.956+0000 7ffac5400640 1 --2- 172.21.15.6:0/1663645488 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffad0159670 0x7ffad014a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:01.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.956+0000 7fface800640 1 --2- 172.21.15.6:0/1663645488 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffad015c170 0x7ffad01f3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:01.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.956+0000 7ffacde00640 1 -- 172.21.15.6:0/1663645488 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffad015c170 msgr2=0x7ffad01f3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:01.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.956+0000 7ffacde00640 1 --2- 172.21.15.6:0/1663645488 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffad015c170 0x7ffad01f3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:01.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.956+0000 7ffacde00640 1 -- 172.21.15.6:0/1663645488 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffad0159670 msgr2=0x7ffad014a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:01.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.956+0000 7ffacde00640 1 --2- 172.21.15.6:0/1663645488 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffad0159670 0x7ffad014a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:01.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.956+0000 7ffacde00640 1 -- 172.21.15.6:0/1663645488 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffad00ca070 con 0x7ffad006fd40 2024-09-10T20:56:01.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.956+0000 7ffacde00640 1 --2- 172.21.15.6:0/1663645488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffad006fd40 0x7ffad0156d00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ffac000ea20 tx=0x7ffac000eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:01.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.956+0000 7ffac6a00640 1 -- 172.21.15.6:0/1663645488 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac000cd80 con 0x7ffad006fd40 2024-09-10T20:56:01.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.956+0000 7ffac6a00640 1 -- 172.21.15.6:0/1663645488 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffac0010430 con 0x7ffad006fd40 2024-09-10T20:56:01.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.957+0000 7ffac6a00640 1 -- 172.21.15.6:0/1663645488 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac0010840 con 0x7ffad006fd40 2024-09-10T20:56:01.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.957+0000 7ffad5000640 1 -- 172.21.15.6:0/1663645488 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffad014b200 con 0x7ffad006fd40 2024-09-10T20:56:01.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.957+0000 7ffad5000640 1 -- 172.21.15.6:0/1663645488 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffad014b7c0 con 0x7ffad006fd40 2024-09-10T20:56:01.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.960+0000 7ffac6a00640 1 -- 172.21.15.6:0/1663645488 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ffac00109e0 con 0x7ffad006fd40 2024-09-10T20:56:01.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.961+0000 7ffac6a00640 1 --2- 172.21.15.6:0/1663645488 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ffaac077f70 0x7ffaac07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:01.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.961+0000 7ffac6a00640 1 -- 172.21.15.6:0/1663645488 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ffac009a900 con 0x7ffad006fd40 2024-09-10T20:56:01.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.961+0000 7ffad8026740 1 Processor -- start 2024-09-10T20:56:01.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.961+0000 7ffad8026740 1 -- start start 2024-09-10T20:56:01.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.961+0000 7ffac5400640 1 --2- 172.21.15.6:0/1663645488 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ffaac077f70 0x7ffaac07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:01.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.962+0000 7ffad8026740 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e3564f08b0 0x55e3564f0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:01.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.962+0000 7ffad8026740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3564aba20 0x55e3564ef390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:01.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.962+0000 7ffac5400640 1 --2- 172.21.15.6:0/1663645488 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ffaac077f70 0x7ffaac07a430 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ffab8034000 tx=0x7ffab8004730 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:01.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.962+0000 7ffad8026740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e3564abfa0 0x55e3564ef8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:01.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.962+0000 7ffad8026740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55e35642e430 con 0x55e3564aba20 2024-09-10T20:56:01.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.962+0000 7ffad8026740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55e35641e5d0 con 0x55e3564abfa0 2024-09-10T20:56:01.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.962+0000 7ffad8026740 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x55e35640da00 con 0x55e3564f08b0 2024-09-10T20:56:01.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.962+0000 7ffac5400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3564aba20 0x55e3564ef390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:01.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.962+0000 7ffac5400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3564aba20 0x55e3564ef390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56322/0 (socket says 172.21.15.6:56322) 2024-09-10T20:56:01.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.962+0000 7ffac5400640 1 -- 172.21.15.6:0/2769261508 learned_addr learned my addr 172.21.15.6:0/2769261508 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:01.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.962+0000 7ffacde00640 1 --2- 172.21.15.6:0/2769261508 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e3564f08b0 0x55e3564f0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:01.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.962+0000 7fface800640 1 --2- 172.21.15.6:0/2769261508 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e3564abfa0 0x55e3564ef8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:01.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.963+0000 7ffac5400640 1 -- 172.21.15.6:0/2769261508 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e3564f08b0 msgr2=0x55e3564f0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:01.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.963+0000 7ffac5400640 1 --2- 172.21.15.6:0/2769261508 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e3564f08b0 0x55e3564f0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:01.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.963+0000 7ffac5400640 1 -- 172.21.15.6:0/2769261508 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e3564abfa0 msgr2=0x55e3564ef8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:01.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.963+0000 7ffac5400640 1 --2- 172.21.15.6:0/2769261508 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e3564abfa0 0x55e3564ef8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:01.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.963+0000 7ffac5400640 1 -- 172.21.15.6:0/2769261508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3563d6520 con 0x55e3564aba20 2024-09-10T20:56:01.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.963+0000 7ffac5400640 1 --2- 172.21.15.6:0/2769261508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3564aba20 0x55e3564ef390 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ffab802aa70 tx=0x7ffab803d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adc016b2052664de server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:01.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.963+0000 7ffabea00640 1 -- 172.21.15.6:0/2769261508 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab804d070 con 0x55e3564aba20 2024-09-10T20:56:01.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.963+0000 7ffabea00640 1 -- 172.21.15.6:0/2769261508 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffab8049450 con 0x55e3564aba20 2024-09-10T20:56:01.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.963+0000 7ffabea00640 1 -- 172.21.15.6:0/2769261508 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab8049840 con 0x55e3564aba20 2024-09-10T20:56:01.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.964+0000 7ffad8026740 1 -- 172.21.15.6:0/2769261508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3564aba20 msgr2=0x55e3564ef390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:01.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.964+0000 7ffad8026740 1 --2- 172.21.15.6:0/2769261508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3564aba20 0x55e3564ef390 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ffab802aa70 tx=0x7ffab803d000 comp rx=0 tx=0).stop 2024-09-10T20:56:01.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.964+0000 7ffad8026740 1 -- 172.21.15.6:0/2769261508 shutdown_connections 2024-09-10T20:56:01.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.964+0000 7ffad8026740 1 --2- 172.21.15.6:0/2769261508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3564aba20 0x55e3564ef390 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:01.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.964+0000 7ffad8026740 1 --2- 172.21.15.6:0/2769261508 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e3564abfa0 0x55e3564ef8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:01.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.964+0000 7ffad8026740 1 --2- 172.21.15.6:0/2769261508 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e3564f08b0 0x55e3564f0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:01.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.964+0000 7ffad8026740 1 -- 172.21.15.6:0/2769261508 >> 172.21.15.6:0/2769261508 conn(0x55e3564a6ff0 msgr2=0x55e3564aaa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:01.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.964+0000 7ffad8026740 1 -- 172.21.15.6:0/2769261508 shutdown_connections 2024-09-10T20:56:01.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.964+0000 7ffad8026740 1 -- 172.21.15.6:0/2769261508 wait complete. 2024-09-10T20:56:01.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.965+0000 7ffad8026740 1 -- start start 2024-09-10T20:56:01.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.965+0000 7ffad8026740 1 Processor -- start 2024-09-10T20:56:01.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.966+0000 7ffad8026740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3564abfa0 0x55e3565008d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:01.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.966+0000 7ffad8026740 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e3564f08b0 0x55e356503470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:01.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.966+0000 7ffad8026740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e3564edc50 0x55e3564c2af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:01.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.966+0000 7ffad8026740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55e3563b4330 con 0x55e3564abfa0 2024-09-10T20:56:01.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.966+0000 7ffad8026740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55e356411810 con 0x55e3564edc50 2024-09-10T20:56:01.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.966+0000 7ffad8026740 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x55e35617e620 con 0x55e3564f08b0 2024-09-10T20:56:01.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.966+0000 7ffad8026740 10 client.0 _ll_register_callbacks cb 0x55e3563b9420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:56:01.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.966+0000 7ffacde00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3564abfa0 0x55e3565008d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:01.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.966+0000 7ffacde00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3564abfa0 0x55e3565008d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56338/0 (socket says 172.21.15.6:56338) 2024-09-10T20:56:01.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.966+0000 7ffacde00640 1 -- 172.21.15.6:0/3185647991 learned_addr learned my addr 172.21.15.6:0/3185647991 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:01.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.966+0000 7ffac5400640 1 --2- 172.21.15.6:0/3185647991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e3564f08b0 0x55e356503470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:01.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.966+0000 7fface800640 1 --2- 172.21.15.6:0/3185647991 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e3564edc50 0x55e3564c2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:01.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.967+0000 7ffacde00640 1 -- 172.21.15.6:0/3185647991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e3564f08b0 msgr2=0x55e356503470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:01.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.967+0000 7ffacde00640 1 --2- 172.21.15.6:0/3185647991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e3564f08b0 0x55e356503470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:01.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.967+0000 7ffacde00640 1 -- 172.21.15.6:0/3185647991 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e3564edc50 msgr2=0x55e3564c2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:01.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.967+0000 7ffacde00640 1 --2- 172.21.15.6:0/3185647991 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e3564edc50 0x55e3564c2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:01.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.967+0000 7ffacde00640 1 -- 172.21.15.6:0/3185647991 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e35616f850 con 0x55e3564abfa0 2024-09-10T20:56:01.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.967+0000 7fface800640 1 --2- 172.21.15.6:0/3185647991 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e3564edc50 0x55e3564c2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:56:01.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.967+0000 7ffacde00640 1 --2- 172.21.15.6:0/3185647991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3564abfa0 0x55e3565008d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ffac005ed00 tx=0x7ffac00628c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ce1783139ae7216 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:01.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.967+0000 7ffab3400640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-10T20:56:01.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.967+0000 7ffab3400640 1 -- 172.21.15.6:0/3185647991 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac0088020 con 0x55e3564abfa0 2024-09-10T20:56:01.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.967+0000 7ffab3400640 1 -- 172.21.15.6:0/3185647991 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ffac005e640 con 0x55e3564abfa0 2024-09-10T20:56:01.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.967+0000 7ffad8026740 1 -- 172.21.15.6:0/3185647991 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffab8049450 con 0x55e3564abfa0 2024-09-10T20:56:01.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.967+0000 7ffab3400640 1 -- 172.21.15.6:0/3185647991 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7ffac0098050 con 0x55e3564abfa0 2024-09-10T20:56:01.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.967+0000 7ffad8026740 10 client.4704 fetch_fsmap learned FSMap version 8 2024-09-10T20:56:01.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.967+0000 7ffad8026740 1 -- 172.21.15.6:0/3185647991 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55e3561e66b0 con 0x55e3564abfa0 2024-09-10T20:56:01.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.967+0000 7ffab3400640 1 -- 172.21.15.6:0/3185647991 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffab8049450 con 0x55e3564abfa0 2024-09-10T20:56:01.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.967+0000 7ffab3400640 1 -- 172.21.15.6:0/3185647991 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7ffac005e840 con 0x55e3564abfa0 2024-09-10T20:56:01.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.968+0000 7ffad8026740 10 client.4704 fetch_fsmap finished waiting for FSMap version 8 2024-09-10T20:56:01.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.968+0000 7ffad8026740 10 client.4704 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T20:56:01.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.968+0000 7ffad8026740 20 client.4704 populate_metadata read hostname 'smithi006' 2024-09-10T20:56:01.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.968+0000 7ffad8026740 1 --2- 172.21.15.6:0/3185647991 >> [v2:172.21.15.6:6833/3230367141,v1:172.21.15.6:6835/3230367141] conn(0x55e3564e9fc0 0x55e3564ea3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:01.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.968+0000 7ffad8026740 4 client.4704 mds_command: new command op to 4375 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:56:01.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.968+0000 7ffad8026740 1 -- 172.21.15.6:0/3185647991 --> [v2:172.21.15.6:6833/3230367141,v1:172.21.15.6:6835/3230367141] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e356420520 con 0x55e3564e9fc0 2024-09-10T20:56:01.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.968+0000 7ffac5400640 1 --2- 172.21.15.6:0/3185647991 >> [v2:172.21.15.6:6833/3230367141,v1:172.21.15.6:6835/3230367141] conn(0x55e3564e9fc0 0x55e3564ea3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:01.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.968+0000 7ffac5400640 1 --2- 172.21.15.6:0/3185647991 >> [v2:172.21.15.6:6833/3230367141,v1:172.21.15.6:6835/3230367141] conn(0x55e3564e9fc0 0x55e3564ea3a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67b80d20a9ed1f87 server_cookie=869f12f5d0b17118 in_seq=0 out_seq=0 2024-09-10T20:56:01.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.968+0000 7ffab3400640 10 client.4704 ms_handle_connect on v2:172.21.15.6:6833/3230367141 2024-09-10T20:56:01.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.969+0000 7ffab3400640 1 -- 172.21.15.6:0/3185647991 <== mds.0 v2:172.21.15.6:6833/3230367141 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e356420520 con 0x55e3564e9fc0 2024-09-10T20:56:01.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.969+0000 7ffab3400640 10 client.4704 handle_command_reply: tid=0 2024-09-10T20:56:01.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.969+0000 7ffad8026740 1 client.4704 shutdown 2024-09-10T20:56:01.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.970+0000 7ffad8026740 1 -- 172.21.15.6:0/3185647991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3564abfa0 msgr2=0x55e3565008d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:01.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.970+0000 7ffad8026740 1 --2- 172.21.15.6:0/3185647991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3564abfa0 0x55e3565008d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ffac005ed00 tx=0x7ffac00628c0 comp rx=0 tx=0).stop 2024-09-10T20:56:01.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.970+0000 7ffad8026740 1 -- 172.21.15.6:0/3185647991 shutdown_connections 2024-09-10T20:56:01.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.970+0000 7ffad8026740 1 --2- 172.21.15.6:0/3185647991 >> [v2:172.21.15.6:6833/3230367141,v1:172.21.15.6:6835/3230367141] conn(0x55e3564e9fc0 0x55e3564ea3a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:01.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.970+0000 7ffad8026740 1 --2- 172.21.15.6:0/3185647991 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e3564edc50 0x55e3564c2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:01.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.970+0000 7ffad8026740 1 --2- 172.21.15.6:0/3185647991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e3564f08b0 0x55e356503470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:01.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.970+0000 7ffad8026740 1 --2- 172.21.15.6:0/3185647991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3564abfa0 0x55e3565008d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:01.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.970+0000 7ffab3400640 0 client.4704 ms_handle_reset on v2:172.21.15.6:6833/3230367141 2024-09-10T20:56:01.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.970+0000 7ffad8026740 1 -- 172.21.15.6:0/3185647991 >> 172.21.15.6:0/3185647991 conn(0x55e3564aba20 msgr2=0x55e3564e9330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:01.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.970+0000 7ffad8026740 1 -- 172.21.15.6:0/3185647991 shutdown_connections 2024-09-10T20:56:01.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.970+0000 7ffad8026740 1 -- 172.21.15.6:0/3185647991 wait complete. 2024-09-10T20:56:01.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.970+0000 7ffad8026740 20 client.4704 trim_cache size 0 max 16384 2024-09-10T20:56:01.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.989+0000 7ffad8026740 1 Processor -- start 2024-09-10T20:56:01.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.989+0000 7ffad8026740 1 -- start start 2024-09-10T20:56:01.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.990+0000 7ffad8026740 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e3564abfa0 0x55e3564f2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:01.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.990+0000 7ffad8026740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e3564edc50 0x55e3564ff530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:01.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.990+0000 7ffad8026740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3564f08b0 0x55e3564e85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:01.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.990+0000 7ffad8026740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ffad01fffb0 con 0x55e3564f08b0 2024-09-10T20:56:01.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.990+0000 7ffad8026740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ffad01f7f90 con 0x55e3564edc50 2024-09-10T20:56:01.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.990+0000 7ffad8026740 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ffad01f85e0 con 0x55e3564abfa0 2024-09-10T20:56:01.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.990+0000 7fface800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3564f08b0 0x55e3564e85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:01.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.990+0000 7fface800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3564f08b0 0x55e3564e85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56342/0 (socket says 172.21.15.6:56342) 2024-09-10T20:56:01.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.990+0000 7fface800640 1 -- 172.21.15.6:0/440286853 learned_addr learned my addr 172.21.15.6:0/440286853 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:01.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.990+0000 7ffacde00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e3564abfa0 0x55e3564f2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:01.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.990+0000 7ffac5400640 1 --2- 172.21.15.6:0/440286853 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e3564edc50 0x55e3564ff530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:01.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.991+0000 7fface800640 1 -- 172.21.15.6:0/440286853 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e3564abfa0 msgr2=0x55e3564f2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:01.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.991+0000 7fface800640 1 --2- 172.21.15.6:0/440286853 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e3564abfa0 0x55e3564f2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:01.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.991+0000 7fface800640 1 -- 172.21.15.6:0/440286853 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e3564edc50 msgr2=0x55e3564ff530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:01.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.991+0000 7fface800640 1 --2- 172.21.15.6:0/440286853 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e3564edc50 0x55e3564ff530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:01.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.991+0000 7fface800640 1 -- 172.21.15.6:0/440286853 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3564a82a0 con 0x55e3564f08b0 2024-09-10T20:56:01.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.991+0000 7fface800640 1 --2- 172.21.15.6:0/440286853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3564f08b0 0x55e3564e85e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ffac8002050 tx=0x7ffac80136a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9af57348e4f41898 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:01.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.991+0000 7ffabe000640 1 -- 172.21.15.6:0/440286853 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac801a030 con 0x55e3564f08b0 2024-09-10T20:56:01.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.991+0000 7ffabe000640 1 -- 172.21.15.6:0/440286853 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffac8016450 con 0x55e3564f08b0 2024-09-10T20:56:01.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.991+0000 7ffabe000640 1 -- 172.21.15.6:0/440286853 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac8016680 con 0x55e3564f08b0 2024-09-10T20:56:01.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.992+0000 7ffad8026740 1 -- 172.21.15.6:0/440286853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3564f08b0 msgr2=0x55e3564e85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:01.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.992+0000 7ffad8026740 1 --2- 172.21.15.6:0/440286853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3564f08b0 0x55e3564e85e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ffac8002050 tx=0x7ffac80136a0 comp rx=0 tx=0).stop 2024-09-10T20:56:01.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.992+0000 7ffad8026740 1 -- 172.21.15.6:0/440286853 shutdown_connections 2024-09-10T20:56:01.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.992+0000 7ffad8026740 1 --2- 172.21.15.6:0/440286853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3564f08b0 0x55e3564e85e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:01.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.992+0000 7ffad8026740 1 --2- 172.21.15.6:0/440286853 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e3564edc50 0x55e3564ff530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:01.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.992+0000 7ffad8026740 1 --2- 172.21.15.6:0/440286853 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e3564abfa0 0x55e3564f2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:01.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.992+0000 7ffad8026740 1 -- 172.21.15.6:0/440286853 >> 172.21.15.6:0/440286853 conn(0x55e3564aba20 msgr2=0x55e3564aa410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:01.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.992+0000 7ffad8026740 1 -- 172.21.15.6:0/440286853 shutdown_connections 2024-09-10T20:56:01.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.992+0000 7ffad8026740 1 -- 172.21.15.6:0/440286853 wait complete. 2024-09-10T20:56:01.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.993+0000 7ffad8026740 1 -- start start 2024-09-10T20:56:02.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.993+0000 7ffad8026740 1 Processor -- start 2024-09-10T20:56:02.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.994+0000 7ffad8026740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3564abfa0 0x55e356568070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:02.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.994+0000 7ffad8026740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e3564edc50 0x55e3564e85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:02.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.994+0000 7ffad8026740 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e3564f08b0 0x55e3564e8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:02.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.994+0000 7ffad8026740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55e3564ee0d0 con 0x55e3564abfa0 2024-09-10T20:56:02.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.994+0000 7ffad8026740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55e3565000d0 con 0x55e3564edc50 2024-09-10T20:56:02.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.994+0000 7ffad8026740 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x55e3564c3270 con 0x55e3564f08b0 2024-09-10T20:56:02.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.994+0000 7ffad8026740 10 client.0 _ll_register_callbacks cb 0x7ffac0062460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:56:02.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.994+0000 7ffacde00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3564abfa0 0x55e356568070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:02.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.994+0000 7ffacde00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3564abfa0 0x55e356568070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56350/0 (socket says 172.21.15.6:56350) 2024-09-10T20:56:02.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.994+0000 7ffacde00640 1 -- 172.21.15.6:0/3572761921 learned_addr learned my addr 172.21.15.6:0/3572761921 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:02.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.994+0000 7ffac5400640 1 --2- 172.21.15.6:0/3572761921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e3564edc50 0x55e3564e85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:02.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.994+0000 7fface800640 1 --2- 172.21.15.6:0/3572761921 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e3564f08b0 0x55e3564e8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:02.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.994+0000 7ffacde00640 1 -- 172.21.15.6:0/3572761921 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e3564f08b0 msgr2=0x55e3564e8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:02.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.994+0000 7ffacde00640 1 --2- 172.21.15.6:0/3572761921 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e3564f08b0 0x55e3564e8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:02.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.994+0000 7ffacde00640 1 -- 172.21.15.6:0/3572761921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e3564edc50 msgr2=0x55e3564e85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:02.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.994+0000 7ffacde00640 1 --2- 172.21.15.6:0/3572761921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e3564edc50 0x55e3564e85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:02.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.994+0000 7ffacde00640 1 -- 172.21.15.6:0/3572761921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e356571740 con 0x55e3564abfa0 2024-09-10T20:56:02.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.994+0000 7ffac5400640 1 --2- 172.21.15.6:0/3572761921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e3564edc50 0x55e3564e85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:56:02.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.995+0000 7ffacde00640 1 --2- 172.21.15.6:0/3572761921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3564abfa0 0x55e356568070 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ffac000e990 tx=0x7ffac005e850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=769c76de5a0ff9ba server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:02.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.995+0000 7ffab3400640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-10T20:56:02.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.995+0000 7ffab3400640 1 -- 172.21.15.6:0/3572761921 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac0088040 con 0x55e3564abfa0 2024-09-10T20:56:02.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.995+0000 7ffab3400640 1 -- 172.21.15.6:0/3572761921 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ffac0062160 con 0x55e3564abfa0 2024-09-10T20:56:02.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.995+0000 7ffad8026740 1 -- 172.21.15.6:0/3572761921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffac8016450 con 0x55e3564abfa0 2024-09-10T20:56:02.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.995+0000 7ffab3400640 1 -- 172.21.15.6:0/3572761921 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7ffac008d050 con 0x55e3564abfa0 2024-09-10T20:56:02.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.995+0000 7ffad8026740 10 client.4710 fetch_fsmap learned FSMap version 8 2024-09-10T20:56:02.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.995+0000 7ffad8026740 1 -- 172.21.15.6:0/3572761921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55e356512be0 con 0x55e3564abfa0 2024-09-10T20:56:02.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.995+0000 7ffab3400640 1 -- 172.21.15.6:0/3572761921 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffac8016450 con 0x55e3564abfa0 2024-09-10T20:56:02.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.995+0000 7ffab3400640 1 -- 172.21.15.6:0/3572761921 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7ffac0090020 con 0x55e3564abfa0 2024-09-10T20:56:02.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.995+0000 7ffad8026740 10 client.4710 fetch_fsmap finished waiting for FSMap version 8 2024-09-10T20:56:02.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.995+0000 7ffad8026740 10 client.4710 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T20:56:02.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.995+0000 7ffad8026740 20 client.4710 populate_metadata read hostname 'smithi006' 2024-09-10T20:56:02.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.995+0000 7ffad8026740 1 --2- 172.21.15.6:0/3572761921 >> [v2:172.21.15.6:6833/3230367141,v1:172.21.15.6:6835/3230367141] conn(0x55e3565757e0 0x55e3564e4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:02.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.995+0000 7ffad8026740 4 client.4710 mds_command: new command op to 4375 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T20:56:02.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.995+0000 7ffad8026740 1 -- 172.21.15.6:0/3572761921 --> [v2:172.21.15.6:6833/3230367141,v1:172.21.15.6:6835/3230367141] -- command(tid 0: {"prefix": "status"}) -- 0x55e35641bfd0 con 0x55e3565757e0 2024-09-10T20:56:02.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.996+0000 7ffac5400640 1 --2- 172.21.15.6:0/3572761921 >> [v2:172.21.15.6:6833/3230367141,v1:172.21.15.6:6835/3230367141] conn(0x55e3565757e0 0x55e3564e4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:02.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.996+0000 7ffac5400640 1 --2- 172.21.15.6:0/3572761921 >> [v2:172.21.15.6:6833/3230367141,v1:172.21.15.6:6835/3230367141] conn(0x55e3565757e0 0x55e3564e4db0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c81e21e7441b9ae server_cookie=134ddc82ec591c52 in_seq=0 out_seq=0 2024-09-10T20:56:02.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.996+0000 7ffab3400640 10 client.4710 ms_handle_connect on v2:172.21.15.6:6833/3230367141 2024-09-10T20:56:02.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.996+0000 7ffab3400640 1 -- 172.21.15.6:0/3572761921 <== mds.0 v2:172.21.15.6:6833/3230367141 1 ==== command_reply(tid 0: 0 ) ==== 8+0+318 (crc 0 0 0) 0x55e35641bfd0 con 0x55e3565757e0 2024-09-10T20:56:02.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.996+0000 7ffab3400640 10 client.4710 handle_command_reply: tid=0 2024-09-10T20:56:02.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.996+0000 7ffad8026740 1 client.4710 shutdown 2024-09-10T20:56:02.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.996+0000 7ffad8026740 1 -- 172.21.15.6:0/3572761921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3564abfa0 msgr2=0x55e356568070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:02.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.996+0000 7ffad8026740 1 --2- 172.21.15.6:0/3572761921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3564abfa0 0x55e356568070 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ffac000e990 tx=0x7ffac005e850 comp rx=0 tx=0).stop 2024-09-10T20:56:02.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.997+0000 7ffad8026740 1 -- 172.21.15.6:0/3572761921 shutdown_connections 2024-09-10T20:56:02.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.997+0000 7ffad8026740 1 --2- 172.21.15.6:0/3572761921 >> [v2:172.21.15.6:6833/3230367141,v1:172.21.15.6:6835/3230367141] conn(0x55e3565757e0 0x55e3564e4db0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:02.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.997+0000 7ffad8026740 1 --2- 172.21.15.6:0/3572761921 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e3564f08b0 0x55e3564e8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:02.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.997+0000 7ffad8026740 1 --2- 172.21.15.6:0/3572761921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e3564edc50 0x55e3564e85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:02.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.997+0000 7ffad8026740 1 --2- 172.21.15.6:0/3572761921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3564abfa0 0x55e356568070 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:02.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.997+0000 7ffab3400640 0 client.4710 ms_handle_reset on v2:172.21.15.6:6833/3230367141 2024-09-10T20:56:02.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.997+0000 7ffad8026740 1 -- 172.21.15.6:0/3572761921 >> 172.21.15.6:0/3572761921 conn(0x55e3564aba20 msgr2=0x55e3564e9570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:02.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.997+0000 7ffad8026740 1 -- 172.21.15.6:0/3572761921 shutdown_connections 2024-09-10T20:56:02.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.997+0000 7ffad8026740 1 -- 172.21.15.6:0/3572761921 wait complete. 2024-09-10T20:56:02.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.997+0000 7ffad8026740 20 client.4710 trim_cache size 0 max 16384 2024-09-10T20:56:02.005 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-10T20:56:02.006 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "9e04309e-61c3-4c78-82db-9576e465d98a", 2024-09-10T20:56:02.006 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2024-09-10T20:56:02.006 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 4375, 2024-09-10T20:56:02.006 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-09-10T20:56:02.006 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-09-10T20:56:02.006 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-09-10T20:56:02.006 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 17.651698645, 2024-09-10T20:56:02.006 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 8, 2024-09-10T20:56:02.006 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 22, 2024-09-10T20:56:02.006 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 22, 2024-09-10T20:56:02.006 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 23.682137506 2024-09-10T20:56:02.006 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-10T20:56:02.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.997+0000 7ffad5000640 1 -- 172.21.15.6:0/1663645488 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ffaac077f70 msgr2=0x7ffaac07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:02.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.997+0000 7ffad5000640 1 --2- 172.21.15.6:0/1663645488 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ffaac077f70 0x7ffaac07a430 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ffab8034000 tx=0x7ffab8004730 comp rx=0 tx=0).stop 2024-09-10T20:56:02.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.997+0000 7ffad5000640 1 -- 172.21.15.6:0/1663645488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffad006fd40 msgr2=0x7ffad0156d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:02.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.997+0000 7ffad5000640 1 --2- 172.21.15.6:0/1663645488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffad006fd40 0x7ffad0156d00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ffac000ea20 tx=0x7ffac000eee0 comp rx=0 tx=0).stop 2024-09-10T20:56:02.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.998+0000 7ffad5000640 1 -- 172.21.15.6:0/1663645488 shutdown_connections 2024-09-10T20:56:02.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.998+0000 7ffad5000640 1 --2- 172.21.15.6:0/1663645488 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ffaac077f70 0x7ffaac07a430 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:02.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.998+0000 7ffad5000640 1 --2- 172.21.15.6:0/1663645488 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffad015c170 0x7ffad01f3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:02.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.998+0000 7ffad5000640 1 --2- 172.21.15.6:0/1663645488 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffad0159670 0x7ffad014a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:02.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.998+0000 7ffad5000640 1 --2- 172.21.15.6:0/1663645488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffad006fd40 0x7ffad0156d00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:02.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.998+0000 7ffad5000640 1 -- 172.21.15.6:0/1663645488 >> 172.21.15.6:0/1663645488 conn(0x7ffad00cfa20 msgr2=0x7ffad0073f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:02.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.998+0000 7ffad5000640 1 -- 172.21.15.6:0/1663645488 shutdown_connections 2024-09-10T20:56:02.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:01.998+0000 7ffad5000640 1 -- 172.21.15.6:0/1663645488 wait complete. 2024-09-10T20:56:02.017 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-10T20:56:02.043 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-10T20:56:02.043 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-10T20:56:02.043 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-10T20:56:02.043 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T20:56:02.043 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T20:56:02.043 INFO:tasks.ceph_fuse:client.2 config is {} 2024-09-10T20:56:02.043 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T20:56:02.044 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-10T20:56:02.044 INFO:tasks.ceph_fuse:client.1 config is {} 2024-09-10T20:56:02.044 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T20:56:02.044 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T20:56:02.044 INFO:tasks.ceph_fuse:client.3 config is {} 2024-09-10T20:56:02.044 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T20:56:02.044 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-10T20:56:02.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:02.044 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-09-10T20:56:02.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:02.081 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link delete ceph-brx 2024-09-10T20:56:02.178 INFO:teuthology.orchestra.run.smithi006.stderr:Cannot find device "ceph-brx" 2024-09-10T20:56:02.181 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T20:56:02.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:02.182 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2024-09-10T20:56:02.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:02.222 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link delete ceph-brx 2024-09-10T20:56:02.326 INFO:teuthology.orchestra.run.smithi150.stderr:Cannot find device "ceph-brx" 2024-09-10T20:56:02.328 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T20:56:02.329 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-10T20:56:02.329 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-10T20:56:02.329 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T20:56:02.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.486+0000 7fd8ecc00640 1 -- 172.21.15.6:0/4043515937 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8e8161430 msgr2=0x7fd8e80cf800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:02.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.486+0000 7fd8ecc00640 1 --2- 172.21.15.6:0/4043515937 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8e8161430 0x7fd8e80cf800 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8009830 tx=0x7fd8d802a530 comp rx=0 tx=0).stop 2024-09-10T20:56:02.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.487+0000 7fd8ecc00640 1 -- 172.21.15.6:0/4043515937 shutdown_connections 2024-09-10T20:56:02.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.487+0000 7fd8ecc00640 1 --2- 172.21.15.6:0/4043515937 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8e8161430 0x7fd8e80cf800 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:02.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.487+0000 7fd8ecc00640 1 -- 172.21.15.6:0/4043515937 >> 172.21.15.6:0/4043515937 conn(0x7fd8e809aa00 msgr2=0x7fd8e809ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:02.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.487+0000 7fd8ecc00640 1 -- 172.21.15.6:0/4043515937 shutdown_connections 2024-09-10T20:56:02.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.487+0000 7fd8ecc00640 1 -- 172.21.15.6:0/4043515937 wait complete. 2024-09-10T20:56:02.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.488+0000 7fd8ecc00640 1 Processor -- start 2024-09-10T20:56:02.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.488+0000 7fd8ecc00640 1 -- start start 2024-09-10T20:56:02.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.489+0000 7fd8ecc00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8e806e0a0 0x7fd8e814ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:02.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.489+0000 7fd8ecc00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8e80b0e00 0x7fd8e81f8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:02.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.489+0000 7fd8ecc00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8e8161430 0x7fd8e815c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:02.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.489+0000 7fd8ecc00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e80d1e50 con 0x7fd8e8161430 2024-09-10T20:56:02.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.489+0000 7fd8ecc00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e80d1cd0 con 0x7fd8e80b0e00 2024-09-10T20:56:02.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.489+0000 7fd8ecc00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd8e80d1fd0 con 0x7fd8e806e0a0 2024-09-10T20:56:02.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.490+0000 7fd8e7e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8e8161430 0x7fd8e815c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:02.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.490+0000 7fd8e7e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8e8161430 0x7fd8e815c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56360/0 (socket says 172.21.15.6:56360) 2024-09-10T20:56:02.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.490+0000 7fd8dea00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8e80b0e00 0x7fd8e81f8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:02.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.490+0000 7fd8e7e00640 1 -- 172.21.15.6:0/2289170614 learned_addr learned my addr 172.21.15.6:0/2289170614 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:02.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.490+0000 7fd8e7400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8e806e0a0 0x7fd8e814ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:02.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.490+0000 7fd8e7e00640 1 -- 172.21.15.6:0/2289170614 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8e806e0a0 msgr2=0x7fd8e814ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:02.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.490+0000 7fd8e7e00640 1 --2- 172.21.15.6:0/2289170614 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8e806e0a0 0x7fd8e814ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:02.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.490+0000 7fd8e7e00640 1 -- 172.21.15.6:0/2289170614 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8e80b0e00 msgr2=0x7fd8e81f8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:02.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.490+0000 7fd8e7e00640 1 --2- 172.21.15.6:0/2289170614 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8e80b0e00 0x7fd8e81f8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:02.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.490+0000 7fd8e7e00640 1 -- 172.21.15.6:0/2289170614 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8e81f8aa0 con 0x7fd8e8161430 2024-09-10T20:56:02.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.491+0000 7fd8e7e00640 1 --2- 172.21.15.6:0/2289170614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8e8161430 0x7fd8e815c240 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd8e000c7a0 tx=0x7fd8e000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:02.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.491+0000 7fd8dfe00640 1 -- 172.21.15.6:0/2289170614 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e0003b70 con 0x7fd8e8161430 2024-09-10T20:56:02.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.491+0000 7fd8dfe00640 1 -- 172.21.15.6:0/2289170614 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd8e0003d30 con 0x7fd8e8161430 2024-09-10T20:56:02.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.491+0000 7fd8dfe00640 1 -- 172.21.15.6:0/2289170614 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e000aab0 con 0x7fd8e8161430 2024-09-10T20:56:02.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.491+0000 7fd8ecc00640 1 -- 172.21.15.6:0/2289170614 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8e81f52b0 con 0x7fd8e8161430 2024-09-10T20:56:02.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.491+0000 7fd8ecc00640 1 -- 172.21.15.6:0/2289170614 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8e80b5ec0 con 0x7fd8e8161430 2024-09-10T20:56:02.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.492+0000 7fd8ecc00640 1 -- 172.21.15.6:0/2289170614 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8e80cf800 con 0x7fd8e8161430 2024-09-10T20:56:02.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.493+0000 7fd8dfe00640 1 -- 172.21.15.6:0/2289170614 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd8e000ac50 con 0x7fd8e8161430 2024-09-10T20:56:02.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.494+0000 7fd8dfe00640 1 --2- 172.21.15.6:0/2289170614 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd8c4077f70 0x7fd8c407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:02.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.494+0000 7fd8dfe00640 1 -- 172.21.15.6:0/2289170614 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd8e0099a10 con 0x7fd8e8161430 2024-09-10T20:56:02.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.495+0000 7fd8e7400640 1 --2- 172.21.15.6:0/2289170614 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd8c4077f70 0x7fd8c407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:02.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.495+0000 7fd8e7400640 1 --2- 172.21.15.6:0/2289170614 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd8c4077f70 0x7fd8c407a430 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8034000 tx=0x7fd8d8004730 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:02.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.498+0000 7fd8dfe00640 1 -- 172.21.15.6:0/2289170614 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fd8e0061eb0 con 0x7fd8e8161430 2024-09-10T20:56:02.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.730+0000 7fd8ecc00640 1 -- 172.21.15.6:0/2289170614 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd8e8069d10 con 0x7fd8e8161430 2024-09-10T20:56:02.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.731+0000 7fd8dfe00640 1 -- 172.21.15.6:0/2289170614 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7fd8e00668e0 con 0x7fd8e8161430 2024-09-10T20:56:02.849 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T20:56:02.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.733+0000 7fd8ecc00640 1 -- 172.21.15.6:0/2289170614 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd8c4077f70 msgr2=0x7fd8c407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:02.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.733+0000 7fd8ecc00640 1 --2- 172.21.15.6:0/2289170614 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd8c4077f70 0x7fd8c407a430 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8034000 tx=0x7fd8d8004730 comp rx=0 tx=0).stop 2024-09-10T20:56:02.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.733+0000 7fd8ecc00640 1 -- 172.21.15.6:0/2289170614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8e8161430 msgr2=0x7fd8e815c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:02.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.733+0000 7fd8ecc00640 1 --2- 172.21.15.6:0/2289170614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8e8161430 0x7fd8e815c240 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd8e000c7a0 tx=0x7fd8e000cc60 comp rx=0 tx=0).stop 2024-09-10T20:56:02.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.733+0000 7fd8ecc00640 1 -- 172.21.15.6:0/2289170614 shutdown_connections 2024-09-10T20:56:02.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.733+0000 7fd8ecc00640 1 --2- 172.21.15.6:0/2289170614 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd8c4077f70 0x7fd8c407a430 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:02.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.733+0000 7fd8ecc00640 1 --2- 172.21.15.6:0/2289170614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8e8161430 0x7fd8e815c240 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:02.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.733+0000 7fd8ecc00640 1 --2- 172.21.15.6:0/2289170614 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8e80b0e00 0x7fd8e81f8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:02.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.733+0000 7fd8ecc00640 1 --2- 172.21.15.6:0/2289170614 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8e806e0a0 0x7fd8e814ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:02.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.733+0000 7fd8ecc00640 1 -- 172.21.15.6:0/2289170614 >> 172.21.15.6:0/2289170614 conn(0x7fd8e809aa00 msgr2=0x7fd8e80b2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:02.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.733+0000 7fd8ecc00640 1 -- 172.21.15.6:0/2289170614 shutdown_connections 2024-09-10T20:56:02.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:02.733+0000 7fd8ecc00640 1 -- 172.21.15.6:0/2289170614 wait complete. 2024-09-10T20:56:02.852 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T20:56:02.852 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T20:56:02.852 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2024-09-10T20:56:02.852 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T20:56:02.852 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T20:56:02.852 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T20:56:02.852 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T20:56:02.852 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T20:56:02.853 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T20:56:02.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:02.853 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2024-09-10T20:56:02.888 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T20:56:02.888 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T20:56:02.888 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T20:56:02.888 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:56:02.888 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2024-09-10T20:56:02.889 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:56:02.889 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T20:56:02.889 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:56:02.889 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2024-09-10T20:56:02.889 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T20:56:02.889 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:56:02.889 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2024-09-10T20:56:02.889 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T20:56:02.889 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:56:02.889 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2024-09-10T20:56:02.889 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-10T20:56:02.889 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42662sec preferred_lft 42662sec 2024-09-10T20:56:02.889 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2024-09-10T20:56:02.889 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:56:02.890 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T20:56:02.890 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:56:02.890 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2024-09-10T20:56:02.890 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T20:56:02.890 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:56:02.890 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-09-10T20:56:02.890 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add name ceph-brx type bridge 2024-09-10T20:56:02.890 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip addr flush dev ceph-brx 2024-09-10T20:56:02.890 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set ceph-brx up 2024-09-10T20:56:02.891 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T20:56:02.891 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-09-10T20:56:03.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:56:03.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:56:03.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:03.325 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T20:56:03.381 INFO:teuthology.orchestra.run.smithi006.stdout:1 2024-09-10T20:56:03.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:03.385 DEBUG:teuthology.orchestra.run.smithi006:> route 2024-09-10T20:56:03.431 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2024-09-10T20:56:03.431 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T20:56:03.431 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-10T20:56:03.431 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-10T20:56:03.431 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T20:56:03.432 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:56:03.432 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-09-10T20:56:03.432 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T20:56:03.432 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T20:56:03.432 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T20:56:03.432 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-09-10T20:56:03.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:56:04.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:56:04.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:04.044 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-09-10T20:56:04.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:04.080 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list-id 2024-09-10T20:56:04.154 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:56:04.154 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-09-10T20:56:04.155 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T20:56:04.155 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-10T20:56:04.155 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-09-10T20:56:04.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:56:04.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:56:04.332 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-10T20:56:04.332 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:56:04.333 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-09-10T20:56:04.333 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-10T20:56:04.333 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T20:56:04.333 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-10T20:56:04.333 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-10T20:56:04.333 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-10T20:56:04.333 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-09-10T20:56:04.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:56:04.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:56:04.572 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:56:04.572 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-09-10T20:56:04.572 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2024-09-10T20:56:04.572 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T20:56:04.572 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-09-10T20:56:04.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:56:04.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:56:04.740 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-10T20:56:04.740 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T20:56:04.740 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T20:56:04.775 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T20:56:04.775 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T20:56:04.775 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T20:56:04.849 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2024-09-10T20:56:04.946 DEBUG:teuthology.orchestra.run.smithi006:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T20:56:04.982 INFO:teuthology.orchestra.run.smithi006.stdout:/proc 2024-09-10T20:56:04.982 INFO:teuthology.orchestra.run.smithi006.stdout:/sys 2024-09-10T20:56:04.983 INFO:teuthology.orchestra.run.smithi006.stdout:/dev 2024-09-10T20:56:04.983 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/security 2024-09-10T20:56:04.983 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/shm 2024-09-10T20:56:04.983 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/pts 2024-09-10T20:56:04.983 INFO:teuthology.orchestra.run.smithi006.stdout:/run 2024-09-10T20:56:04.983 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/cgroup 2024-09-10T20:56:04.983 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/pstore 2024-09-10T20:56:04.983 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/bpf 2024-09-10T20:56:04.983 INFO:teuthology.orchestra.run.smithi006.stdout:/ 2024-09-10T20:56:04.983 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/selinux 2024-09-10T20:56:04.983 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T20:56:04.983 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/mqueue 2024-09-10T20:56:04.983 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/hugepages 2024-09-10T20:56:04.983 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/debug 2024-09-10T20:56:04.983 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/tracing 2024-09-10T20:56:04.984 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/fuse/connections 2024-09-10T20:56:04.984 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/config 2024-09-10T20:56:04.984 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T20:56:04.984 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T20:56:04.984 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T20:56:04.984 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T20:56:04.984 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/1000 2024-09-10T20:56:04.984 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph 2024-09-10T20:56:04.984 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T20:56:04.984 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T20:56:04.984 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T20:56:04.984 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T20:56:04.984 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns 2024-09-10T20:56:04.985 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T20:56:04.985 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T20:56:04.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:04.986 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2024-09-10T20:56:05.060 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T20:56:05.060 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-10T20:56:05.105 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2024-09-10T20:56:05.160 DEBUG:teuthology.orchestra.run.smithi006:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T20:56:05.196 INFO:teuthology.orchestra.run.smithi006.stdout:/proc 2024-09-10T20:56:05.196 INFO:teuthology.orchestra.run.smithi006.stdout:/sys 2024-09-10T20:56:05.196 INFO:teuthology.orchestra.run.smithi006.stdout:/dev 2024-09-10T20:56:05.196 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/security 2024-09-10T20:56:05.196 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/shm 2024-09-10T20:56:05.196 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/pts 2024-09-10T20:56:05.196 INFO:teuthology.orchestra.run.smithi006.stdout:/run 2024-09-10T20:56:05.196 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/cgroup 2024-09-10T20:56:05.197 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/pstore 2024-09-10T20:56:05.197 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/bpf 2024-09-10T20:56:05.197 INFO:teuthology.orchestra.run.smithi006.stdout:/ 2024-09-10T20:56:05.197 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/selinux 2024-09-10T20:56:05.197 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T20:56:05.197 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/mqueue 2024-09-10T20:56:05.197 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/hugepages 2024-09-10T20:56:05.197 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/debug 2024-09-10T20:56:05.197 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/tracing 2024-09-10T20:56:05.197 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/fuse/connections 2024-09-10T20:56:05.197 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/config 2024-09-10T20:56:05.197 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T20:56:05.197 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T20:56:05.198 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T20:56:05.198 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T20:56:05.198 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/1000 2024-09-10T20:56:05.198 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph 2024-09-10T20:56:05.198 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T20:56:05.198 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T20:56:05.198 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T20:56:05.198 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T20:56:05.198 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns 2024-09-10T20:56:05.198 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T20:56:05.198 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T20:56:05.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:05.199 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2024-09-10T20:56:05.311 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:2024-09-10T20:56:05.307+0000 7f6e45e0a480 -1 init, newargv = 0x562ed245c190 newargc=15 2024-09-10T20:56:05.311 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[44356]: starting ceph client 2024-09-10T20:56:05.320 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[44356]: starting fuse 2024-09-10T20:56:06.376 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2024-09-10T20:56:06.440 DEBUG:teuthology.orchestra.run.smithi006:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T20:56:06.479 INFO:teuthology.orchestra.run.smithi006.stdout:/proc 2024-09-10T20:56:06.480 INFO:teuthology.orchestra.run.smithi006.stdout:/sys 2024-09-10T20:56:06.480 INFO:teuthology.orchestra.run.smithi006.stdout:/dev 2024-09-10T20:56:06.480 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/security 2024-09-10T20:56:06.480 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/shm 2024-09-10T20:56:06.480 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/pts 2024-09-10T20:56:06.480 INFO:teuthology.orchestra.run.smithi006.stdout:/run 2024-09-10T20:56:06.480 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/cgroup 2024-09-10T20:56:06.480 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/pstore 2024-09-10T20:56:06.480 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/bpf 2024-09-10T20:56:06.480 INFO:teuthology.orchestra.run.smithi006.stdout:/ 2024-09-10T20:56:06.480 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/selinux 2024-09-10T20:56:06.480 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T20:56:06.481 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/mqueue 2024-09-10T20:56:06.481 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/hugepages 2024-09-10T20:56:06.481 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/debug 2024-09-10T20:56:06.481 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/tracing 2024-09-10T20:56:06.481 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/fuse/connections 2024-09-10T20:56:06.481 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/config 2024-09-10T20:56:06.481 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T20:56:06.481 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T20:56:06.481 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T20:56:06.481 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T20:56:06.481 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/1000 2024-09-10T20:56:06.481 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph 2024-09-10T20:56:06.481 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T20:56:06.481 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T20:56:06.482 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T20:56:06.482 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T20:56:06.482 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns 2024-09-10T20:56:06.482 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T20:56:06.482 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T20:56:06.482 INFO:teuthology.orchestra.run.smithi006.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-10T20:56:06.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:06.483 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2024-09-10T20:56:06.559 INFO:teuthology.orchestra.run.smithi006.stdout:43 2024-09-10T20:56:06.559 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-09-10T20:56:06.559 DEBUG:teuthology.orchestra.run.smithi006:> sudo stdin-killer -- python3 -c ' 2024-09-10T20:56:06.559 DEBUG:teuthology.orchestra.run.smithi006:> import glob 2024-09-10T20:56:06.559 DEBUG:teuthology.orchestra.run.smithi006:> import re 2024-09-10T20:56:06.560 DEBUG:teuthology.orchestra.run.smithi006:> import os 2024-09-10T20:56:06.560 DEBUG:teuthology.orchestra.run.smithi006:> import subprocess 2024-09-10T20:56:06.560 DEBUG:teuthology.orchestra.run.smithi006:> 2024-09-10T20:56:06.560 DEBUG:teuthology.orchestra.run.smithi006:> def _find_admin_socket(client_name): 2024-09-10T20:56:06.560 DEBUG:teuthology.orchestra.run.smithi006:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-10T20:56:06.560 DEBUG:teuthology.orchestra.run.smithi006:> files = glob.glob(asok_path) 2024-09-10T20:56:06.560 DEBUG:teuthology.orchestra.run.smithi006:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-10T20:56:06.560 DEBUG:teuthology.orchestra.run.smithi006:> 2024-09-10T20:56:06.560 DEBUG:teuthology.orchestra.run.smithi006:> # Given a non-glob path, it better be there 2024-09-10T20:56:06.560 DEBUG:teuthology.orchestra.run.smithi006:> if "*" not in asok_path: 2024-09-10T20:56:06.560 DEBUG:teuthology.orchestra.run.smithi006:> assert(len(files) == 1) 2024-09-10T20:56:06.560 DEBUG:teuthology.orchestra.run.smithi006:> return files[0] 2024-09-10T20:56:06.560 DEBUG:teuthology.orchestra.run.smithi006:> 2024-09-10T20:56:06.560 DEBUG:teuthology.orchestra.run.smithi006:> for f in files: 2024-09-10T20:56:06.561 DEBUG:teuthology.orchestra.run.smithi006:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T20:56:06.561 DEBUG:teuthology.orchestra.run.smithi006:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T20:56:06.561 DEBUG:teuthology.orchestra.run.smithi006:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T20:56:06.561 DEBUG:teuthology.orchestra.run.smithi006:> contents = proc_f.read() 2024-09-10T20:56:06.561 DEBUG:teuthology.orchestra.run.smithi006:> if mountpoint in contents: 2024-09-10T20:56:06.561 DEBUG:teuthology.orchestra.run.smithi006:> return f 2024-09-10T20:56:06.561 DEBUG:teuthology.orchestra.run.smithi006:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T20:56:06.561 DEBUG:teuthology.orchestra.run.smithi006:> 2024-09-10T20:56:06.561 DEBUG:teuthology.orchestra.run.smithi006:> print(_find_admin_socket("client.0")) 2024-09-10T20:56:06.561 DEBUG:teuthology.orchestra.run.smithi006:> ' 2024-09-10T20:56:06.726 INFO:teuthology.orchestra.run.smithi006.stdout:/var/run/ceph/ceph-client.0.44356.asok 2024-09-10T20:56:06.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:56:06.740 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.44356.asok 2024-09-10T20:56:06.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:06.741 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.44356.asok status 2024-09-10T20:56:06.925 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-10T20:56:06.926 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": { 2024-09-10T20:56:06.926 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T20:56:06.926 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T20:56:06.926 INFO:teuthology.orchestra.run.smithi006.stdout: "entity_id": "0", 2024-09-10T20:56:06.926 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": "smithi006", 2024-09-10T20:56:06.926 INFO:teuthology.orchestra.run.smithi006.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-10T20:56:06.926 INFO:teuthology.orchestra.run.smithi006.stdout: "pid": "44356", 2024-09-10T20:56:06.926 INFO:teuthology.orchestra.run.smithi006.stdout: "root": "/" 2024-09-10T20:56:06.926 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-10T20:56:06.926 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_count": 0, 2024-09-10T20:56:06.926 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_pinned_count": 0, 2024-09-10T20:56:06.926 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 4523, 2024-09-10T20:56:06.927 INFO:teuthology.orchestra.run.smithi006.stdout: "inst": { 2024-09-10T20:56:06.927 INFO:teuthology.orchestra.run.smithi006.stdout: "name": { 2024-09-10T20:56:06.927 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2024-09-10T20:56:06.927 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 4523 2024-09-10T20:56:06.927 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-10T20:56:06.927 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2024-09-10T20:56:06.927 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-10T20:56:06.927 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2024-09-10T20:56:06.927 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2253049904 2024-09-10T20:56:06.927 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-10T20:56:06.927 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-10T20:56:06.927 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2024-09-10T20:56:06.927 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-10T20:56:06.928 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2024-09-10T20:56:06.928 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2253049904 2024-09-10T20:56:06.928 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-10T20:56:06.928 INFO:teuthology.orchestra.run.smithi006.stdout: "inst_str": "client.4523 192.168.0.1:0/2253049904", 2024-09-10T20:56:06.928 INFO:teuthology.orchestra.run.smithi006.stdout: "addr_str": "192.168.0.1:0/2253049904", 2024-09-10T20:56:06.928 INFO:teuthology.orchestra.run.smithi006.stdout: "inode_count": 1, 2024-09-10T20:56:06.928 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_epoch": 8, 2024-09-10T20:56:06.928 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch": 22, 2024-09-10T20:56:06.928 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch_barrier": 0, 2024-09-10T20:56:06.928 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklisted": false, 2024-09-10T20:56:06.928 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs" 2024-09-10T20:56:06.928 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-10T20:56:06.937 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-10T20:56:06.937 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T20:56:07.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.093+0000 7f6346200640 1 -- 172.21.15.6:0/547372460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63400cf380 msgr2=0x7f63400d2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:07.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.093+0000 7f6346200640 1 --2- 172.21.15.6:0/547372460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63400cf380 0x7f63400d2520 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f634008e0b0 tx=0x7f632c02a5f0 comp rx=0 tx=0).stop 2024-09-10T20:56:07.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.094+0000 7f6346200640 1 -- 172.21.15.6:0/547372460 shutdown_connections 2024-09-10T20:56:07.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.094+0000 7f6346200640 1 --2- 172.21.15.6:0/547372460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63400cf380 0x7f63400d2520 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:07.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.094+0000 7f6346200640 1 --2- 172.21.15.6:0/547372460 >> v2:172.21.15.150:3300/0 conn(0x7f634015dc90 0x7f63400d46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:07.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.094+0000 7f6346200640 1 -- 172.21.15.6:0/547372460 >> 172.21.15.6:0/547372460 conn(0x7f634009d0a0 msgr2=0x7f63400d3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:07.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.094+0000 7f6346200640 1 -- 172.21.15.6:0/547372460 shutdown_connections 2024-09-10T20:56:07.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.094+0000 7f6346200640 1 -- 172.21.15.6:0/547372460 wait complete. 2024-09-10T20:56:07.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.095+0000 7f6346200640 1 Processor -- start 2024-09-10T20:56:07.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.095+0000 7f6346200640 1 -- start start 2024-09-10T20:56:07.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.096+0000 7f6346200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63400cf380 0x7f63400cd950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:07.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.096+0000 7f6346200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63400d2a60 0x7f634014e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:07.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.096+0000 7f6346200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f634015dc90 0x7f63400c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:07.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.096+0000 7f6346200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f634015e270 con 0x7f634015dc90 2024-09-10T20:56:07.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.096+0000 7f6346200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6340162250 con 0x7f63400cf380 2024-09-10T20:56:07.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.096+0000 7f6346200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f63400b3350 con 0x7f63400d2a60 2024-09-10T20:56:07.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.097+0000 7f6345800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f634015dc90 0x7f63400c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:07.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.097+0000 7f6344e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63400cf380 0x7f63400cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:07.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.097+0000 7f6345800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f634015dc90 0x7f63400c9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56380/0 (socket says 172.21.15.6:56380) 2024-09-10T20:56:07.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.097+0000 7f6345800640 1 -- 172.21.15.6:0/3098678708 learned_addr learned my addr 172.21.15.6:0/3098678708 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:07.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.097+0000 7f633fe00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63400d2a60 0x7f634014e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:07.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.097+0000 7f6345800640 1 -- 172.21.15.6:0/3098678708 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63400d2a60 msgr2=0x7f634014e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:07.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.097+0000 7f6345800640 1 --2- 172.21.15.6:0/3098678708 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63400d2a60 0x7f634014e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:07.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.097+0000 7f6345800640 1 -- 172.21.15.6:0/3098678708 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63400cf380 msgr2=0x7f63400cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:07.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.097+0000 7f6345800640 1 --2- 172.21.15.6:0/3098678708 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63400cf380 0x7f63400cd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:07.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.097+0000 7f6345800640 1 -- 172.21.15.6:0/3098678708 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63400c8320 con 0x7f634015dc90 2024-09-10T20:56:07.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.097+0000 7f6344e00640 1 --2- 172.21.15.6:0/3098678708 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63400cf380 0x7f63400cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:56:07.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.098+0000 7f6345800640 1 --2- 172.21.15.6:0/3098678708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f634015dc90 0x7f63400c9ce0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f633800c7d0 tx=0x7f633800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:07.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.098+0000 7f633cc00640 1 -- 172.21.15.6:0/3098678708 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6338003b70 con 0x7f634015dc90 2024-09-10T20:56:07.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.098+0000 7f633cc00640 1 -- 172.21.15.6:0/3098678708 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6338003d10 con 0x7f634015dc90 2024-09-10T20:56:07.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.098+0000 7f633cc00640 1 -- 172.21.15.6:0/3098678708 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633800aab0 con 0x7f634015dc90 2024-09-10T20:56:07.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.098+0000 7f6346200640 1 -- 172.21.15.6:0/3098678708 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63400c85c0 con 0x7f634015dc90 2024-09-10T20:56:07.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.098+0000 7f6346200640 1 -- 172.21.15.6:0/3098678708 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63400c7b30 con 0x7f634015dc90 2024-09-10T20:56:07.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.099+0000 7f6346200640 1 -- 172.21.15.6:0/3098678708 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63400d2520 con 0x7f634015dc90 2024-09-10T20:56:07.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.100+0000 7f633cc00640 1 -- 172.21.15.6:0/3098678708 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f633800ac50 con 0x7f634015dc90 2024-09-10T20:56:07.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.101+0000 7f633cc00640 1 --2- 172.21.15.6:0/3098678708 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6320077fa0 0x7f632007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:07.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.101+0000 7f633cc00640 1 -- 172.21.15.6:0/3098678708 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f6338099a80 con 0x7f634015dc90 2024-09-10T20:56:07.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.102+0000 7f6344e00640 1 --2- 172.21.15.6:0/3098678708 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6320077fa0 0x7f632007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:07.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.102+0000 7f6344e00640 1 --2- 172.21.15.6:0/3098678708 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6320077fa0 0x7f632007a460 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f63400cb6e0 tx=0x7f6334005f90 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:07.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.106+0000 7f633cc00640 1 -- 172.21.15.6:0/3098678708 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f633809be20 con 0x7f634015dc90 2024-09-10T20:56:07.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.334+0000 7f6346200640 1 -- 172.21.15.6:0/3098678708 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6340069d10 con 0x7f634015dc90 2024-09-10T20:56:07.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.335+0000 7f633cc00640 1 -- 172.21.15.6:0/3098678708 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f6338061e90 con 0x7f634015dc90 2024-09-10T20:56:07.339 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T20:56:07.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.337+0000 7f6346200640 1 -- 172.21.15.6:0/3098678708 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6320077fa0 msgr2=0x7f632007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:07.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.337+0000 7f6346200640 1 --2- 172.21.15.6:0/3098678708 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6320077fa0 0x7f632007a460 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f63400cb6e0 tx=0x7f6334005f90 comp rx=0 tx=0).stop 2024-09-10T20:56:07.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.337+0000 7f6346200640 1 -- 172.21.15.6:0/3098678708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f634015dc90 msgr2=0x7f63400c9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:07.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.337+0000 7f6346200640 1 --2- 172.21.15.6:0/3098678708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f634015dc90 0x7f63400c9ce0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f633800c7d0 tx=0x7f633800cc90 comp rx=0 tx=0).stop 2024-09-10T20:56:07.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.337+0000 7f6346200640 1 -- 172.21.15.6:0/3098678708 shutdown_connections 2024-09-10T20:56:07.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.337+0000 7f6346200640 1 --2- 172.21.15.6:0/3098678708 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6320077fa0 0x7f632007a460 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:07.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.337+0000 7f6346200640 1 --2- 172.21.15.6:0/3098678708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f634015dc90 0x7f63400c9ce0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:07.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.337+0000 7f6346200640 1 --2- 172.21.15.6:0/3098678708 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63400d2a60 0x7f634014e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:07.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.337+0000 7f6346200640 1 --2- 172.21.15.6:0/3098678708 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63400cf380 0x7f63400cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:07.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.337+0000 7f6346200640 1 -- 172.21.15.6:0/3098678708 >> 172.21.15.6:0/3098678708 conn(0x7f634009d0a0 msgr2=0x7f63400b0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:07.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.337+0000 7f6346200640 1 -- 172.21.15.6:0/3098678708 shutdown_connections 2024-09-10T20:56:07.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07.337+0000 7f6346200640 1 -- 172.21.15.6:0/3098678708 wait complete. 2024-09-10T20:56:07.356 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T20:56:07.356 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T20:56:07.356 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2024-09-10T20:56:07.356 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-10T20:56:07.356 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-10T20:56:07.356 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T20:56:07.356 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T20:56:07.357 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T20:56:07.357 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-10T20:56:07.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:07.357 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2024-09-10T20:56:07.394 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T20:56:07.394 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T20:56:07.394 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T20:56:07.394 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:56:07.394 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2024-09-10T20:56:07.394 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:56:07.394 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T20:56:07.394 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:56:07.395 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2024-09-10T20:56:07.395 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T20:56:07.395 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:56:07.395 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2024-09-10T20:56:07.395 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T20:56:07.395 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:56:07.395 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2024-09-10T20:56:07.395 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-10T20:56:07.395 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42658sec preferred_lft 42658sec 2024-09-10T20:56:07.395 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2024-09-10T20:56:07.395 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:56:07.395 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T20:56:07.395 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:56:07.395 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2024-09-10T20:56:07.396 INFO:teuthology.orchestra.run.smithi006.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T20:56:07.396 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 42:19:f6:0f:32:a7 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:56:07.396 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T20:56:07.396 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:56:07.396 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::4c7f:9eff:fe7f:c27e/64 scope link 2024-09-10T20:56:07.396 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:56:07.396 INFO:teuthology.orchestra.run.smithi006.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T20:56:07.396 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 42:19:f6:0f:32:a7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T20:56:07.396 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::4019:f6ff:fe0f:32a7/64 scope link 2024-09-10T20:56:07.396 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:56:07.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:07.397 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T20:56:07.489 INFO:teuthology.orchestra.run.smithi006.stdout:1 2024-09-10T20:56:07.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:07.492 DEBUG:teuthology.orchestra.run.smithi006:> route 2024-09-10T20:56:07.528 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2024-09-10T20:56:07.529 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T20:56:07.529 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-10T20:56:07.529 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-10T20:56:07.529 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T20:56:07.529 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:56:07.529 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-09-10T20:56:07.529 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T20:56:07.529 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T20:56:07.529 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T20:56:07.529 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-09-10T20:56:07.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:56:07.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:56:07.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:07.725 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-09-10T20:56:07.760 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T20:56:07.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:07.761 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list-id 2024-09-10T20:56:07.835 INFO:teuthology.orchestra.run.smithi006.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-10T20:56:07.836 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:56:07.836 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-09-10T20:56:07.836 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T20:56:07.836 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-10T20:56:07.836 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-09-10T20:56:07.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:56:08.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:56:08.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:08.013 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-10T20:56:08.068 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T20:56:08.068 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T20:56:08.068 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T20:56:08.069 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:56:08.069 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2024-09-10T20:56:08.069 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:56:08.069 INFO:teuthology.orchestra.run.smithi006.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T20:56:08.069 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether c6:5b:4b:19:5b:ba brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-10T20:56:08.069 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-10T20:56:08.069 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:56:08.069 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::c45b:4bff:fe19:5bba/64 scope link 2024-09-10T20:56:08.069 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:56:08.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:08.071 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-10T20:56:08.127 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T20:56:08.127 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T20:56:08.127 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T20:56:08.128 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:56:08.128 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2024-09-10T20:56:08.128 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:56:08.128 INFO:teuthology.orchestra.run.smithi006.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T20:56:08.128 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether c6:5b:4b:19:5b:ba brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-10T20:56:08.129 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-10T20:56:08.129 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:56:08.129 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::c45b:4bff:fe19:5bba/64 scope link 2024-09-10T20:56:08.129 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:56:08.131 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-10T20:56:08.131 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:56:08.131 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-09-10T20:56:08.132 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-10T20:56:08.132 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-10T20:56:08.132 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-10T20:56:08.132 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-10T20:56:08.132 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-10T20:56:08.132 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-09-10T20:56:08.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:56:08.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:56:08.354 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:56:08.354 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-09-10T20:56:08.354 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.1 up 2024-09-10T20:56:08.354 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set dev brx.1 master ceph-brx 2024-09-10T20:56:08.354 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-09-10T20:56:08.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:56:08.466 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T20:56:08.470 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T20:56:08.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:56:08.528 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-09-10T20:56:08.528 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T20:56:08.528 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-10T20:56:08.564 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-10T20:56:08.564 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T20:56:08.564 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-10T20:56:08.639 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2024-09-10T20:56:08.737 DEBUG:teuthology.orchestra.run.smithi006:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T20:56:08.774 INFO:teuthology.orchestra.run.smithi006.stdout:/proc 2024-09-10T20:56:08.774 INFO:teuthology.orchestra.run.smithi006.stdout:/sys 2024-09-10T20:56:08.774 INFO:teuthology.orchestra.run.smithi006.stdout:/dev 2024-09-10T20:56:08.774 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/security 2024-09-10T20:56:08.774 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/shm 2024-09-10T20:56:08.774 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/pts 2024-09-10T20:56:08.774 INFO:teuthology.orchestra.run.smithi006.stdout:/run 2024-09-10T20:56:08.774 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/cgroup 2024-09-10T20:56:08.774 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/pstore 2024-09-10T20:56:08.775 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/bpf 2024-09-10T20:56:08.775 INFO:teuthology.orchestra.run.smithi006.stdout:/ 2024-09-10T20:56:08.775 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/selinux 2024-09-10T20:56:08.775 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T20:56:08.775 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/mqueue 2024-09-10T20:56:08.775 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/hugepages 2024-09-10T20:56:08.775 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/debug 2024-09-10T20:56:08.775 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/tracing 2024-09-10T20:56:08.775 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/fuse/connections 2024-09-10T20:56:08.775 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/config 2024-09-10T20:56:08.775 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T20:56:08.775 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T20:56:08.775 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T20:56:08.775 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T20:56:08.776 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/1000 2024-09-10T20:56:08.776 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph 2024-09-10T20:56:08.776 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T20:56:08.776 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T20:56:08.776 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T20:56:08.776 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T20:56:08.776 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns 2024-09-10T20:56:08.776 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T20:56:08.776 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T20:56:08.776 INFO:teuthology.orchestra.run.smithi006.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-10T20:56:08.776 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T20:56:08.776 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T20:56:08.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:08.777 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2024-09-10T20:56:08.853 INFO:teuthology.orchestra.run.smithi006.stdout:43 2024-09-10T20:56:08.853 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2024-09-10T20:56:08.853 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-09-10T20:56:08.898 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2024-09-10T20:56:08.956 DEBUG:teuthology.orchestra.run.smithi006:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T20:56:08.995 INFO:teuthology.orchestra.run.smithi006.stdout:/proc 2024-09-10T20:56:08.995 INFO:teuthology.orchestra.run.smithi006.stdout:/sys 2024-09-10T20:56:08.995 INFO:teuthology.orchestra.run.smithi006.stdout:/dev 2024-09-10T20:56:08.995 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/security 2024-09-10T20:56:08.995 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/shm 2024-09-10T20:56:08.995 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/pts 2024-09-10T20:56:08.995 INFO:teuthology.orchestra.run.smithi006.stdout:/run 2024-09-10T20:56:08.995 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/cgroup 2024-09-10T20:56:08.995 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/pstore 2024-09-10T20:56:08.995 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/bpf 2024-09-10T20:56:08.996 INFO:teuthology.orchestra.run.smithi006.stdout:/ 2024-09-10T20:56:08.996 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/selinux 2024-09-10T20:56:08.996 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T20:56:08.996 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/mqueue 2024-09-10T20:56:08.996 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/hugepages 2024-09-10T20:56:08.996 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/debug 2024-09-10T20:56:08.996 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/tracing 2024-09-10T20:56:08.996 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/fuse/connections 2024-09-10T20:56:08.996 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/config 2024-09-10T20:56:08.996 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T20:56:08.996 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T20:56:08.996 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T20:56:08.996 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T20:56:08.997 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/1000 2024-09-10T20:56:08.997 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph 2024-09-10T20:56:08.997 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T20:56:08.997 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T20:56:08.997 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T20:56:08.997 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T20:56:08.997 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns 2024-09-10T20:56:08.997 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T20:56:08.997 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T20:56:08.997 INFO:teuthology.orchestra.run.smithi006.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-10T20:56:08.997 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T20:56:08.997 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T20:56:08.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:08.998 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2024-09-10T20:56:09.048 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi006.stderr:2024-09-10T20:56:09.044+0000 7fe9ee836480 -1 init, newargv = 0x5635ba3455a0 newargc=15 2024-09-10T20:56:09.049 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi006.stderr:ceph-fuse[44917]: starting ceph client 2024-09-10T20:56:09.058 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi006.stderr:ceph-fuse[44917]: starting fuse 2024-09-10T20:56:09.080 INFO:teuthology.orchestra.run.smithi006.stdout:43 2024-09-10T20:56:09.080 INFO:teuthology.orchestra.run.smithi006.stdout:44 2024-09-10T20:56:09.080 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2024-09-10T20:56:09.080 DEBUG:teuthology.orchestra.run.smithi006:> sudo stdin-killer -- python3 -c ' 2024-09-10T20:56:09.080 DEBUG:teuthology.orchestra.run.smithi006:> import glob 2024-09-10T20:56:09.080 DEBUG:teuthology.orchestra.run.smithi006:> import re 2024-09-10T20:56:09.081 DEBUG:teuthology.orchestra.run.smithi006:> import os 2024-09-10T20:56:09.081 DEBUG:teuthology.orchestra.run.smithi006:> import subprocess 2024-09-10T20:56:09.081 DEBUG:teuthology.orchestra.run.smithi006:> 2024-09-10T20:56:09.081 DEBUG:teuthology.orchestra.run.smithi006:> def _find_admin_socket(client_name): 2024-09-10T20:56:09.081 DEBUG:teuthology.orchestra.run.smithi006:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-09-10T20:56:09.081 DEBUG:teuthology.orchestra.run.smithi006:> files = glob.glob(asok_path) 2024-09-10T20:56:09.081 DEBUG:teuthology.orchestra.run.smithi006:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-09-10T20:56:09.081 DEBUG:teuthology.orchestra.run.smithi006:> 2024-09-10T20:56:09.081 DEBUG:teuthology.orchestra.run.smithi006:> # Given a non-glob path, it better be there 2024-09-10T20:56:09.081 DEBUG:teuthology.orchestra.run.smithi006:> if "*" not in asok_path: 2024-09-10T20:56:09.082 DEBUG:teuthology.orchestra.run.smithi006:> assert(len(files) == 1) 2024-09-10T20:56:09.082 DEBUG:teuthology.orchestra.run.smithi006:> return files[0] 2024-09-10T20:56:09.082 DEBUG:teuthology.orchestra.run.smithi006:> 2024-09-10T20:56:09.082 DEBUG:teuthology.orchestra.run.smithi006:> for f in files: 2024-09-10T20:56:09.082 DEBUG:teuthology.orchestra.run.smithi006:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T20:56:09.082 DEBUG:teuthology.orchestra.run.smithi006:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T20:56:09.082 DEBUG:teuthology.orchestra.run.smithi006:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T20:56:09.082 DEBUG:teuthology.orchestra.run.smithi006:> contents = proc_f.read() 2024-09-10T20:56:09.082 DEBUG:teuthology.orchestra.run.smithi006:> if mountpoint in contents: 2024-09-10T20:56:09.082 DEBUG:teuthology.orchestra.run.smithi006:> return f 2024-09-10T20:56:09.082 DEBUG:teuthology.orchestra.run.smithi006:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T20:56:09.082 DEBUG:teuthology.orchestra.run.smithi006:> 2024-09-10T20:56:09.082 DEBUG:teuthology.orchestra.run.smithi006:> print(_find_admin_socket("client.2")) 2024-09-10T20:56:09.082 DEBUG:teuthology.orchestra.run.smithi006:> ' 2024-09-10T20:56:09.247 INFO:teuthology.orchestra.run.smithi006.stdout:/var/run/ceph/ceph-client.2.44917.asok 2024-09-10T20:56:09.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:56:09.262 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.44917.asok 2024-09-10T20:56:09.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:09.263 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.44917.asok status 2024-09-10T20:56:09.449 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-10T20:56:09.449 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": { 2024-09-10T20:56:09.449 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T20:56:09.449 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T20:56:09.449 INFO:teuthology.orchestra.run.smithi006.stdout: "entity_id": "2", 2024-09-10T20:56:09.449 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": "smithi006", 2024-09-10T20:56:09.449 INFO:teuthology.orchestra.run.smithi006.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-09-10T20:56:09.449 INFO:teuthology.orchestra.run.smithi006.stdout: "pid": "44917", 2024-09-10T20:56:09.450 INFO:teuthology.orchestra.run.smithi006.stdout: "root": "/" 2024-09-10T20:56:09.450 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-10T20:56:09.450 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_count": 0, 2024-09-10T20:56:09.450 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_pinned_count": 0, 2024-09-10T20:56:09.450 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 4532, 2024-09-10T20:56:09.450 INFO:teuthology.orchestra.run.smithi006.stdout: "inst": { 2024-09-10T20:56:09.450 INFO:teuthology.orchestra.run.smithi006.stdout: "name": { 2024-09-10T20:56:09.450 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2024-09-10T20:56:09.450 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 4532 2024-09-10T20:56:09.450 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-10T20:56:09.450 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2024-09-10T20:56:09.450 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-10T20:56:09.450 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.2:0", 2024-09-10T20:56:09.450 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2916530664 2024-09-10T20:56:09.450 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-10T20:56:09.451 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-10T20:56:09.451 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2024-09-10T20:56:09.451 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-10T20:56:09.451 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.2:0", 2024-09-10T20:56:09.451 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2916530664 2024-09-10T20:56:09.451 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-10T20:56:09.451 INFO:teuthology.orchestra.run.smithi006.stdout: "inst_str": "client.4532 192.168.0.2:0/2916530664", 2024-09-10T20:56:09.451 INFO:teuthology.orchestra.run.smithi006.stdout: "addr_str": "192.168.0.2:0/2916530664", 2024-09-10T20:56:09.451 INFO:teuthology.orchestra.run.smithi006.stdout: "inode_count": 1, 2024-09-10T20:56:09.451 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_epoch": 8, 2024-09-10T20:56:09.451 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch": 22, 2024-09-10T20:56:09.451 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch_barrier": 0, 2024-09-10T20:56:09.451 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklisted": false, 2024-09-10T20:56:09.451 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs" 2024-09-10T20:56:09.451 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-10T20:56:09.461 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-10T20:56:09.461 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T20:56:09.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.619+0000 7f4411200640 1 -- 172.21.15.6:0/3988992445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f440c0af060 msgr2=0x7f440c15f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:09.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.619+0000 7f4411200640 1 --2- 172.21.15.6:0/3988992445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f440c0af060 0x7f440c15f060 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f440c074e80 tx=0x7f43f402a4d0 comp rx=0 tx=0).stop 2024-09-10T20:56:09.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.619+0000 7f4411200640 1 -- 172.21.15.6:0/3988992445 shutdown_connections 2024-09-10T20:56:09.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.619+0000 7f4411200640 1 --2- 172.21.15.6:0/3988992445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f440c0af060 0x7f440c15f060 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:09.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.619+0000 7f4411200640 1 --2- 172.21.15.6:0/3988992445 >> v2:172.21.15.150:3300/0 conn(0x7f440c06f090 0x7f440c15eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:09.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.619+0000 7f4411200640 1 -- 172.21.15.6:0/3988992445 >> 172.21.15.6:0/3988992445 conn(0x7f440c0cfa20 msgr2=0x7f440c0cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:09.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.619+0000 7f4411200640 1 -- 172.21.15.6:0/3988992445 shutdown_connections 2024-09-10T20:56:09.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.619+0000 7f4411200640 1 -- 172.21.15.6:0/3988992445 wait complete. 2024-09-10T20:56:09.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.621+0000 7f4411200640 1 Processor -- start 2024-09-10T20:56:09.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.621+0000 7f4411200640 1 -- start start 2024-09-10T20:56:09.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.622+0000 7f4411200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f440c06f090 0x7f440c0c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:09.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.622+0000 7f4411200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f440c0af060 0x7f440c15bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:09.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.622+0000 7f4411200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f440c0cdc40 0x7f440c0b0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:09.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.622+0000 7f4411200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f440c15f5a0 con 0x7f440c0cdc40 2024-09-10T20:56:09.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.622+0000 7f4411200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f440c06f680 con 0x7f440c06f090 2024-09-10T20:56:09.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.622+0000 7f4411200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f440c15f720 con 0x7f440c0af060 2024-09-10T20:56:09.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.622+0000 7f440a800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f440c0cdc40 0x7f440c0b0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:09.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.622+0000 7f4409e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f440c06f090 0x7f440c0c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:09.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.622+0000 7f440a800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f440c0cdc40 0x7f440c0b0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50140/0 (socket says 172.21.15.6:50140) 2024-09-10T20:56:09.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.622+0000 7f4409e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f440c06f090 0x7f440c0c5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.6:52986/0 (socket says 172.21.15.6:52986) 2024-09-10T20:56:09.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.622+0000 7f440a800640 1 -- 172.21.15.6:0/2419285752 learned_addr learned my addr 172.21.15.6:0/2419285752 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:09.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.622+0000 7f4403e00640 1 --2- 172.21.15.6:0/2419285752 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f440c0af060 0x7f440c15bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:09.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.623+0000 7f440a800640 1 -- 172.21.15.6:0/2419285752 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f440c0af060 msgr2=0x7f440c15bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:09.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.623+0000 7f440a800640 1 --2- 172.21.15.6:0/2419285752 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f440c0af060 0x7f440c15bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:09.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.623+0000 7f440a800640 1 -- 172.21.15.6:0/2419285752 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f440c06f090 msgr2=0x7f440c0c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:09.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.623+0000 7f440a800640 1 --2- 172.21.15.6:0/2419285752 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f440c06f090 0x7f440c0c5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:09.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.623+0000 7f440a800640 1 -- 172.21.15.6:0/2419285752 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f440c1f7a40 con 0x7f440c0cdc40 2024-09-10T20:56:09.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.623+0000 7f440a800640 1 --2- 172.21.15.6:0/2419285752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f440c0cdc40 0x7f440c0b0550 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f440400c6b0 tx=0x7f440400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:09.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.623+0000 7f4402000640 1 -- 172.21.15.6:0/2419285752 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4404003b70 con 0x7f440c0cdc40 2024-09-10T20:56:09.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.623+0000 7f4402000640 1 -- 172.21.15.6:0/2419285752 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4404003d30 con 0x7f440c0cdc40 2024-09-10T20:56:09.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.623+0000 7f4402000640 1 -- 172.21.15.6:0/2419285752 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4404005330 con 0x7f440c0cdc40 2024-09-10T20:56:09.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.623+0000 7f4411200640 1 -- 172.21.15.6:0/2419285752 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f440c1f7d20 con 0x7f440c0cdc40 2024-09-10T20:56:09.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.624+0000 7f4411200640 1 -- 172.21.15.6:0/2419285752 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f440c1f82e0 con 0x7f440c0cdc40 2024-09-10T20:56:09.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.625+0000 7f4411200640 1 -- 172.21.15.6:0/2419285752 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f440c15eb20 con 0x7f440c0cdc40 2024-09-10T20:56:09.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.627+0000 7f4402000640 1 -- 172.21.15.6:0/2419285752 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f44040054d0 con 0x7f440c0cdc40 2024-09-10T20:56:09.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.628+0000 7f4402000640 1 --2- 172.21.15.6:0/2419285752 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f43e8077f70 0x7f43e807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:09.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.628+0000 7f4402000640 1 -- 172.21.15.6:0/2419285752 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f44040999b0 con 0x7f440c0cdc40 2024-09-10T20:56:09.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.628+0000 7f4409e00640 1 --2- 172.21.15.6:0/2419285752 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f43e8077f70 0x7f43e807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:09.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.629+0000 7f4409e00640 1 --2- 172.21.15.6:0/2419285752 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f43e8077f70 0x7f43e807a430 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f43fc00bbe0 tx=0x7f43fc00b390 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:09.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.632+0000 7f4402000640 1 -- 172.21.15.6:0/2419285752 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f44040057f0 con 0x7f440c0cdc40 2024-09-10T20:56:09.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.867+0000 7f4411200640 1 -- 172.21.15.6:0/2419285752 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f440c069d20 con 0x7f440c0cdc40 2024-09-10T20:56:09.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.868+0000 7f4402000640 1 -- 172.21.15.6:0/2419285752 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f4404061e50 con 0x7f440c0cdc40 2024-09-10T20:56:09.872 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T20:56:09.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.870+0000 7f4411200640 1 -- 172.21.15.6:0/2419285752 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f43e8077f70 msgr2=0x7f43e807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:09.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.870+0000 7f4411200640 1 --2- 172.21.15.6:0/2419285752 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f43e8077f70 0x7f43e807a430 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f43fc00bbe0 tx=0x7f43fc00b390 comp rx=0 tx=0).stop 2024-09-10T20:56:09.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.870+0000 7f4411200640 1 -- 172.21.15.6:0/2419285752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f440c0cdc40 msgr2=0x7f440c0b0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:09.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.870+0000 7f4411200640 1 --2- 172.21.15.6:0/2419285752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f440c0cdc40 0x7f440c0b0550 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f440400c6b0 tx=0x7f440400cb70 comp rx=0 tx=0).stop 2024-09-10T20:56:09.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.870+0000 7f4411200640 1 -- 172.21.15.6:0/2419285752 shutdown_connections 2024-09-10T20:56:09.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.870+0000 7f4411200640 1 --2- 172.21.15.6:0/2419285752 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f43e8077f70 0x7f43e807a430 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:09.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.870+0000 7f4411200640 1 --2- 172.21.15.6:0/2419285752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f440c0cdc40 0x7f440c0b0550 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:09.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.870+0000 7f4411200640 1 --2- 172.21.15.6:0/2419285752 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f440c0af060 0x7f440c15bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:09.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.870+0000 7f4411200640 1 --2- 172.21.15.6:0/2419285752 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f440c06f090 0x7f440c0c5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:09.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.870+0000 7f4411200640 1 -- 172.21.15.6:0/2419285752 >> 172.21.15.6:0/2419285752 conn(0x7f440c0cfa20 msgr2=0x7f440c15d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:09.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.870+0000 7f4411200640 1 -- 172.21.15.6:0/2419285752 shutdown_connections 2024-09-10T20:56:09.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:09.870+0000 7f4411200640 1 -- 172.21.15.6:0/2419285752 wait complete. 2024-09-10T20:56:09.889 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T20:56:09.889 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T20:56:09.890 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi150.front.sepia.ceph.com 2024-09-10T20:56:09.890 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-10T20:56:09.890 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T20:56:09.890 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T20:56:09.890 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T20:56:09.890 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T20:56:09.890 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T20:56:09.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:09.890 DEBUG:teuthology.orchestra.run.smithi150:> ip addr 2024-09-10T20:56:09.930 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T20:56:09.930 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T20:56:09.931 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T20:56:09.931 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:56:09.931 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2024-09-10T20:56:09.931 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:56:09.931 INFO:teuthology.orchestra.run.smithi150.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T20:56:09.931 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bc brd ff:ff:ff:ff:ff:ff 2024-09-10T20:56:09.931 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f0 2024-09-10T20:56:09.931 INFO:teuthology.orchestra.run.smithi150.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T20:56:09.931 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bd brd ff:ff:ff:ff:ff:ff 2024-09-10T20:56:09.931 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f1 2024-09-10T20:56:09.931 INFO:teuthology.orchestra.run.smithi150.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T20:56:09.931 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:34 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:56:09.931 INFO:teuthology.orchestra.run.smithi150.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T20:56:09.932 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:35 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:56:09.932 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.21.15.150/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T20:56:09.932 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft 42645sec preferred_lft 42645sec 2024-09-10T20:56:09.932 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::ec4:7aff:fe88:6e35/64 scope link noprefixroute 2024-09-10T20:56:09.932 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:56:09.932 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T20:56:09.932 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:56:09.932 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-10T20:56:09.932 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link add name ceph-brx type bridge 2024-09-10T20:56:09.932 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip addr flush dev ceph-brx 2024-09-10T20:56:09.933 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set ceph-brx up 2024-09-10T20:56:09.933 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T20:56:09.933 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-10T20:56:10.053 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:56:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:56:10.336 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:56:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:56:10.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:10.344 DEBUG:teuthology.orchestra.run.smithi150:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T20:56:10.400 INFO:teuthology.orchestra.run.smithi150.stdout:1 2024-09-10T20:56:10.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:10.403 DEBUG:teuthology.orchestra.run.smithi150:> route 2024-09-10T20:56:10.456 INFO:teuthology.orchestra.run.smithi150.stdout:Kernel IP routing table 2024-09-10T20:56:10.456 INFO:teuthology.orchestra.run.smithi150.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T20:56:10.456 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T20:56:10.456 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T20:56:10.456 INFO:teuthology.orchestra.run.smithi150.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T20:56:10.456 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:56:10.457 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-10T20:56:10.457 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T20:56:10.457 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T20:56:10.457 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T20:56:10.457 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-10T20:56:10.534 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:56:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:56:11.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:56:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:56:11.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:11.048 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2024-09-10T20:56:11.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:11.084 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list-id 2024-09-10T20:56:11.159 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:56:11.159 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-10T20:56:11.159 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T20:56:11.159 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-10T20:56:11.159 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-10T20:56:11.277 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:56:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:56:11.328 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:56:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:56:11.336 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-10T20:56:11.336 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:56:11.336 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-10T20:56:11.336 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-10T20:56:11.336 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T20:56:11.336 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-10T20:56:11.337 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-10T20:56:11.337 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-10T20:56:11.337 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-10T20:56:11.415 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:56:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:56:11.570 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:56:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:56:11.578 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:56:11.578 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-10T20:56:11.578 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set brx.0 up 2024-09-10T20:56:11.578 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T20:56:11.578 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-10T20:56:11.656 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:56:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:56:11.736 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:56:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:56:11.744 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-10T20:56:11.744 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T20:56:11.744 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-10T20:56:11.779 INFO:teuthology.orchestra.run.smithi150.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-10T20:56:11.779 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T20:56:11.779 DEBUG:teuthology.orchestra.run.smithi150:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-10T20:56:11.854 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2024-09-10T20:56:11.951 DEBUG:teuthology.orchestra.run.smithi150:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T20:56:11.988 INFO:teuthology.orchestra.run.smithi150.stdout:/proc 2024-09-10T20:56:11.988 INFO:teuthology.orchestra.run.smithi150.stdout:/sys 2024-09-10T20:56:11.988 INFO:teuthology.orchestra.run.smithi150.stdout:/dev 2024-09-10T20:56:11.988 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/security 2024-09-10T20:56:11.988 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/shm 2024-09-10T20:56:11.988 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/pts 2024-09-10T20:56:11.988 INFO:teuthology.orchestra.run.smithi150.stdout:/run 2024-09-10T20:56:11.988 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/cgroup 2024-09-10T20:56:11.988 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/pstore 2024-09-10T20:56:11.988 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/bpf 2024-09-10T20:56:11.988 INFO:teuthology.orchestra.run.smithi150.stdout:/ 2024-09-10T20:56:11.988 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/selinux 2024-09-10T20:56:11.988 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T20:56:11.989 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/mqueue 2024-09-10T20:56:11.989 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/hugepages 2024-09-10T20:56:11.989 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/debug 2024-09-10T20:56:11.989 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/tracing 2024-09-10T20:56:11.989 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/fuse/connections 2024-09-10T20:56:11.989 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/config 2024-09-10T20:56:11.989 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T20:56:11.989 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T20:56:11.989 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T20:56:11.989 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T20:56:11.989 INFO:teuthology.orchestra.run.smithi150.stdout:/run/user/1000 2024-09-10T20:56:11.989 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph 2024-09-10T20:56:11.989 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-4 2024-09-10T20:56:11.989 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-5 2024-09-10T20:56:11.990 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-6 2024-09-10T20:56:11.990 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-7 2024-09-10T20:56:11.990 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns 2024-09-10T20:56:11.990 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T20:56:11.990 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T20:56:11.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:11.991 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2024-09-10T20:56:12.066 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T20:56:12.066 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-10T20:56:12.110 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2024-09-10T20:56:12.168 DEBUG:teuthology.orchestra.run.smithi150:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T20:56:12.204 INFO:teuthology.orchestra.run.smithi150.stdout:/proc 2024-09-10T20:56:12.204 INFO:teuthology.orchestra.run.smithi150.stdout:/sys 2024-09-10T20:56:12.204 INFO:teuthology.orchestra.run.smithi150.stdout:/dev 2024-09-10T20:56:12.204 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/security 2024-09-10T20:56:12.205 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/shm 2024-09-10T20:56:12.205 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/pts 2024-09-10T20:56:12.205 INFO:teuthology.orchestra.run.smithi150.stdout:/run 2024-09-10T20:56:12.205 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/cgroup 2024-09-10T20:56:12.205 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/pstore 2024-09-10T20:56:12.205 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/bpf 2024-09-10T20:56:12.205 INFO:teuthology.orchestra.run.smithi150.stdout:/ 2024-09-10T20:56:12.205 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/selinux 2024-09-10T20:56:12.206 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T20:56:12.206 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/mqueue 2024-09-10T20:56:12.206 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/hugepages 2024-09-10T20:56:12.206 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/debug 2024-09-10T20:56:12.206 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/tracing 2024-09-10T20:56:12.206 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/fuse/connections 2024-09-10T20:56:12.206 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/config 2024-09-10T20:56:12.206 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T20:56:12.207 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T20:56:12.207 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T20:56:12.207 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T20:56:12.207 INFO:teuthology.orchestra.run.smithi150.stdout:/run/user/1000 2024-09-10T20:56:12.207 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph 2024-09-10T20:56:12.207 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-4 2024-09-10T20:56:12.207 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-5 2024-09-10T20:56:12.207 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-6 2024-09-10T20:56:12.207 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-7 2024-09-10T20:56:12.207 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns 2024-09-10T20:56:12.207 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T20:56:12.207 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T20:56:12.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:12.208 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2024-09-10T20:56:12.268 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi150.stderr:2024-09-10T20:56:12.263+0000 7f9917000480 -1 init, newargv = 0x555946676360 newargc=15 2024-09-10T20:56:12.268 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi150.stderr:ceph-fuse[41336]: starting ceph client 2024-09-10T20:56:12.277 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi150.stderr:ceph-fuse[41336]: starting fuse 2024-09-10T20:56:12.289 INFO:teuthology.orchestra.run.smithi150.stdout:43 2024-09-10T20:56:12.290 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-09-10T20:56:12.290 DEBUG:teuthology.orchestra.run.smithi150:> sudo stdin-killer -- python3 -c ' 2024-09-10T20:56:12.290 DEBUG:teuthology.orchestra.run.smithi150:> import glob 2024-09-10T20:56:12.290 DEBUG:teuthology.orchestra.run.smithi150:> import re 2024-09-10T20:56:12.290 DEBUG:teuthology.orchestra.run.smithi150:> import os 2024-09-10T20:56:12.290 DEBUG:teuthology.orchestra.run.smithi150:> import subprocess 2024-09-10T20:56:12.290 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-10T20:56:12.290 DEBUG:teuthology.orchestra.run.smithi150:> def _find_admin_socket(client_name): 2024-09-10T20:56:12.290 DEBUG:teuthology.orchestra.run.smithi150:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-10T20:56:12.291 DEBUG:teuthology.orchestra.run.smithi150:> files = glob.glob(asok_path) 2024-09-10T20:56:12.291 DEBUG:teuthology.orchestra.run.smithi150:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-10T20:56:12.291 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-10T20:56:12.291 DEBUG:teuthology.orchestra.run.smithi150:> # Given a non-glob path, it better be there 2024-09-10T20:56:12.291 DEBUG:teuthology.orchestra.run.smithi150:> if "*" not in asok_path: 2024-09-10T20:56:12.291 DEBUG:teuthology.orchestra.run.smithi150:> assert(len(files) == 1) 2024-09-10T20:56:12.291 DEBUG:teuthology.orchestra.run.smithi150:> return files[0] 2024-09-10T20:56:12.291 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-10T20:56:12.291 DEBUG:teuthology.orchestra.run.smithi150:> for f in files: 2024-09-10T20:56:12.291 DEBUG:teuthology.orchestra.run.smithi150:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T20:56:12.291 DEBUG:teuthology.orchestra.run.smithi150:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T20:56:12.291 DEBUG:teuthology.orchestra.run.smithi150:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T20:56:12.291 DEBUG:teuthology.orchestra.run.smithi150:> contents = proc_f.read() 2024-09-10T20:56:12.291 DEBUG:teuthology.orchestra.run.smithi150:> if mountpoint in contents: 2024-09-10T20:56:12.291 DEBUG:teuthology.orchestra.run.smithi150:> return f 2024-09-10T20:56:12.291 DEBUG:teuthology.orchestra.run.smithi150:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T20:56:12.292 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-10T20:56:12.292 DEBUG:teuthology.orchestra.run.smithi150:> print(_find_admin_socket("client.1")) 2024-09-10T20:56:12.292 DEBUG:teuthology.orchestra.run.smithi150:> ' 2024-09-10T20:56:12.453 INFO:teuthology.orchestra.run.smithi150.stdout:/var/run/ceph/ceph-client.1.41336.asok 2024-09-10T20:56:12.457 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:56:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:56:12.467 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.41336.asok 2024-09-10T20:56:12.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:12.468 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.41336.asok status 2024-09-10T20:56:12.651 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-10T20:56:12.651 INFO:teuthology.orchestra.run.smithi150.stdout: "metadata": { 2024-09-10T20:56:12.652 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T20:56:12.652 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T20:56:12.652 INFO:teuthology.orchestra.run.smithi150.stdout: "entity_id": "1", 2024-09-10T20:56:12.652 INFO:teuthology.orchestra.run.smithi150.stdout: "hostname": "smithi150", 2024-09-10T20:56:12.652 INFO:teuthology.orchestra.run.smithi150.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-10T20:56:12.652 INFO:teuthology.orchestra.run.smithi150.stdout: "pid": "41336", 2024-09-10T20:56:12.652 INFO:teuthology.orchestra.run.smithi150.stdout: "root": "/" 2024-09-10T20:56:12.652 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-10T20:56:12.652 INFO:teuthology.orchestra.run.smithi150.stdout: "dentry_count": 0, 2024-09-10T20:56:12.652 INFO:teuthology.orchestra.run.smithi150.stdout: "dentry_pinned_count": 0, 2024-09-10T20:56:12.652 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 4541, 2024-09-10T20:56:12.652 INFO:teuthology.orchestra.run.smithi150.stdout: "inst": { 2024-09-10T20:56:12.652 INFO:teuthology.orchestra.run.smithi150.stdout: "name": { 2024-09-10T20:56:12.652 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "client", 2024-09-10T20:56:12.653 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4541 2024-09-10T20:56:12.653 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-10T20:56:12.653 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": { 2024-09-10T20:56:12.653 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2024-09-10T20:56:12.653 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "192.168.0.1:0", 2024-09-10T20:56:12.653 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 238408316 2024-09-10T20:56:12.653 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-10T20:56:12.653 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-10T20:56:12.653 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": { 2024-09-10T20:56:12.653 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2024-09-10T20:56:12.653 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "192.168.0.1:0", 2024-09-10T20:56:12.653 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 238408316 2024-09-10T20:56:12.653 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-10T20:56:12.653 INFO:teuthology.orchestra.run.smithi150.stdout: "inst_str": "client.4541 192.168.0.1:0/238408316", 2024-09-10T20:56:12.654 INFO:teuthology.orchestra.run.smithi150.stdout: "addr_str": "192.168.0.1:0/238408316", 2024-09-10T20:56:12.654 INFO:teuthology.orchestra.run.smithi150.stdout: "inode_count": 1, 2024-09-10T20:56:12.654 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_epoch": 8, 2024-09-10T20:56:12.654 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_epoch": 22, 2024-09-10T20:56:12.654 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_epoch_barrier": 0, 2024-09-10T20:56:12.654 INFO:teuthology.orchestra.run.smithi150.stdout: "blocklisted": false, 2024-09-10T20:56:12.654 INFO:teuthology.orchestra.run.smithi150.stdout: "fs_name": "cephfs" 2024-09-10T20:56:12.654 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-10T20:56:12.663 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-10T20:56:12.663 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T20:56:12.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:12.827+0000 7f624d800640 1 -- 172.21.15.6:0/320074769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6248073d30 msgr2=0x7f624815c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:12.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:12.827+0000 7f624d800640 1 --2- 172.21.15.6:0/320074769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6248073d30 0x7f624815c970 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6230005fd0 tx=0x7f623002a5d0 comp rx=0 tx=0).stop 2024-09-10T20:56:12.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:12.828+0000 7f624d800640 1 -- 172.21.15.6:0/320074769 shutdown_connections 2024-09-10T20:56:12.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:12.828+0000 7f624d800640 1 --2- 172.21.15.6:0/320074769 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f624806e180 0x7f624806e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:12.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:12.828+0000 7f624d800640 1 --2- 172.21.15.6:0/320074769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6248073d30 0x7f624815c970 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:12.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:12.828+0000 7f624d800640 1 -- 172.21.15.6:0/320074769 >> 172.21.15.6:0/320074769 conn(0x7f624806cf90 msgr2=0x7f624806d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:12.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:12.828+0000 7f624d800640 1 -- 172.21.15.6:0/320074769 shutdown_connections 2024-09-10T20:56:12.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:12.828+0000 7f624d800640 1 -- 172.21.15.6:0/320074769 wait complete. 2024-09-10T20:56:12.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:12.829+0000 7f624d800640 1 Processor -- start 2024-09-10T20:56:12.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:12.829+0000 7f624d800640 1 -- start start 2024-09-10T20:56:12.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:12.830+0000 7f624d800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f624806e180 0x7f6248145490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:12.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:12.830+0000 7f624d800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6248073d30 0x7f6248154e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:12.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:12.830+0000 7f624d800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62480cc2e0 0x7f62481534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:12.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:12.830+0000 7f624d800640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f62480cff50 con 0x7f62480cc2e0 2024-09-10T20:56:12.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:12.830+0000 7f624d800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f62480cfdd0 con 0x7f624806e180 2024-09-10T20:56:12.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:12.830+0000 7f624d800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f62480d00d0 con 0x7f6248073d30 2024-09-10T20:56:12.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:12.830+0000 7f624ce00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62480cc2e0 0x7f62481534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:12.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:12.831+0000 7f624ce00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62480cc2e0 0x7f62481534f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50152/0 (socket says 172.21.15.6:50152) 2024-09-10T20:56:12.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:12.831+0000 7f624ce00640 1 -- 172.21.15.6:0/2959815134 learned_addr learned my addr 172.21.15.6:0/2959815134 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:12.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:12.831+0000 7f623fe00640 1 --2- 172.21.15.6:0/2959815134 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6248073d30 0x7f6248154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:12.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:12.831+0000 7f6247e00640 1 --2- 172.21.15.6:0/2959815134 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f624806e180 0x7f6248145490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:12.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:12.831+0000 7f624ce00640 1 -- 172.21.15.6:0/2959815134 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6248073d30 msgr2=0x7f6248154e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:12.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:12.831+0000 7f624ce00640 1 --2- 172.21.15.6:0/2959815134 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6248073d30 0x7f6248154e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:12.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:12.831+0000 7f624ce00640 1 -- 172.21.15.6:0/2959815134 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f624806e180 msgr2=0x7f6248145490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:12.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:12.831+0000 7f624ce00640 1 --2- 172.21.15.6:0/2959815134 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f624806e180 0x7f6248145490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:12.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:12.831+0000 7f624ce00640 1 -- 172.21.15.6:0/2959815134 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62481459d0 con 0x7f62480cc2e0 2024-09-10T20:56:12.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:12.831+0000 7f623fe00640 1 --2- 172.21.15.6:0/2959815134 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6248073d30 0x7f6248154e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:56:12.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:12.831+0000 7f6247e00640 1 --2- 172.21.15.6:0/2959815134 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f624806e180 0x7f6248145490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:56:12.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:12.831+0000 7f624ce00640 1 --2- 172.21.15.6:0/2959815134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62480cc2e0 0x7f62481534f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f624000eb10 tx=0x7f624000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:12.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:12.831+0000 7f6244c00640 1 -- 172.21.15.6:0/2959815134 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6240004b20 con 0x7f62480cc2e0 2024-09-10T20:56:12.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:12.831+0000 7f6244c00640 1 -- 172.21.15.6:0/2959815134 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6240004ce0 con 0x7f62480cc2e0 2024-09-10T20:56:12.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:12.831+0000 7f6244c00640 1 -- 172.21.15.6:0/2959815134 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6240005280 con 0x7f62480cc2e0 2024-09-10T20:56:12.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:12.831+0000 7f624d800640 1 -- 172.21.15.6:0/2959815134 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6248152450 con 0x7f62480cc2e0 2024-09-10T20:56:12.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:12.832+0000 7f624d800640 1 -- 172.21.15.6:0/2959815134 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6248152a10 con 0x7f62480cc2e0 2024-09-10T20:56:12.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:12.833+0000 7f624d800640 1 -- 172.21.15.6:0/2959815134 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62480d0620 con 0x7f62480cc2e0 2024-09-10T20:56:12.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:12.833+0000 7f6244c00640 1 -- 172.21.15.6:0/2959815134 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6240005420 con 0x7f62480cc2e0 2024-09-10T20:56:12.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:12.834+0000 7f6244c00640 1 --2- 172.21.15.6:0/2959815134 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6224077f70 0x7f622407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:12.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:12.834+0000 7f6244c00640 1 -- 172.21.15.6:0/2959815134 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f624009aaa0 con 0x7f62480cc2e0 2024-09-10T20:56:12.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:12.835+0000 7f6247e00640 1 --2- 172.21.15.6:0/2959815134 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6224077f70 0x7f622407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:12.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:12.835+0000 7f6247e00640 1 --2- 172.21.15.6:0/2959815134 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6224077f70 0x7f622407a430 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f62380016a0 tx=0x7f6238009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:12.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:12.839+0000 7f6244c00640 1 -- 172.21.15.6:0/2959815134 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f6240063590 con 0x7f62480cc2e0 2024-09-10T20:56:13.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:13.074+0000 7f624d800640 1 -- 172.21.15.6:0/2959815134 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6248160280 con 0x7f62480cc2e0 2024-09-10T20:56:13.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:13.074+0000 7f6244c00640 1 -- 172.21.15.6:0/2959815134 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f6240062e90 con 0x7f62480cc2e0 2024-09-10T20:56:13.078 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T20:56:13.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:13.076+0000 7f624d800640 1 -- 172.21.15.6:0/2959815134 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6224077f70 msgr2=0x7f622407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:13.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:13.076+0000 7f624d800640 1 --2- 172.21.15.6:0/2959815134 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6224077f70 0x7f622407a430 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f62380016a0 tx=0x7f6238009040 comp rx=0 tx=0).stop 2024-09-10T20:56:13.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:13.076+0000 7f624d800640 1 -- 172.21.15.6:0/2959815134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62480cc2e0 msgr2=0x7f62481534f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:13.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:13.076+0000 7f624d800640 1 --2- 172.21.15.6:0/2959815134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62480cc2e0 0x7f62481534f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f624000eb10 tx=0x7f624000c2d0 comp rx=0 tx=0).stop 2024-09-10T20:56:13.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:13.076+0000 7f624d800640 1 -- 172.21.15.6:0/2959815134 shutdown_connections 2024-09-10T20:56:13.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:13.076+0000 7f624d800640 1 --2- 172.21.15.6:0/2959815134 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6224077f70 0x7f622407a430 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:13.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:13.076+0000 7f624d800640 1 --2- 172.21.15.6:0/2959815134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62480cc2e0 0x7f62481534f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:13.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:13.076+0000 7f624d800640 1 --2- 172.21.15.6:0/2959815134 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6248073d30 0x7f6248154e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:13.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:13.076+0000 7f624d800640 1 --2- 172.21.15.6:0/2959815134 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f624806e180 0x7f6248145490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:13.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:13.076+0000 7f624d800640 1 -- 172.21.15.6:0/2959815134 >> 172.21.15.6:0/2959815134 conn(0x7f624806cf90 msgr2=0x7f624815db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:13.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:13.076+0000 7f624d800640 1 -- 172.21.15.6:0/2959815134 shutdown_connections 2024-09-10T20:56:13.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:13.076+0000 7f624d800640 1 -- 172.21.15.6:0/2959815134 wait complete. 2024-09-10T20:56:13.095 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T20:56:13.096 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T20:56:13.096 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi150.front.sepia.ceph.com 2024-09-10T20:56:13.096 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-10T20:56:13.096 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-10T20:56:13.096 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T20:56:13.096 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T20:56:13.096 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T20:56:13.096 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-10T20:56:13.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:13.096 DEBUG:teuthology.orchestra.run.smithi150:> ip addr 2024-09-10T20:56:13.132 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T20:56:13.132 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T20:56:13.132 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T20:56:13.132 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:56:13.133 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2024-09-10T20:56:13.133 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:56:13.133 INFO:teuthology.orchestra.run.smithi150.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T20:56:13.133 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bc brd ff:ff:ff:ff:ff:ff 2024-09-10T20:56:13.133 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f0 2024-09-10T20:56:13.133 INFO:teuthology.orchestra.run.smithi150.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T20:56:13.133 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bd brd ff:ff:ff:ff:ff:ff 2024-09-10T20:56:13.133 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f1 2024-09-10T20:56:13.133 INFO:teuthology.orchestra.run.smithi150.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T20:56:13.133 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:34 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:56:13.133 INFO:teuthology.orchestra.run.smithi150.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T20:56:13.133 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:35 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:56:13.133 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.21.15.150/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T20:56:13.134 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft 42642sec preferred_lft 42642sec 2024-09-10T20:56:13.134 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::ec4:7aff:fe88:6e35/64 scope link noprefixroute 2024-09-10T20:56:13.134 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:56:13.134 INFO:teuthology.orchestra.run.smithi150.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T20:56:13.134 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 42:0f:ea:d9:4c:b2 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:56:13.134 INFO:teuthology.orchestra.run.smithi150.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T20:56:13.134 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:56:13.134 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::b0ef:8ff:fe8a:ed60/64 scope link 2024-09-10T20:56:13.134 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:56:13.134 INFO:teuthology.orchestra.run.smithi150.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T20:56:13.134 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 42:0f:ea:d9:4c:b2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T20:56:13.134 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::400f:eaff:fed9:4cb2/64 scope link tentative 2024-09-10T20:56:13.134 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:56:13.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:13.135 DEBUG:teuthology.orchestra.run.smithi150:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T20:56:13.229 INFO:teuthology.orchestra.run.smithi150.stdout:1 2024-09-10T20:56:13.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:13.233 DEBUG:teuthology.orchestra.run.smithi150:> route 2024-09-10T20:56:13.268 INFO:teuthology.orchestra.run.smithi150.stdout:Kernel IP routing table 2024-09-10T20:56:13.269 INFO:teuthology.orchestra.run.smithi150.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T20:56:13.269 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T20:56:13.269 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T20:56:13.269 INFO:teuthology.orchestra.run.smithi150.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T20:56:13.269 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:56:13.269 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-10T20:56:13.269 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T20:56:13.269 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T20:56:13.269 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T20:56:13.269 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-10T20:56:13.387 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:56:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:56:13.458 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:56:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:56:13.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:13.467 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2024-09-10T20:56:13.502 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-10T20:56:13.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:13.502 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list-id 2024-09-10T20:56:13.576 INFO:teuthology.orchestra.run.smithi150.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-10T20:56:13.577 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:56:13.577 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-10T20:56:13.577 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T20:56:13.577 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-10T20:56:13.577 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-10T20:56:13.696 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:56:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:56:13.745 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:56:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:56:13.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:13.754 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-10T20:56:13.809 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T20:56:13.809 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T20:56:13.809 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T20:56:13.809 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:56:13.809 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2024-09-10T20:56:13.809 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:56:13.809 INFO:teuthology.orchestra.run.smithi150.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T20:56:13.809 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 06:7b:70:ab:ec:71 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-10T20:56:13.809 INFO:teuthology.orchestra.run.smithi150.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-10T20:56:13.809 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:56:13.809 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::47b:70ff:feab:ec71/64 scope link 2024-09-10T20:56:13.809 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:56:13.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:13.812 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-10T20:56:13.868 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T20:56:13.868 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T20:56:13.868 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T20:56:13.868 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:56:13.868 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2024-09-10T20:56:13.868 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:56:13.868 INFO:teuthology.orchestra.run.smithi150.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T20:56:13.868 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 06:7b:70:ab:ec:71 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-10T20:56:13.869 INFO:teuthology.orchestra.run.smithi150.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-10T20:56:13.869 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:56:13.869 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::47b:70ff:feab:ec71/64 scope link 2024-09-10T20:56:13.869 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:56:13.870 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-10T20:56:13.870 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:56:13.870 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-10T20:56:13.870 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-10T20:56:13.870 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-10T20:56:13.870 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-10T20:56:13.871 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-10T20:56:13.871 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-10T20:56:13.871 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-10T20:56:13.948 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:56:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:56:14.080 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:56:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:56:14.088 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:56:14.088 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-10T20:56:14.088 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set brx.1 up 2024-09-10T20:56:14.088 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set dev brx.1 master ceph-brx 2024-09-10T20:56:14.088 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-10T20:56:14.165 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:56:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:56:14.246 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:56:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:56:14.254 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-09-10T20:56:14.254 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T20:56:14.254 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-10T20:56:14.289 INFO:teuthology.orchestra.run.smithi150.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-10T20:56:14.289 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T20:56:14.290 DEBUG:teuthology.orchestra.run.smithi150:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-10T20:56:14.365 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2024-09-10T20:56:14.462 DEBUG:teuthology.orchestra.run.smithi150:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T20:56:14.498 INFO:teuthology.orchestra.run.smithi150.stdout:/proc 2024-09-10T20:56:14.498 INFO:teuthology.orchestra.run.smithi150.stdout:/sys 2024-09-10T20:56:14.498 INFO:teuthology.orchestra.run.smithi150.stdout:/dev 2024-09-10T20:56:14.498 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/security 2024-09-10T20:56:14.499 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/shm 2024-09-10T20:56:14.499 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/pts 2024-09-10T20:56:14.499 INFO:teuthology.orchestra.run.smithi150.stdout:/run 2024-09-10T20:56:14.499 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/cgroup 2024-09-10T20:56:14.499 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/pstore 2024-09-10T20:56:14.499 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/bpf 2024-09-10T20:56:14.499 INFO:teuthology.orchestra.run.smithi150.stdout:/ 2024-09-10T20:56:14.499 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/selinux 2024-09-10T20:56:14.499 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T20:56:14.499 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/mqueue 2024-09-10T20:56:14.499 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/hugepages 2024-09-10T20:56:14.499 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/debug 2024-09-10T20:56:14.499 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/tracing 2024-09-10T20:56:14.499 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/fuse/connections 2024-09-10T20:56:14.499 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/config 2024-09-10T20:56:14.500 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T20:56:14.500 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T20:56:14.500 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T20:56:14.500 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T20:56:14.500 INFO:teuthology.orchestra.run.smithi150.stdout:/run/user/1000 2024-09-10T20:56:14.500 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph 2024-09-10T20:56:14.500 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-4 2024-09-10T20:56:14.500 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-5 2024-09-10T20:56:14.500 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-6 2024-09-10T20:56:14.500 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-7 2024-09-10T20:56:14.500 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns 2024-09-10T20:56:14.500 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T20:56:14.500 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T20:56:14.501 INFO:teuthology.orchestra.run.smithi150.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-10T20:56:14.501 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T20:56:14.501 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T20:56:14.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:14.502 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2024-09-10T20:56:14.577 INFO:teuthology.orchestra.run.smithi150.stdout:43 2024-09-10T20:56:14.577 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2024-09-10T20:56:14.577 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-09-10T20:56:14.621 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2024-09-10T20:56:14.678 DEBUG:teuthology.orchestra.run.smithi150:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T20:56:14.714 INFO:teuthology.orchestra.run.smithi150.stdout:/proc 2024-09-10T20:56:14.714 INFO:teuthology.orchestra.run.smithi150.stdout:/sys 2024-09-10T20:56:14.714 INFO:teuthology.orchestra.run.smithi150.stdout:/dev 2024-09-10T20:56:14.714 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/security 2024-09-10T20:56:14.714 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/shm 2024-09-10T20:56:14.715 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/pts 2024-09-10T20:56:14.715 INFO:teuthology.orchestra.run.smithi150.stdout:/run 2024-09-10T20:56:14.715 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/cgroup 2024-09-10T20:56:14.715 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/pstore 2024-09-10T20:56:14.715 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/bpf 2024-09-10T20:56:14.715 INFO:teuthology.orchestra.run.smithi150.stdout:/ 2024-09-10T20:56:14.715 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/selinux 2024-09-10T20:56:14.715 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T20:56:14.715 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/mqueue 2024-09-10T20:56:14.715 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/hugepages 2024-09-10T20:56:14.715 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/debug 2024-09-10T20:56:14.715 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/tracing 2024-09-10T20:56:14.715 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/fuse/connections 2024-09-10T20:56:14.715 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/config 2024-09-10T20:56:14.716 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T20:56:14.716 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T20:56:14.716 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T20:56:14.716 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T20:56:14.716 INFO:teuthology.orchestra.run.smithi150.stdout:/run/user/1000 2024-09-10T20:56:14.716 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph 2024-09-10T20:56:14.716 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-4 2024-09-10T20:56:14.716 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-5 2024-09-10T20:56:14.716 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-6 2024-09-10T20:56:14.716 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-7 2024-09-10T20:56:14.716 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns 2024-09-10T20:56:14.716 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T20:56:14.717 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T20:56:14.717 INFO:teuthology.orchestra.run.smithi150.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-10T20:56:14.717 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T20:56:14.717 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T20:56:14.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:14.718 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2024-09-10T20:56:14.766 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi150.stderr:2024-09-10T20:56:14.763+0000 7f3c5c764480 -1 init, newargv = 0x5635759e1520 newargc=15 2024-09-10T20:56:14.766 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi150.stderr:ceph-fuse[41792]: starting ceph client 2024-09-10T20:56:14.775 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi150.stderr:ceph-fuse[41792]: starting fuse 2024-09-10T20:56:14.796 INFO:teuthology.orchestra.run.smithi150.stdout:43 2024-09-10T20:56:14.796 INFO:teuthology.orchestra.run.smithi150.stdout:44 2024-09-10T20:56:14.797 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2024-09-10T20:56:14.797 DEBUG:teuthology.orchestra.run.smithi150:> sudo stdin-killer -- python3 -c ' 2024-09-10T20:56:14.797 DEBUG:teuthology.orchestra.run.smithi150:> import glob 2024-09-10T20:56:14.797 DEBUG:teuthology.orchestra.run.smithi150:> import re 2024-09-10T20:56:14.797 DEBUG:teuthology.orchestra.run.smithi150:> import os 2024-09-10T20:56:14.797 DEBUG:teuthology.orchestra.run.smithi150:> import subprocess 2024-09-10T20:56:14.797 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-10T20:56:14.797 DEBUG:teuthology.orchestra.run.smithi150:> def _find_admin_socket(client_name): 2024-09-10T20:56:14.798 DEBUG:teuthology.orchestra.run.smithi150:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-09-10T20:56:14.798 DEBUG:teuthology.orchestra.run.smithi150:> files = glob.glob(asok_path) 2024-09-10T20:56:14.798 DEBUG:teuthology.orchestra.run.smithi150:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-09-10T20:56:14.798 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-10T20:56:14.798 DEBUG:teuthology.orchestra.run.smithi150:> # Given a non-glob path, it better be there 2024-09-10T20:56:14.798 DEBUG:teuthology.orchestra.run.smithi150:> if "*" not in asok_path: 2024-09-10T20:56:14.798 DEBUG:teuthology.orchestra.run.smithi150:> assert(len(files) == 1) 2024-09-10T20:56:14.798 DEBUG:teuthology.orchestra.run.smithi150:> return files[0] 2024-09-10T20:56:14.798 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-10T20:56:14.798 DEBUG:teuthology.orchestra.run.smithi150:> for f in files: 2024-09-10T20:56:14.798 DEBUG:teuthology.orchestra.run.smithi150:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T20:56:14.798 DEBUG:teuthology.orchestra.run.smithi150:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T20:56:14.798 DEBUG:teuthology.orchestra.run.smithi150:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T20:56:14.798 DEBUG:teuthology.orchestra.run.smithi150:> contents = proc_f.read() 2024-09-10T20:56:14.798 DEBUG:teuthology.orchestra.run.smithi150:> if mountpoint in contents: 2024-09-10T20:56:14.799 DEBUG:teuthology.orchestra.run.smithi150:> return f 2024-09-10T20:56:14.799 DEBUG:teuthology.orchestra.run.smithi150:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T20:56:14.799 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-10T20:56:14.799 DEBUG:teuthology.orchestra.run.smithi150:> print(_find_admin_socket("client.3")) 2024-09-10T20:56:14.799 DEBUG:teuthology.orchestra.run.smithi150:> ' 2024-09-10T20:56:14.962 INFO:teuthology.orchestra.run.smithi150.stdout:/var/run/ceph/ceph-client.3.41792.asok 2024-09-10T20:56:14.965 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-10T20:56:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:56:14.976 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.41792.asok 2024-09-10T20:56:14.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:14.976 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.41792.asok status 2024-09-10T20:56:15.158 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-10T20:56:15.158 INFO:teuthology.orchestra.run.smithi150.stdout: "metadata": { 2024-09-10T20:56:15.158 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T20:56:15.158 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T20:56:15.158 INFO:teuthology.orchestra.run.smithi150.stdout: "entity_id": "3", 2024-09-10T20:56:15.159 INFO:teuthology.orchestra.run.smithi150.stdout: "hostname": "smithi150", 2024-09-10T20:56:15.159 INFO:teuthology.orchestra.run.smithi150.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-09-10T20:56:15.159 INFO:teuthology.orchestra.run.smithi150.stdout: "pid": "41792", 2024-09-10T20:56:15.159 INFO:teuthology.orchestra.run.smithi150.stdout: "root": "/" 2024-09-10T20:56:15.159 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-10T20:56:15.159 INFO:teuthology.orchestra.run.smithi150.stdout: "dentry_count": 0, 2024-09-10T20:56:15.159 INFO:teuthology.orchestra.run.smithi150.stdout: "dentry_pinned_count": 0, 2024-09-10T20:56:15.159 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 4765, 2024-09-10T20:56:15.159 INFO:teuthology.orchestra.run.smithi150.stdout: "inst": { 2024-09-10T20:56:15.159 INFO:teuthology.orchestra.run.smithi150.stdout: "name": { 2024-09-10T20:56:15.159 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "client", 2024-09-10T20:56:15.159 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4765 2024-09-10T20:56:15.159 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-10T20:56:15.159 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": { 2024-09-10T20:56:15.159 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2024-09-10T20:56:15.160 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "192.168.0.2:0", 2024-09-10T20:56:15.160 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 1217321734 2024-09-10T20:56:15.160 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-10T20:56:15.160 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-10T20:56:15.160 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": { 2024-09-10T20:56:15.160 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2024-09-10T20:56:15.160 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "192.168.0.2:0", 2024-09-10T20:56:15.160 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 1217321734 2024-09-10T20:56:15.160 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-10T20:56:15.160 INFO:teuthology.orchestra.run.smithi150.stdout: "inst_str": "client.4765 192.168.0.2:0/1217321734", 2024-09-10T20:56:15.160 INFO:teuthology.orchestra.run.smithi150.stdout: "addr_str": "192.168.0.2:0/1217321734", 2024-09-10T20:56:15.160 INFO:teuthology.orchestra.run.smithi150.stdout: "inode_count": 1, 2024-09-10T20:56:15.160 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_epoch": 8, 2024-09-10T20:56:15.160 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_epoch": 22, 2024-09-10T20:56:15.160 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_epoch_barrier": 0, 2024-09-10T20:56:15.161 INFO:teuthology.orchestra.run.smithi150.stdout: "blocklisted": false, 2024-09-10T20:56:15.161 INFO:teuthology.orchestra.run.smithi150.stdout: "fs_name": "cephfs" 2024-09-10T20:56:15.161 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-10T20:56:15.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:15.170 DEBUG:teuthology.orchestra.run.smithi006:> stat --file-system '--printf=%T 2024-09-10T20:56:15.170 DEBUG:teuthology.orchestra.run.smithi006:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-10T20:56:15.211 INFO:teuthology.orchestra.run.smithi006.stdout:fuseblk 2024-09-10T20:56:15.211 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-10T20:56:15.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:15.211 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T20:56:15.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:15.314 DEBUG:teuthology.orchestra.run.smithi006:> stat --file-system '--printf=%T 2024-09-10T20:56:15.315 DEBUG:teuthology.orchestra.run.smithi006:> ' -- /home/ubuntu/cephtest/mnt.2 2024-09-10T20:56:15.352 INFO:teuthology.orchestra.run.smithi006.stdout:fuseblk 2024-09-10T20:56:15.352 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-09-10T20:56:15.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:15.352 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-10T20:56:15.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:15.454 DEBUG:teuthology.orchestra.run.smithi150:> stat --file-system '--printf=%T 2024-09-10T20:56:15.454 DEBUG:teuthology.orchestra.run.smithi150:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-10T20:56:15.491 INFO:teuthology.orchestra.run.smithi150.stdout:fuseblk 2024-09-10T20:56:15.491 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-10T20:56:15.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:15.491 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-10T20:56:15.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:15.588 DEBUG:teuthology.orchestra.run.smithi150:> stat --file-system '--printf=%T 2024-09-10T20:56:15.588 DEBUG:teuthology.orchestra.run.smithi150:> ' -- /home/ubuntu/cephtest/mnt.3 2024-09-10T20:56:15.623 INFO:teuthology.orchestra.run.smithi150.stdout:fuseblk 2024-09-10T20:56:15.624 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-09-10T20:56:15.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:15.624 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-10T20:56:15.720 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-10T20:56:15.746 INFO:tasks.cephfs_test_runner:Starting test: test_backtrace (tasks.cephfs.test_backtrace.TestBacktrace) That the 'parent' 'layout' and 'symlink' xattrs on the head objects of files 2024-09-10T20:56:15.746 INFO:tasks.cephfs_test_runner:test_backtrace (tasks.cephfs.test_backtrace.TestBacktrace) 2024-09-10T20:56:15.746 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T20:56:15.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:15.905+0000 7fad1e000640 1 -- 172.21.15.6:0/2872826297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facfc0040b0 msgr2=0x7facfc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:15.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:15.905+0000 7fad1e000640 1 --2- 172.21.15.6:0/2872826297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facfc0040b0 0x7facfc004800 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fad1809fc50 tx=0x7facfc005830 comp rx=0 tx=0).stop 2024-09-10T20:56:15.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:15.905+0000 7fad1d600640 1 -- 172.21.15.6:0/2872826297 reap_dead start 2024-09-10T20:56:15.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:15.905+0000 7fad1e000640 1 -- 172.21.15.6:0/2872826297 shutdown_connections 2024-09-10T20:56:15.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:15.905+0000 7fad1e000640 1 -- 172.21.15.6:0/2872826297 >> 172.21.15.6:0/2872826297 conn(0x7fad1809aa00 msgr2=0x7fad1809ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:15.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:15.906+0000 7fad1e000640 1 -- 172.21.15.6:0/2872826297 shutdown_connections 2024-09-10T20:56:15.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:15.906+0000 7fad1e000640 1 -- 172.21.15.6:0/2872826297 wait complete. 2024-09-10T20:56:15.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:15.907+0000 7fad1e000640 1 Processor -- start 2024-09-10T20:56:15.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:15.907+0000 7fad1e000640 1 -- start start 2024-09-10T20:56:15.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:15.908+0000 7fad1e000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facfc0040b0 0x7fad180cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:15.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:15.908+0000 7fad1e000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad181f5be0 0x7fad181f53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:15.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:15.908+0000 7fad1e000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad1806ef40 0x7fad181f74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:15.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:15.908+0000 7fad1e000640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fad1815d490 con 0x7facfc0040b0 2024-09-10T20:56:15.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:15.908+0000 7fad1e000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fad1815d310 con 0x7fad181f5be0 2024-09-10T20:56:15.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:15.908+0000 7fad1e000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fad1815d610 con 0x7fad1806ef40 2024-09-10T20:56:15.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:15.908+0000 7fad1cc00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facfc0040b0 0x7fad180cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:15.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:15.908+0000 7fad1cc00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facfc0040b0 0x7fad180cf0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50168/0 (socket says 172.21.15.6:50168) 2024-09-10T20:56:15.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:15.908+0000 7fad1cc00640 1 -- 172.21.15.6:0/523639362 learned_addr learned my addr 172.21.15.6:0/523639362 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:15.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:15.909+0000 7fad0fe00640 1 --2- 172.21.15.6:0/523639362 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad181f5be0 0x7fad181f53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:15.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:15.909+0000 7fad1d600640 1 --2- 172.21.15.6:0/523639362 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad1806ef40 0x7fad181f74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:15.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:15.909+0000 7fad1cc00640 1 -- 172.21.15.6:0/523639362 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad1806ef40 msgr2=0x7fad181f74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:15.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:15.909+0000 7fad1cc00640 1 --2- 172.21.15.6:0/523639362 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad1806ef40 0x7fad181f74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:15.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:15.909+0000 7fad1cc00640 1 -- 172.21.15.6:0/523639362 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad181f5be0 msgr2=0x7fad181f53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:15.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:15.909+0000 7fad1cc00640 1 --2- 172.21.15.6:0/523639362 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad181f5be0 0x7fad181f53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:15.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:15.909+0000 7fad1cc00640 1 -- 172.21.15.6:0/523639362 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad180c4cd0 con 0x7facfc0040b0 2024-09-10T20:56:15.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:15.909+0000 7fad1d600640 1 --2- 172.21.15.6:0/523639362 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad1806ef40 0x7fad181f74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:56:15.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:15.909+0000 7fad1cc00640 1 --2- 172.21.15.6:0/523639362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facfc0040b0 0x7fad180cf0a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fad080066b0 tx=0x7fad080039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:15.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:15.909+0000 7fad15600640 1 -- 172.21.15.6:0/523639362 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0800f760 con 0x7facfc0040b0 2024-09-10T20:56:15.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:15.909+0000 7fad15600640 1 -- 172.21.15.6:0/523639362 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fad08016020 con 0x7facfc0040b0 2024-09-10T20:56:15.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:15.910+0000 7fad1e000640 1 -- 172.21.15.6:0/523639362 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad181f6060 con 0x7facfc0040b0 2024-09-10T20:56:15.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:15.910+0000 7fad15600640 1 -- 172.21.15.6:0/523639362 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0800fba0 con 0x7facfc0040b0 2024-09-10T20:56:15.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:15.910+0000 7fad1e000640 1 -- 172.21.15.6:0/523639362 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad180b7910 con 0x7facfc0040b0 2024-09-10T20:56:15.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:15.911+0000 7fad1e000640 1 -- 172.21.15.6:0/523639362 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad180698b0 con 0x7facfc0040b0 2024-09-10T20:56:15.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:15.912+0000 7fad15600640 1 -- 172.21.15.6:0/523639362 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fad08011430 con 0x7facfc0040b0 2024-09-10T20:56:15.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:15.913+0000 7fad15600640 1 --2- 172.21.15.6:0/523639362 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7facf4077f70 0x7facf407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:15.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:15.913+0000 7fad15600640 1 -- 172.21.15.6:0/523639362 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fad0809a880 con 0x7facfc0040b0 2024-09-10T20:56:15.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:15.913+0000 7fad0fe00640 1 --2- 172.21.15.6:0/523639362 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7facf4077f70 0x7facf407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:15.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:15.914+0000 7fad0fe00640 1 --2- 172.21.15.6:0/523639362 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7facf4077f70 0x7facf407a430 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fad00036000 tx=0x7fad0003e040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:15.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:15.917+0000 7fad15600640 1 -- 172.21.15.6:0/523639362 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fad180698b0 con 0x7facfc0040b0 2024-09-10T20:56:16.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.113+0000 7fad1e000640 1 -- 172.21.15.6:0/523639362 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fad180b3070 con 0x7facfc0040b0 2024-09-10T20:56:16.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.114+0000 7fad15600640 1 -- 172.21.15.6:0/523639362 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16605 (secure 0 0 0) 0x7fad08020020 con 0x7facfc0040b0 2024-09-10T20:56:16.118 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:56:16.118 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":22,"fsid":"9e04309e-61c3-4c78-82db-9576e465d98a","created":"2024-09-10T20:55:17.972466+0000","modified":"2024-09-10T20:55:45.353614+0000","last_up_change":"2024-09-10T20:55:32.392769+0000","last_in_change":"2024-09-10T20:55:22.232252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:55:33.196464+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:55:41.833420+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T20:55:42.749182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0918c5c8-a028-4987-bad2-406c412ec3f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6801","nonce":895515615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6803","nonce":895515615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6807","nonce":895515615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6805","nonce":895515615}]},"public_addr":"172.21.15.6:6801/895515615","cluster_addr":"172.21.15.6:6803/895515615","heartbeat_back_addr":"172.21.15.6:6807/895515615","heartbeat_front_addr":"172.21.15.6:6805/895515615","state":["exists","up"]},{"osd":1,"uuid":"415e9c78-c3d9-46d6-b277-348453f42155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6809","nonce":1129113250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6811","nonce":1129113250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6815","nonce":1129113250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6813","nonce":1129113250}]},"public_addr":"172.21.15.6:6809/1129113250","cluster_addr":"172.21.15.6:6811/1129113250","heartbeat_back_addr":"172.21.15.6:6815/1129113250","heartbeat_front_addr":"172.21.15.6:6813/1129113250","state":["exists","up"]},{"osd":2,"uuid":"763c1cf2-a43d-4c10-815d-eaf4a32afc1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6825","nonce":3847470051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6827","nonce":3847470051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6831","nonce":3847470051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6829","nonce":3847470051}]},"public_addr":"172.21.15.6:6825/3847470051","cluster_addr":"172.21.15.6:6827/3847470051","heartbeat_back_addr":"172.21.15.6:6831/3847470051","heartbeat_front_addr":"172.21.15.6:6829/3847470051","state":["exists","up"]},{"osd":3,"uuid":"877b1cc1-2434-4b32-af66-9c2485eac9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6817","nonce":3911674247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6819","nonce":3911674247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6823","nonce":3911674247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6821","nonce":3911674247}]},"public_addr":"172.21.15.6:6817/3911674247","cluster_addr":"172.21.15.6:6819/3911674247","heartbeat_back_addr":"172.21.15.6:6823/3911674247","heartbeat_front_addr":"172.21.15.6:6821/3911674247","state":["exists","up"]},{"osd":4,"uuid":"e0b27501-dfdc-4e7f-b73a-9573c869267a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6827","nonce":2568527750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6829","nonce":2568527750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6833","nonce":2568527750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6831","nonce":2568527750}]},"public_addr":"172.21.15.150:6827/2568527750","cluster_addr":"172.21.15.150:6829/2568527750","heartbeat_back_addr":"172.21.15.150:6833/2568527750","heartbeat_front_addr":"172.21.15.150:6831/2568527750","state":["exists","up"]},{"osd":5,"uuid":"67e48053-4f15-44fd-a30c-c9522f86d169","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6811","nonce":371417736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6813","nonce":371417736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6817","nonce":371417736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6815","nonce":371417736}]},"public_addr":"172.21.15.150:6811/371417736","cluster_addr":"172.21.15.150:6813/371417736","heartbeat_back_addr":"172.21.15.150:6817/371417736","heartbeat_front_addr":"172.21.15.150:6815/371417736","state":["exists","up"]},{"osd":6,"uuid":"1456df2e-ae91-45a4-bc3a-a06c753092af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6819","nonce":2329248366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6821","nonce":2329248366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6825","nonce":2329248366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6823","nonce":2329248366}]},"public_addr":"172.21.15.150:6819/2329248366","cluster_addr":"172.21.15.150:6821/2329248366","heartbeat_back_addr":"172.21.15.150:6825/2329248366","heartbeat_front_addr":"172.21.15.150:6823/2329248366","state":["exists","up"]},{"osd":7,"uuid":"a9daafcb-5ecd-43bd-ab0a-dc4b480cfc2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6803","nonce":527018351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6805","nonce":527018351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6809","nonce":527018351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6807","nonce":527018351}]},"public_addr":"172.21.15.150:6803/527018351","cluster_addr":"172.21.15.150:6805/527018351","heartbeat_back_addr":"172.21.15.150:6809/527018351","heartbeat_front_addr":"172.21.15.150:6807/527018351","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.710061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.024506+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.824320+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.431608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.637032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.054828+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.333290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.358875+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:56:16.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.116+0000 7fad1e000640 1 -- 172.21.15.6:0/523639362 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7facf4077f70 msgr2=0x7facf407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:16.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.116+0000 7fad1e000640 1 --2- 172.21.15.6:0/523639362 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7facf4077f70 0x7facf407a430 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fad00036000 tx=0x7fad0003e040 comp rx=0 tx=0).stop 2024-09-10T20:56:16.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.116+0000 7fad1e000640 1 -- 172.21.15.6:0/523639362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facfc0040b0 msgr2=0x7fad180cf0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:16.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.116+0000 7fad1e000640 1 --2- 172.21.15.6:0/523639362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facfc0040b0 0x7fad180cf0a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fad080066b0 tx=0x7fad080039c0 comp rx=0 tx=0).stop 2024-09-10T20:56:16.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.116+0000 7fad1e000640 1 -- 172.21.15.6:0/523639362 shutdown_connections 2024-09-10T20:56:16.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.116+0000 7fad1e000640 1 --2- 172.21.15.6:0/523639362 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7facf4077f70 0x7facf407a430 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:16.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.116+0000 7fad1e000640 1 --2- 172.21.15.6:0/523639362 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad1806ef40 0x7fad181f74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:16.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.116+0000 7fad1e000640 1 --2- 172.21.15.6:0/523639362 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad181f5be0 0x7fad181f53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:16.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.116+0000 7fad1e000640 1 --2- 172.21.15.6:0/523639362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facfc0040b0 0x7fad180cf0a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:16.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.116+0000 7fad1e000640 1 -- 172.21.15.6:0/523639362 >> 172.21.15.6:0/523639362 conn(0x7fad1809aa00 msgr2=0x7fad1815b450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:16.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.116+0000 7fad1e000640 1 -- 172.21.15.6:0/523639362 shutdown_connections 2024-09-10T20:56:16.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.116+0000 7fad1e000640 1 -- 172.21.15.6:0/523639362 wait complete. 2024-09-10T20:56:16.137 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T20:55:33.196464+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-10T20:55:41.833420+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-10T20:55:42.749182+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T20:56:16.138 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T20:56:16.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.297+0000 7fcfbbc00640 1 -- 172.21.15.6:0/1537861787 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfb4070450 msgr2=0x7fcfb40cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:16.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.297+0000 7fcfbbc00640 1 --2- 172.21.15.6:0/1537861787 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfb4070450 0x7fcfb40cd920 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcfac005fd0 tx=0x7fcfac02a820 comp rx=0 tx=0).stop 2024-09-10T20:56:16.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.297+0000 7fcfbbc00640 1 -- 172.21.15.6:0/1537861787 shutdown_connections 2024-09-10T20:56:16.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.297+0000 7fcfbbc00640 1 --2- 172.21.15.6:0/1537861787 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfb4070450 0x7fcfb40cd920 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:16.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.297+0000 7fcfbbc00640 1 --2- 172.21.15.6:0/1537861787 >> v2:172.21.15.150:3300/0 conn(0x7fcfb4159670 0x7fcfb40743b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:16.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.297+0000 7fcfbbc00640 1 -- 172.21.15.6:0/1537861787 >> 172.21.15.6:0/1537861787 conn(0x7fcfb40cfa20 msgr2=0x7fcfb40cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:16.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.297+0000 7fcfbbc00640 1 -- 172.21.15.6:0/1537861787 shutdown_connections 2024-09-10T20:56:16.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.297+0000 7fcfbbc00640 1 -- 172.21.15.6:0/1537861787 wait complete. 2024-09-10T20:56:16.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.299+0000 7fcfbbc00640 1 Processor -- start 2024-09-10T20:56:16.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.299+0000 7fcfbbc00640 1 -- start start 2024-09-10T20:56:16.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.300+0000 7fcfbbc00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcfb4070450 0x7fcfb4151060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:16.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.300+0000 7fcfbbc00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfb4159670 0x7fcfb40c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:16.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.300+0000 7fcfbbc00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfb415c170 0x7fcfb415acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:16.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.300+0000 7fcfbbc00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb40b4ca0 con 0x7fcfb4159670 2024-09-10T20:56:16.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.300+0000 7fcfbbc00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb40b4b20 con 0x7fcfb4070450 2024-09-10T20:56:16.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.300+0000 7fcfbbc00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fcfb40b4e20 con 0x7fcfb415c170 2024-09-10T20:56:16.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.300+0000 7fcfabe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfb4159670 0x7fcfb40c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:16.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.300+0000 7fcfabe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfb4159670 0x7fcfb40c7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50174/0 (socket says 172.21.15.6:50174) 2024-09-10T20:56:16.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.300+0000 7fcfabe00640 1 -- 172.21.15.6:0/3320769760 learned_addr learned my addr 172.21.15.6:0/3320769760 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:16.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.300+0000 7fcfb9200640 1 --2- 172.21.15.6:0/3320769760 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcfb4070450 0x7fcfb4151060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:16.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.300+0000 7fcfb9c00640 1 --2- 172.21.15.6:0/3320769760 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfb415c170 0x7fcfb415acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:16.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.301+0000 7fcfabe00640 1 -- 172.21.15.6:0/3320769760 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfb415c170 msgr2=0x7fcfb415acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:16.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.301+0000 7fcfabe00640 1 --2- 172.21.15.6:0/3320769760 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfb415c170 0x7fcfb415acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:16.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.301+0000 7fcfabe00640 1 -- 172.21.15.6:0/3320769760 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcfb4070450 msgr2=0x7fcfb4151060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:16.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.301+0000 7fcfabe00640 1 --2- 172.21.15.6:0/3320769760 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcfb4070450 0x7fcfb4151060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:16.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.301+0000 7fcfabe00640 1 -- 172.21.15.6:0/3320769760 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfb41f62d0 con 0x7fcfb4159670 2024-09-10T20:56:16.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.301+0000 7fcfb9c00640 1 --2- 172.21.15.6:0/3320769760 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfb415c170 0x7fcfb415acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:56:16.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.301+0000 7fcfabe00640 1 --2- 172.21.15.6:0/3320769760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfb4159670 0x7fcfb40c7b30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c00c420 tx=0x7fcf9c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:16.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.301+0000 7fcfb1600640 1 -- 172.21.15.6:0/3320769760 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c011790 con 0x7fcfb4159670 2024-09-10T20:56:16.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.301+0000 7fcfb1600640 1 -- 172.21.15.6:0/3320769760 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf9c017070 con 0x7fcfb4159670 2024-09-10T20:56:16.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.301+0000 7fcfb1600640 1 -- 172.21.15.6:0/3320769760 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c011c80 con 0x7fcfb4159670 2024-09-10T20:56:16.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.301+0000 7fcfbbc00640 1 -- 172.21.15.6:0/3320769760 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfb41f65b0 con 0x7fcfb4159670 2024-09-10T20:56:16.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.301+0000 7fcfbbc00640 1 -- 172.21.15.6:0/3320769760 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfb41f6b70 con 0x7fcfb4159670 2024-09-10T20:56:16.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.302+0000 7fcfbbc00640 1 -- 172.21.15.6:0/3320769760 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfb40b5340 con 0x7fcfb4159670 2024-09-10T20:56:16.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.304+0000 7fcfb1600640 1 -- 172.21.15.6:0/3320769760 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fcf9c01c460 con 0x7fcfb4159670 2024-09-10T20:56:16.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.304+0000 7fcfb1600640 1 --2- 172.21.15.6:0/3320769760 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fcf90077f70 0x7fcf9007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:16.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.305+0000 7fcfb1600640 1 -- 172.21.15.6:0/3320769760 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fcf9c099ab0 con 0x7fcfb4159670 2024-09-10T20:56:16.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.305+0000 7fcfb9200640 1 --2- 172.21.15.6:0/3320769760 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fcf90077f70 0x7fcf9007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:16.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.306+0000 7fcfb9200640 1 --2- 172.21.15.6:0/3320769760 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fcf90077f70 0x7fcf9007a430 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4009bd0 tx=0x7fcfa4005f90 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:16.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.309+0000 7fcfb1600640 1 -- 172.21.15.6:0/3320769760 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fcf9c061ed0 con 0x7fcfb4159670 2024-09-10T20:56:16.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.509+0000 7fcfbbc00640 1 -- 172.21.15.6:0/3320769760 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcfb4069d20 con 0x7fcfb4159670 2024-09-10T20:56:16.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.509+0000 7fcfb1600640 1 -- 172.21.15.6:0/3320769760 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7fcf9c066900 con 0x7fcfb4159670 2024-09-10T20:56:16.514 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-09-10T20:56:16.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.512+0000 7fcfbbc00640 1 -- 172.21.15.6:0/3320769760 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fcf90077f70 msgr2=0x7fcf9007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:16.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.512+0000 7fcfbbc00640 1 --2- 172.21.15.6:0/3320769760 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fcf90077f70 0x7fcf9007a430 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4009bd0 tx=0x7fcfa4005f90 comp rx=0 tx=0).stop 2024-09-10T20:56:16.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.512+0000 7fcfbbc00640 1 -- 172.21.15.6:0/3320769760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfb4159670 msgr2=0x7fcfb40c7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:16.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.512+0000 7fcfbbc00640 1 --2- 172.21.15.6:0/3320769760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfb4159670 0x7fcfb40c7b30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c00c420 tx=0x7fcf9c00c8e0 comp rx=0 tx=0).stop 2024-09-10T20:56:16.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.512+0000 7fcfbbc00640 1 -- 172.21.15.6:0/3320769760 shutdown_connections 2024-09-10T20:56:16.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.512+0000 7fcfbbc00640 1 --2- 172.21.15.6:0/3320769760 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fcf90077f70 0x7fcf9007a430 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:16.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.512+0000 7fcfbbc00640 1 --2- 172.21.15.6:0/3320769760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfb4159670 0x7fcfb40c7b30 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:16.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.512+0000 7fcfbbc00640 1 --2- 172.21.15.6:0/3320769760 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfb415c170 0x7fcfb415acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:16.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.512+0000 7fcfbbc00640 1 --2- 172.21.15.6:0/3320769760 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcfb4070450 0x7fcfb4151060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:16.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.512+0000 7fcfbbc00640 1 -- 172.21.15.6:0/3320769760 >> 172.21.15.6:0/3320769760 conn(0x7fcfb40cfa20 msgr2=0x7fcfb40740f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:16.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.512+0000 7fcfbbc00640 1 -- 172.21.15.6:0/3320769760 shutdown_connections 2024-09-10T20:56:16.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.512+0000 7fcfbbc00640 1 -- 172.21.15.6:0/3320769760 wait complete. 2024-09-10T20:56:16.531 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-10T20:56:16.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.691+0000 7ff58a200640 1 -- 172.21.15.6:0/4213884357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff584070450 msgr2=0x7ff5840cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:16.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.691+0000 7ff58a200640 1 --2- 172.21.15.6:0/4213884357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff584070450 0x7ff5840cd920 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff57c005fd0 tx=0x7ff57c02a820 comp rx=0 tx=0).stop 2024-09-10T20:56:16.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.691+0000 7ff58a200640 1 -- 172.21.15.6:0/4213884357 shutdown_connections 2024-09-10T20:56:16.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.691+0000 7ff58a200640 1 --2- 172.21.15.6:0/4213884357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff584070450 0x7ff5840cd920 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:16.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.691+0000 7ff58a200640 1 --2- 172.21.15.6:0/4213884357 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff58415c170 0x7ff5840743b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:16.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.691+0000 7ff58a200640 1 -- 172.21.15.6:0/4213884357 >> 172.21.15.6:0/4213884357 conn(0x7ff5840cfa20 msgr2=0x7ff5840cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:16.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.691+0000 7ff58a200640 1 -- 172.21.15.6:0/4213884357 shutdown_connections 2024-09-10T20:56:16.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.691+0000 7ff58a200640 1 -- 172.21.15.6:0/4213884357 wait complete. 2024-09-10T20:56:16.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.693+0000 7ff58a200640 1 Processor -- start 2024-09-10T20:56:16.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.693+0000 7ff58a200640 1 -- start start 2024-09-10T20:56:16.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.694+0000 7ff58a200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff584070450 0x7ff5840aff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:16.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.694+0000 7ff58a200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff584159670 0x7ff58415d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:16.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.694+0000 7ff58a200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff58415c170 0x7ff5841f7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:16.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.694+0000 7ff58a200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff5840b4a90 con 0x7ff58415c170 2024-09-10T20:56:16.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.694+0000 7ff58a200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff5840b4910 con 0x7ff584070450 2024-09-10T20:56:16.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.694+0000 7ff58a200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ff5840b4c10 con 0x7ff584159670 2024-09-10T20:56:16.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.694+0000 7ff583e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff58415c170 0x7ff5841f7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:16.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.695+0000 7ff583400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff584070450 0x7ff5840aff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:16.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.695+0000 7ff583e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff58415c170 0x7ff5841f7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50180/0 (socket says 172.21.15.6:50180) 2024-09-10T20:56:16.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.695+0000 7ff583e00640 1 -- 172.21.15.6:0/2092418230 learned_addr learned my addr 172.21.15.6:0/2092418230 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:16.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.695+0000 7ff57aa00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff584159670 0x7ff58415d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:16.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.695+0000 7ff583e00640 1 -- 172.21.15.6:0/2092418230 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff584159670 msgr2=0x7ff58415d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:16.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.695+0000 7ff583e00640 1 --2- 172.21.15.6:0/2092418230 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff584159670 0x7ff58415d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:16.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.695+0000 7ff583e00640 1 -- 172.21.15.6:0/2092418230 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff584070450 msgr2=0x7ff5840aff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:16.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.695+0000 7ff583e00640 1 --2- 172.21.15.6:0/2092418230 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff584070450 0x7ff5840aff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:16.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.695+0000 7ff583e00640 1 -- 172.21.15.6:0/2092418230 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff58415e200 con 0x7ff58415c170 2024-09-10T20:56:16.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.695+0000 7ff57aa00640 1 --2- 172.21.15.6:0/2092418230 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff584159670 0x7ff58415d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:56:16.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.695+0000 7ff583400640 1 --2- 172.21.15.6:0/2092418230 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff584070450 0x7ff5840aff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:56:16.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.695+0000 7ff583e00640 1 --2- 172.21.15.6:0/2092418230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff58415c170 0x7ff5841f7e20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff57c035040 tx=0x7ff57c032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:16.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.696+0000 7ff57be00640 1 -- 172.21.15.6:0/2092418230 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff57c037040 con 0x7ff58415c170 2024-09-10T20:56:16.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.696+0000 7ff57be00640 1 -- 172.21.15.6:0/2092418230 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff57c042070 con 0x7ff58415c170 2024-09-10T20:56:16.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.696+0000 7ff57be00640 1 -- 172.21.15.6:0/2092418230 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff57c003e60 con 0x7ff58415c170 2024-09-10T20:56:16.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.696+0000 7ff58a200640 1 -- 172.21.15.6:0/2092418230 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff58415e4e0 con 0x7ff58415c170 2024-09-10T20:56:16.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.696+0000 7ff58a200640 1 -- 172.21.15.6:0/2092418230 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff58415eaa0 con 0x7ff58415c170 2024-09-10T20:56:16.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.697+0000 7ff58a200640 1 -- 172.21.15.6:0/2092418230 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5840b5170 con 0x7ff58415c170 2024-09-10T20:56:16.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.698+0000 7ff57be00640 1 -- 172.21.15.6:0/2092418230 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff57c03a030 con 0x7ff58415c170 2024-09-10T20:56:16.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.699+0000 7ff57be00640 1 --2- 172.21.15.6:0/2092418230 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ff560077f70 0x7ff56007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:16.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.699+0000 7ff57be00640 1 -- 172.21.15.6:0/2092418230 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ff57c0ba500 con 0x7ff58415c170 2024-09-10T20:56:16.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.699+0000 7ff583400640 1 --2- 172.21.15.6:0/2092418230 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ff560077f70 0x7ff56007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:16.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.700+0000 7ff583400640 1 --2- 172.21.15.6:0/2092418230 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ff560077f70 0x7ff56007a430 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff574007f20 tx=0x7ff574007eb0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:16.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.703+0000 7ff57be00640 1 -- 172.21.15.6:0/2092418230 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff57c0829a0 con 0x7ff58415c170 2024-09-10T20:56:16.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.894+0000 7ff58a200640 1 -- 172.21.15.6:0/2092418230 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff584069d20 con 0x7ff58415c170 2024-09-10T20:56:16.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.895+0000 7ff57be00640 1 -- 172.21.15.6:0/2092418230 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7ff57c0873d0 con 0x7ff58415c170 2024-09-10T20:56:16.899 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-09-10T20:56:16.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.897+0000 7ff58a200640 1 -- 172.21.15.6:0/2092418230 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ff560077f70 msgr2=0x7ff56007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:16.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.897+0000 7ff58a200640 1 --2- 172.21.15.6:0/2092418230 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ff560077f70 0x7ff56007a430 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff574007f20 tx=0x7ff574007eb0 comp rx=0 tx=0).stop 2024-09-10T20:56:16.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.897+0000 7ff58a200640 1 -- 172.21.15.6:0/2092418230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff58415c170 msgr2=0x7ff5841f7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:16.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.897+0000 7ff58a200640 1 --2- 172.21.15.6:0/2092418230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff58415c170 0x7ff5841f7e20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff57c035040 tx=0x7ff57c032c60 comp rx=0 tx=0).stop 2024-09-10T20:56:16.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.897+0000 7ff58a200640 1 -- 172.21.15.6:0/2092418230 shutdown_connections 2024-09-10T20:56:16.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.897+0000 7ff58a200640 1 --2- 172.21.15.6:0/2092418230 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ff560077f70 0x7ff56007a430 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:16.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.897+0000 7ff58a200640 1 --2- 172.21.15.6:0/2092418230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff58415c170 0x7ff5841f7e20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:16.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.897+0000 7ff58a200640 1 --2- 172.21.15.6:0/2092418230 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff584159670 0x7ff58415d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:16.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.897+0000 7ff58a200640 1 --2- 172.21.15.6:0/2092418230 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff584070450 0x7ff5840aff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:16.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.897+0000 7ff58a200640 1 -- 172.21.15.6:0/2092418230 >> 172.21.15.6:0/2092418230 conn(0x7ff5840cfa20 msgr2=0x7ff5840cebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:16.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.897+0000 7ff58a200640 1 -- 172.21.15.6:0/2092418230 shutdown_connections 2024-09-10T20:56:16.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:16.897+0000 7ff58a200640 1 -- 172.21.15.6:0/2092418230 wait complete. 2024-09-10T20:56:16.917 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-10T20:56:17.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.076+0000 7f7a7f200640 1 -- 172.21.15.6:0/4010421375 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7a7815dcb0 msgr2=0x7f7a780d0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:17.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.076+0000 7f7a7f200640 1 --2- 172.21.15.6:0/4010421375 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7a7815dcb0 0x7f7a780d0f60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c009830 tx=0x7f7a6c02a5b0 comp rx=0 tx=0).stop 2024-09-10T20:56:17.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.076+0000 7f7a7f200640 1 -- 172.21.15.6:0/4010421375 shutdown_connections 2024-09-10T20:56:17.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.076+0000 7f7a7f200640 1 --2- 172.21.15.6:0/4010421375 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7a7815dcb0 0x7f7a780d0f60 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:17.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.076+0000 7f7a7f200640 1 -- 172.21.15.6:0/4010421375 >> 172.21.15.6:0/4010421375 conn(0x7f7a7809d100 msgr2=0x7f7a780d3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:17.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.076+0000 7f7a7f200640 1 -- 172.21.15.6:0/4010421375 shutdown_connections 2024-09-10T20:56:17.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.076+0000 7f7a7f200640 1 -- 172.21.15.6:0/4010421375 wait complete. 2024-09-10T20:56:17.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.078+0000 7f7a7f200640 1 Processor -- start 2024-09-10T20:56:17.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.078+0000 7f7a7f200640 1 -- start start 2024-09-10T20:56:17.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.079+0000 7f7a7f200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a780cf7a0 0x7f7a781f5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:17.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.079+0000 7f7a7f200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a7815dcb0 0x7f7a7815e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:17.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.079+0000 7f7a7f200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7a7815e090 0x7f7a781f8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:17.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.079+0000 7f7a7f200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7a780b6e50 con 0x7f7a780cf7a0 2024-09-10T20:56:17.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.079+0000 7f7a7f200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7a78162370 con 0x7f7a7815e090 2024-09-10T20:56:17.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.079+0000 7f7a7f200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f7a780b6fd0 con 0x7f7a7815dcb0 2024-09-10T20:56:17.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.079+0000 7f7a7de00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a780cf7a0 0x7f7a781f5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:17.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.079+0000 7f7a7de00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a780cf7a0 0x7f7a781f5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50192/0 (socket says 172.21.15.6:50192) 2024-09-10T20:56:17.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.079+0000 7f7a7de00640 1 -- 172.21.15.6:0/4202676013 learned_addr learned my addr 172.21.15.6:0/4202676013 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:17.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.080+0000 7f7a7d400640 1 --2- 172.21.15.6:0/4202676013 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a7815dcb0 0x7f7a7815e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:17.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.080+0000 7f7a7e800640 1 --2- 172.21.15.6:0/4202676013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7a7815e090 0x7f7a781f8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:17.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.080+0000 7f7a7de00640 1 -- 172.21.15.6:0/4202676013 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a7815dcb0 msgr2=0x7f7a7815e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:17.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.080+0000 7f7a7de00640 1 --2- 172.21.15.6:0/4202676013 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a7815dcb0 0x7f7a7815e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:17.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.080+0000 7f7a7de00640 1 -- 172.21.15.6:0/4202676013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7a7815e090 msgr2=0x7f7a781f8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:17.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.080+0000 7f7a7de00640 1 --2- 172.21.15.6:0/4202676013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7a7815e090 0x7f7a781f8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:17.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.080+0000 7f7a7de00640 1 -- 172.21.15.6:0/4202676013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a7815afd0 con 0x7f7a780cf7a0 2024-09-10T20:56:17.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.080+0000 7f7a7de00640 1 --2- 172.21.15.6:0/4202676013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a780cf7a0 0x7f7a781f5c20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c009950 tx=0x7f7a6c032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:17.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.080+0000 7f7a72000640 1 -- 172.21.15.6:0/4202676013 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c040070 con 0x7f7a780cf7a0 2024-09-10T20:56:17.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.081+0000 7f7a7f200640 1 -- 172.21.15.6:0/4202676013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a7815eb80 con 0x7f7a780cf7a0 2024-09-10T20:56:17.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.081+0000 7f7a72000640 1 -- 172.21.15.6:0/4202676013 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7a6c0038e0 con 0x7f7a780cf7a0 2024-09-10T20:56:17.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.081+0000 7f7a72000640 1 -- 172.21.15.6:0/4202676013 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c003d30 con 0x7f7a780cf7a0 2024-09-10T20:56:17.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.081+0000 7f7a7f200640 1 -- 172.21.15.6:0/4202676013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a7815b570 con 0x7f7a780cf7a0 2024-09-10T20:56:17.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.082+0000 7f7a7f200640 1 -- 172.21.15.6:0/4202676013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a780b7480 con 0x7f7a780cf7a0 2024-09-10T20:56:17.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.083+0000 7f7a72000640 1 -- 172.21.15.6:0/4202676013 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f7a6c045670 con 0x7f7a780cf7a0 2024-09-10T20:56:17.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.084+0000 7f7a72000640 1 --2- 172.21.15.6:0/4202676013 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f7a5c077f70 0x7f7a5c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:17.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.084+0000 7f7a72000640 1 -- 172.21.15.6:0/4202676013 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f7a6c0bb800 con 0x7f7a780cf7a0 2024-09-10T20:56:17.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.084+0000 7f7a7d400640 1 --2- 172.21.15.6:0/4202676013 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f7a5c077f70 0x7f7a5c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:17.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.085+0000 7f7a7d400640 1 --2- 172.21.15.6:0/4202676013 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f7a5c077f70 0x7f7a5c07a430 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7a7815d380 tx=0x7f7a68009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:17.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.088+0000 7f7a72000640 1 -- 172.21.15.6:0/4202676013 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f7a6c0841e0 con 0x7f7a780cf7a0 2024-09-10T20:56:17.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.280+0000 7f7a7f200640 1 -- 172.21.15.6:0/4202676013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f7a780d4500 con 0x7f7a780cf7a0 2024-09-10T20:56:17.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.281+0000 7f7a72000640 1 -- 172.21.15.6:0/4202676013 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f7a6c083ae0 con 0x7f7a780cf7a0 2024-09-10T20:56:17.285 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-09-10T20:56:17.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.283+0000 7f7a7f200640 1 -- 172.21.15.6:0/4202676013 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f7a5c077f70 msgr2=0x7f7a5c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:17.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.283+0000 7f7a7f200640 1 --2- 172.21.15.6:0/4202676013 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f7a5c077f70 0x7f7a5c07a430 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7a7815d380 tx=0x7f7a68009040 comp rx=0 tx=0).stop 2024-09-10T20:56:17.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.283+0000 7f7a7f200640 1 -- 172.21.15.6:0/4202676013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a780cf7a0 msgr2=0x7f7a781f5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:17.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.283+0000 7f7a7f200640 1 --2- 172.21.15.6:0/4202676013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a780cf7a0 0x7f7a781f5c20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c009950 tx=0x7f7a6c032c10 comp rx=0 tx=0).stop 2024-09-10T20:56:17.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.283+0000 7f7a7f200640 1 -- 172.21.15.6:0/4202676013 shutdown_connections 2024-09-10T20:56:17.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.283+0000 7f7a7f200640 1 --2- 172.21.15.6:0/4202676013 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f7a5c077f70 0x7f7a5c07a430 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:17.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.283+0000 7f7a7f200640 1 --2- 172.21.15.6:0/4202676013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7a7815e090 0x7f7a781f8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:17.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.283+0000 7f7a7f200640 1 --2- 172.21.15.6:0/4202676013 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a7815dcb0 0x7f7a7815e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:17.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.283+0000 7f7a7f200640 1 --2- 172.21.15.6:0/4202676013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a780cf7a0 0x7f7a781f5c20 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:17.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.283+0000 7f7a7f200640 1 -- 172.21.15.6:0/4202676013 >> 172.21.15.6:0/4202676013 conn(0x7f7a7809d100 msgr2=0x7f7a780b7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:17.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.283+0000 7f7a7f200640 1 -- 172.21.15.6:0/4202676013 shutdown_connections 2024-09-10T20:56:17.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.283+0000 7f7a7f200640 1 -- 172.21.15.6:0/4202676013 wait complete. 2024-09-10T20:56:17.302 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_backtrace.TestBacktrace.test_backtrace' 2024-09-10T20:56:17.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.458+0000 7fcd82400640 1 -- 172.21.15.6:0/1696297170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd7c072f70 msgr2=0x7fcd7c06e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:17.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.458+0000 7fcd82400640 1 --2- 172.21.15.6:0/1696297170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd7c072f70 0x7fcd7c06e560 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c0ce940 tx=0x7fcd6402a510 comp rx=0 tx=0).stop 2024-09-10T20:56:17.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.458+0000 7fcd82400640 1 -- 172.21.15.6:0/1696297170 shutdown_connections 2024-09-10T20:56:17.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.458+0000 7fcd82400640 1 --2- 172.21.15.6:0/1696297170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd7c072f70 0x7fcd7c06e560 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:17.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.458+0000 7fcd82400640 1 -- 172.21.15.6:0/1696297170 >> 172.21.15.6:0/1696297170 conn(0x7fcd7c0b1660 msgr2=0x7fcd7c0b1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:17.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.458+0000 7fcd82400640 1 -- 172.21.15.6:0/1696297170 shutdown_connections 2024-09-10T20:56:17.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.458+0000 7fcd82400640 1 -- 172.21.15.6:0/1696297170 wait complete. 2024-09-10T20:56:17.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.460+0000 7fcd82400640 1 Processor -- start 2024-09-10T20:56:17.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.460+0000 7fcd82400640 1 -- start start 2024-09-10T20:56:17.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.461+0000 7fcd82400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd7c072f70 0x7fcd7c1e4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:17.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.461+0000 7fcd82400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd7c152c00 0x7fcd7c1f8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:17.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.461+0000 7fcd82400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd7c15f780 0x7fcd7c139ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:17.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.461+0000 7fcd82400640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcd7c0cf7a0 con 0x7fcd7c15f780 2024-09-10T20:56:17.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.461+0000 7fcd82400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fcd7c0cf620 con 0x7fcd7c072f70 2024-09-10T20:56:17.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.461+0000 7fcd82400640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fcd7c15fbb0 con 0x7fcd7c152c00 2024-09-10T20:56:17.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.461+0000 7fcd7be00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd7c15f780 0x7fcd7c139ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:17.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.461+0000 7fcd7be00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd7c15f780 0x7fcd7c139ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50204/0 (socket says 172.21.15.6:50204) 2024-09-10T20:56:17.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.461+0000 7fcd7be00640 1 -- 172.21.15.6:0/2454017874 learned_addr learned my addr 172.21.15.6:0/2454017874 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:17.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.461+0000 7fcd7b400640 1 --2- 172.21.15.6:0/2454017874 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd7c072f70 0x7fcd7c1e4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:17.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.461+0000 7fcd72a00640 1 --2- 172.21.15.6:0/2454017874 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd7c152c00 0x7fcd7c1f8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:17.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.462+0000 7fcd7be00640 1 -- 172.21.15.6:0/2454017874 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd7c152c00 msgr2=0x7fcd7c1f8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:17.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.462+0000 7fcd7be00640 1 --2- 172.21.15.6:0/2454017874 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd7c152c00 0x7fcd7c1f8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:17.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.462+0000 7fcd7be00640 1 -- 172.21.15.6:0/2454017874 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd7c072f70 msgr2=0x7fcd7c1e4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:17.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.462+0000 7fcd7be00640 1 --2- 172.21.15.6:0/2454017874 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd7c072f70 0x7fcd7c1e4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:17.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.462+0000 7fcd7be00640 1 -- 172.21.15.6:0/2454017874 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd7c157720 con 0x7fcd7c15f780 2024-09-10T20:56:17.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.462+0000 7fcd7be00640 1 --2- 172.21.15.6:0/2454017874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd7c15f780 0x7fcd7c139ab0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcd7400c6c0 tx=0x7fcd7400cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:17.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.462+0000 7fcd73e00640 1 -- 172.21.15.6:0/2454017874 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd74017070 con 0x7fcd7c15f780 2024-09-10T20:56:17.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.462+0000 7fcd73e00640 1 -- 172.21.15.6:0/2454017874 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd74003c60 con 0x7fcd7c15f780 2024-09-10T20:56:17.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.462+0000 7fcd73e00640 1 -- 172.21.15.6:0/2454017874 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd740052d0 con 0x7fcd7c15f780 2024-09-10T20:56:17.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.462+0000 7fcd82400640 1 -- 172.21.15.6:0/2454017874 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd7c1e5500 con 0x7fcd7c15f780 2024-09-10T20:56:17.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.462+0000 7fcd82400640 1 -- 172.21.15.6:0/2454017874 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd7c157f80 con 0x7fcd7c15f780 2024-09-10T20:56:17.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.463+0000 7fcd82400640 1 -- 172.21.15.6:0/2454017874 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd7c157ad0 con 0x7fcd7c15f780 2024-09-10T20:56:17.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.465+0000 7fcd73e00640 1 -- 172.21.15.6:0/2454017874 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fcd74005470 con 0x7fcd7c15f780 2024-09-10T20:56:17.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.466+0000 7fcd73e00640 1 --2- 172.21.15.6:0/2454017874 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fcd58077fa0 0x7fcd5807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:17.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.466+0000 7fcd73e00640 1 -- 172.21.15.6:0/2454017874 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fcd74099690 con 0x7fcd7c15f780 2024-09-10T20:56:17.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.467+0000 7fcd7b400640 1 --2- 172.21.15.6:0/2454017874 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fcd58077fa0 0x7fcd5807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:17.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.467+0000 7fcd7b400640 1 --2- 172.21.15.6:0/2454017874 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fcd58077fa0 0x7fcd5807a460 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c004f60 tx=0x7fcd6c007e30 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:17.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.470+0000 7fcd73e00640 1 -- 172.21.15.6:0/2454017874 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fcd74061aa0 con 0x7fcd7c15f780 2024-09-10T20:56:17.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:17.738+0000 7fcd82400640 1 -- 172.21.15.6:0/2454017874 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_backtrace.TestBacktrace.test_backtrace"]} v 0) -- 0x7fcd7c1600a0 con 0x7fcd7c15f780 2024-09-10T20:56:18.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.477+0000 7fcd73e00640 1 -- 172.21.15.6:0/2454017874 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_backtrace.TestBacktrace.test_backtrace"]}]=0 v55) ==== 138+0+0 (secure 0 0 0) 0x7fcd740664d0 con 0x7fcd7c15f780 2024-09-10T20:56:18.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.480+0000 7fcd82400640 1 -- 172.21.15.6:0/2454017874 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fcd58077fa0 msgr2=0x7fcd5807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:18.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.480+0000 7fcd82400640 1 --2- 172.21.15.6:0/2454017874 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fcd58077fa0 0x7fcd5807a460 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c004f60 tx=0x7fcd6c007e30 comp rx=0 tx=0).stop 2024-09-10T20:56:18.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.480+0000 7fcd82400640 1 -- 172.21.15.6:0/2454017874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd7c15f780 msgr2=0x7fcd7c139ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:18.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.480+0000 7fcd82400640 1 --2- 172.21.15.6:0/2454017874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd7c15f780 0x7fcd7c139ab0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcd7400c6c0 tx=0x7fcd7400cb80 comp rx=0 tx=0).stop 2024-09-10T20:56:18.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.480+0000 7fcd82400640 1 -- 172.21.15.6:0/2454017874 shutdown_connections 2024-09-10T20:56:18.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.480+0000 7fcd82400640 1 --2- 172.21.15.6:0/2454017874 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fcd58077fa0 0x7fcd5807a460 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:18.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.480+0000 7fcd82400640 1 --2- 172.21.15.6:0/2454017874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd7c15f780 0x7fcd7c139ab0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:18.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.481+0000 7fcd82400640 1 --2- 172.21.15.6:0/2454017874 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd7c152c00 0x7fcd7c1f8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:18.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.481+0000 7fcd82400640 1 --2- 172.21.15.6:0/2454017874 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd7c072f70 0x7fcd7c1e4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:18.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.481+0000 7fcd82400640 1 -- 172.21.15.6:0/2454017874 >> 172.21.15.6:0/2454017874 conn(0x7fcd7c0b1660 msgr2=0x7fcd7c14e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:18.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.481+0000 7fcd82400640 1 -- 172.21.15.6:0/2454017874 shutdown_connections 2024-09-10T20:56:18.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.481+0000 7fcd82400640 1 -- 172.21.15.6:0/2454017874 wait complete. 2024-09-10T20:56:18.503 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-10T20:56:18.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.664+0000 7f05cca00640 1 -- 172.21.15.6:0/4044802972 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05ac004d40 msgr2=0x7f05ac0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:18.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.664+0000 7f05cca00640 1 --2- 172.21.15.6:0/4044802972 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05ac004d40 0x7f05ac0051c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f05c000c660 tx=0x7f05ac005830 comp rx=0 tx=0).stop 2024-09-10T20:56:18.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.664+0000 7f05c7200640 1 -- 172.21.15.6:0/4044802972 reap_dead start 2024-09-10T20:56:18.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.665+0000 7f05cca00640 1 -- 172.21.15.6:0/4044802972 shutdown_connections 2024-09-10T20:56:18.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.665+0000 7f05cca00640 1 -- 172.21.15.6:0/4044802972 >> 172.21.15.6:0/4044802972 conn(0x7f05c806cf90 msgr2=0x7f05c806d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:18.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.665+0000 7f05cca00640 1 -- 172.21.15.6:0/4044802972 shutdown_connections 2024-09-10T20:56:18.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.665+0000 7f05cca00640 1 -- 172.21.15.6:0/4044802972 wait complete. 2024-09-10T20:56:18.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.666+0000 7f05cca00640 1 Processor -- start 2024-09-10T20:56:18.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.667+0000 7f05cca00640 1 -- start start 2024-09-10T20:56:18.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.667+0000 7f05cca00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05ac004d40 0x7f05c80af3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:18.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.667+0000 7f05cca00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05c815d680 0x7f05c80b1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:18.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.667+0000 7f05cca00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05c8156610 0x7f05c8156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:18.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.667+0000 7f05cca00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f05c806e5c0 con 0x7f05c8156610 2024-09-10T20:56:18.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.667+0000 7f05cca00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f05c8073490 con 0x7f05ac004d40 2024-09-10T20:56:18.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.667+0000 7f05cca00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f05c806e740 con 0x7f05c815d680 2024-09-10T20:56:18.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.668+0000 7f05c7200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05c8156610 0x7f05c8156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:18.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.668+0000 7f05c7200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05c8156610 0x7f05c8156aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52316/0 (socket says 172.21.15.6:52316) 2024-09-10T20:56:18.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.668+0000 7f05c7200640 1 -- 172.21.15.6:0/3830687363 learned_addr learned my addr 172.21.15.6:0/3830687363 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:18.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.668+0000 7f05bde00640 1 --2- 172.21.15.6:0/3830687363 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05c815d680 0x7f05c80b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:18.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.668+0000 7f05c7200640 1 -- 172.21.15.6:0/3830687363 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05c815d680 msgr2=0x7f05c80b1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:18.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.668+0000 7f05c7200640 1 --2- 172.21.15.6:0/3830687363 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05c815d680 0x7f05c80b1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:18.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.668+0000 7f05c6800640 1 --2- 172.21.15.6:0/3830687363 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05ac004d40 0x7f05c80af3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:18.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.668+0000 7f05c7200640 1 -- 172.21.15.6:0/3830687363 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05ac004d40 msgr2=0x7f05c80af3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:18.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.668+0000 7f05c7200640 1 --2- 172.21.15.6:0/3830687363 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05ac004d40 0x7f05c80af3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:18.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.668+0000 7f05c7200640 1 -- 172.21.15.6:0/3830687363 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05c81f7f50 con 0x7f05c8156610 2024-09-10T20:56:18.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.668+0000 7f05c6800640 1 --2- 172.21.15.6:0/3830687363 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05ac004d40 0x7f05c80af3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:56:18.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.668+0000 7f05c7200640 1 --2- 172.21.15.6:0/3830687363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05c8156610 0x7f05c8156aa0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f05c000c780 tx=0x7f05c0001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:18.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.669+0000 7f05bf400640 1 -- 172.21.15.6:0/3830687363 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c0039070 con 0x7f05c8156610 2024-09-10T20:56:18.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.669+0000 7f05bf400640 1 -- 172.21.15.6:0/3830687363 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f05c002bc10 con 0x7f05c8156610 2024-09-10T20:56:18.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.669+0000 7f05bf400640 1 -- 172.21.15.6:0/3830687363 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c000c280 con 0x7f05c8156610 2024-09-10T20:56:18.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.669+0000 7f05cca00640 1 -- 172.21.15.6:0/3830687363 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05c81f8230 con 0x7f05c8156610 2024-09-10T20:56:18.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.669+0000 7f05cca00640 1 -- 172.21.15.6:0/3830687363 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05c81f87f0 con 0x7f05c8156610 2024-09-10T20:56:18.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.670+0000 7f05cca00640 1 -- 172.21.15.6:0/3830687363 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05c80ae960 con 0x7f05c8156610 2024-09-10T20:56:18.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.671+0000 7f05bf400640 1 -- 172.21.15.6:0/3830687363 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f05c0006140 con 0x7f05c8156610 2024-09-10T20:56:18.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.673+0000 7f05bf400640 1 --2- 172.21.15.6:0/3830687363 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f05a4077f70 0x7f05a407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:18.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.673+0000 7f05bf400640 1 -- 172.21.15.6:0/3830687363 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f05c00b9340 con 0x7f05c8156610 2024-09-10T20:56:18.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.673+0000 7f05c6800640 1 --2- 172.21.15.6:0/3830687363 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f05a4077f70 0x7f05a407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:18.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.674+0000 7f05c6800640 1 --2- 172.21.15.6:0/3830687363 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f05a4077f70 0x7f05a407a430 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f05b80011a0 tx=0x7f05b8006a80 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:18.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.677+0000 7f05bf400640 1 -- 172.21.15.6:0/3830687363 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f05c80ae960 con 0x7f05c8156610 2024-09-10T20:56:18.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.872+0000 7f05cca00640 1 -- 172.21.15.6:0/3830687363 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f05c815cb00 con 0x7f05c8156610 2024-09-10T20:56:18.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.873+0000 7f05bf400640 1 -- 172.21.15.6:0/3830687363 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v27) ==== 59+0+1998 (secure 0 0 0) 0x7f05c0044030 con 0x7f05c8156610 2024-09-10T20:56:18.877 INFO:teuthology.orchestra.run.smithi006.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-10T20:56:18.877 INFO:teuthology.orchestra.run.smithi006.stdout:mon advanced mon_op_complaint_time 120 2024-09-10T20:56:18.877 INFO:teuthology.orchestra.run.smithi006.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-10T20:56:18.877 INFO:teuthology.orchestra.run.smithi006.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-10T20:56:18.877 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4198.065426 2024-09-10T20:56:18.877 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4425.539353 2024-09-10T20:56:18.878 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4435.011707 2024-09-10T20:56:18.878 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 6471.435341 2024-09-10T20:56:18.878 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 5834.445474 2024-09-10T20:56:18.878 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4009.428176 2024-09-10T20:56:18.878 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3872.889185 2024-09-10T20:56:18.878 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4083.423693 2024-09-10T20:56:18.878 INFO:teuthology.orchestra.run.smithi006.stdout:mds advanced debug_mds 20/20 2024-09-10T20:56:18.878 INFO:teuthology.orchestra.run.smithi006.stdout:mds advanced debug_mds_balancer 20/20 2024-09-10T20:56:18.878 INFO:teuthology.orchestra.run.smithi006.stdout:mds advanced debug_ms 2/2 2024-09-10T20:56:18.878 INFO:teuthology.orchestra.run.smithi006.stdout:mds dev mds_debug_frag true 2024-09-10T20:56:18.878 INFO:teuthology.orchestra.run.smithi006.stdout:mds dev mds_debug_scatterstat true 2024-09-10T20:56:18.878 INFO:teuthology.orchestra.run.smithi006.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-10T20:56:18.878 INFO:teuthology.orchestra.run.smithi006.stdout:mds dev mds_verify_scatter true 2024-09-10T20:56:18.878 INFO:teuthology.orchestra.run.smithi006.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-10T20:56:18.879 INFO:teuthology.orchestra.run.smithi006.stdout:mds advanced rados_mon_op_timeout 900 2024-09-10T20:56:18.879 INFO:teuthology.orchestra.run.smithi006.stdout:mds advanced rados_osd_op_timeout 900 2024-09-10T20:56:18.879 INFO:teuthology.orchestra.run.smithi006.stdout:client advanced client_mount_timeout 600 2024-09-10T20:56:18.879 INFO:teuthology.orchestra.run.smithi006.stdout:client advanced debug_client 20/20 2024-09-10T20:56:18.879 INFO:teuthology.orchestra.run.smithi006.stdout:client advanced debug_ms 1/1 2024-09-10T20:56:18.879 INFO:teuthology.orchestra.run.smithi006.stdout:client advanced rados_mon_op_timeout 900 2024-09-10T20:56:18.879 INFO:teuthology.orchestra.run.smithi006.stdout:client advanced rados_osd_op_timeout 900 2024-09-10T20:56:18.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.875+0000 7f05cca00640 1 -- 172.21.15.6:0/3830687363 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f05a4077f70 msgr2=0x7f05a407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:18.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.875+0000 7f05cca00640 1 --2- 172.21.15.6:0/3830687363 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f05a4077f70 0x7f05a407a430 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f05b80011a0 tx=0x7f05b8006a80 comp rx=0 tx=0).stop 2024-09-10T20:56:18.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.875+0000 7f05cca00640 1 -- 172.21.15.6:0/3830687363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05c8156610 msgr2=0x7f05c8156aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:18.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.875+0000 7f05cca00640 1 --2- 172.21.15.6:0/3830687363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05c8156610 0x7f05c8156aa0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f05c000c780 tx=0x7f05c0001aa0 comp rx=0 tx=0).stop 2024-09-10T20:56:18.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.875+0000 7f05cca00640 1 -- 172.21.15.6:0/3830687363 shutdown_connections 2024-09-10T20:56:18.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.875+0000 7f05cca00640 1 --2- 172.21.15.6:0/3830687363 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f05a4077f70 0x7f05a407a430 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:18.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.875+0000 7f05cca00640 1 --2- 172.21.15.6:0/3830687363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05c8156610 0x7f05c8156aa0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:18.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.875+0000 7f05cca00640 1 --2- 172.21.15.6:0/3830687363 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05c815d680 0x7f05c80b1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:18.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.875+0000 7f05cca00640 1 --2- 172.21.15.6:0/3830687363 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05ac004d40 0x7f05c80af3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:18.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.875+0000 7f05cca00640 1 -- 172.21.15.6:0/3830687363 >> 172.21.15.6:0/3830687363 conn(0x7f05c806cf90 msgr2=0x7f05c80ce6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:18.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.876+0000 7f05cca00640 1 -- 172.21.15.6:0/3830687363 shutdown_connections 2024-09-10T20:56:18.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:18.876+0000 7f05cca00640 1 -- 172.21.15.6:0/3830687363 wait complete. 2024-09-10T20:56:18.895 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T20:56:19.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.055+0000 7f453dc00640 1 -- 172.21.15.6:0/810858513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45380742b0 msgr2=0x7f45380cb090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:19.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.055+0000 7f453dc00640 1 --2- 172.21.15.6:0/810858513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45380742b0 0x7f45380cb090 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4520005fd0 tx=0x7f452002a5d0 comp rx=0 tx=0).stop 2024-09-10T20:56:19.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.055+0000 7f453dc00640 1 -- 172.21.15.6:0/810858513 shutdown_connections 2024-09-10T20:56:19.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.055+0000 7f453dc00640 1 --2- 172.21.15.6:0/810858513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45380742b0 0x7f45380cb090 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:19.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.055+0000 7f453dc00640 1 --2- 172.21.15.6:0/810858513 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45380cc310 0x7f453815bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:19.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.055+0000 7f453dc00640 1 -- 172.21.15.6:0/810858513 >> 172.21.15.6:0/810858513 conn(0x7f45380b2670 msgr2=0x7f45380b2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:19.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.055+0000 7f453dc00640 1 -- 172.21.15.6:0/810858513 shutdown_connections 2024-09-10T20:56:19.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.055+0000 7f453dc00640 1 -- 172.21.15.6:0/810858513 wait complete. 2024-09-10T20:56:19.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.057+0000 7f453dc00640 1 Processor -- start 2024-09-10T20:56:19.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.057+0000 7f453dc00640 1 -- start start 2024-09-10T20:56:19.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.058+0000 7f453dc00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45380742b0 0x7f45380afde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:19.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.058+0000 7f453dc00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45380cc310 0x7f4538145420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:19.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.058+0000 7f453dc00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45380c7660 0x7f453815f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:19.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.058+0000 7f453dc00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f45380cfc40 con 0x7f45380742b0 2024-09-10T20:56:19.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.058+0000 7f453dc00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f45380ce310 con 0x7f45380cc310 2024-09-10T20:56:19.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.058+0000 7f453dc00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f45380cfdc0 con 0x7f45380c7660 2024-09-10T20:56:19.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.058+0000 7f4537e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45380742b0 0x7f45380afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:19.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.059+0000 7f4537e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45380742b0 0x7f45380afde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52328/0 (socket says 172.21.15.6:52328) 2024-09-10T20:56:19.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.059+0000 7f4537e00640 1 -- 172.21.15.6:0/3132620070 learned_addr learned my addr 172.21.15.6:0/3132620070 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:19.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.059+0000 7f452f400640 1 --2- 172.21.15.6:0/3132620070 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45380cc310 0x7f4538145420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:19.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.059+0000 7f453d200640 1 --2- 172.21.15.6:0/3132620070 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45380c7660 0x7f453815f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:19.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.059+0000 7f4537e00640 1 -- 172.21.15.6:0/3132620070 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45380c7660 msgr2=0x7f453815f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:19.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.059+0000 7f4537e00640 1 --2- 172.21.15.6:0/3132620070 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45380c7660 0x7f453815f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:19.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.059+0000 7f4537e00640 1 -- 172.21.15.6:0/3132620070 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45380cc310 msgr2=0x7f4538145420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:19.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.059+0000 7f4537e00640 1 --2- 172.21.15.6:0/3132620070 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45380cc310 0x7f4538145420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:19.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.059+0000 7f4537e00640 1 -- 172.21.15.6:0/3132620070 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45381f8170 con 0x7f45380742b0 2024-09-10T20:56:19.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.059+0000 7f452f400640 1 --2- 172.21.15.6:0/3132620070 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45380cc310 0x7f4538145420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:56:19.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.059+0000 7f4537e00640 1 --2- 172.21.15.6:0/3132620070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45380742b0 0x7f45380afde0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f452800e790 tx=0x7f452800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:19.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.059+0000 7f4534c00640 1 -- 172.21.15.6:0/3132620070 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f452800eea0 con 0x7f45380742b0 2024-09-10T20:56:19.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.060+0000 7f4534c00640 1 -- 172.21.15.6:0/3132620070 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f452800cdb0 con 0x7f45380742b0 2024-09-10T20:56:19.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.060+0000 7f453dc00640 1 -- 172.21.15.6:0/3132620070 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45381f8450 con 0x7f45380742b0 2024-09-10T20:56:19.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.060+0000 7f4534c00640 1 -- 172.21.15.6:0/3132620070 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4528010690 con 0x7f45380742b0 2024-09-10T20:56:19.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.060+0000 7f453dc00640 1 -- 172.21.15.6:0/3132620070 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45381f8a10 con 0x7f45380742b0 2024-09-10T20:56:19.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.061+0000 7f453dc00640 1 -- 172.21.15.6:0/3132620070 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45380cb090 con 0x7f45380742b0 2024-09-10T20:56:19.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.062+0000 7f4534c00640 1 -- 172.21.15.6:0/3132620070 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4528010830 con 0x7f45380742b0 2024-09-10T20:56:19.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.063+0000 7f4534c00640 1 --2- 172.21.15.6:0/3132620070 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4514077f70 0x7f451407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:19.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.063+0000 7f4534c00640 1 -- 172.21.15.6:0/3132620070 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f452809a780 con 0x7f45380742b0 2024-09-10T20:56:19.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.064+0000 7f452f400640 1 --2- 172.21.15.6:0/3132620070 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4514077f70 0x7f451407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:19.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.065+0000 7f452f400640 1 --2- 172.21.15.6:0/3132620070 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4514077f70 0x7f451407a430 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4520033000 tx=0x7f4520004730 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:19.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.068+0000 7f4534c00640 1 -- 172.21.15.6:0/3132620070 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4528062b90 con 0x7f45380742b0 2024-09-10T20:56:19.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.278+0000 7f453dc00640 1 -- 172.21.15.6:0/3132620070 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f4538152740 con 0x7f45380742b0 2024-09-10T20:56:19.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.282+0000 7f4534c00640 1 -- 172.21.15.6:0/3132620070 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7f45280675c0 con 0x7f45380742b0 2024-09-10T20:56:19.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.284+0000 7f453dc00640 1 -- 172.21.15.6:0/3132620070 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4514077f70 msgr2=0x7f451407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:19.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.284+0000 7f453dc00640 1 --2- 172.21.15.6:0/3132620070 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4514077f70 0x7f451407a430 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4520033000 tx=0x7f4520004730 comp rx=0 tx=0).stop 2024-09-10T20:56:19.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.284+0000 7f453dc00640 1 -- 172.21.15.6:0/3132620070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45380742b0 msgr2=0x7f45380afde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:19.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.284+0000 7f453dc00640 1 --2- 172.21.15.6:0/3132620070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45380742b0 0x7f45380afde0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f452800e790 tx=0x7f452800ec50 comp rx=0 tx=0).stop 2024-09-10T20:56:19.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.284+0000 7f453dc00640 1 -- 172.21.15.6:0/3132620070 shutdown_connections 2024-09-10T20:56:19.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.284+0000 7f453dc00640 1 --2- 172.21.15.6:0/3132620070 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4514077f70 0x7f451407a430 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:19.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.284+0000 7f453dc00640 1 --2- 172.21.15.6:0/3132620070 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45380c7660 0x7f453815f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:19.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.284+0000 7f453dc00640 1 --2- 172.21.15.6:0/3132620070 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45380cc310 0x7f4538145420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:19.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.284+0000 7f453dc00640 1 --2- 172.21.15.6:0/3132620070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45380742b0 0x7f45380afde0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:19.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.284+0000 7f453dc00640 1 -- 172.21.15.6:0/3132620070 >> 172.21.15.6:0/3132620070 conn(0x7f45380b2670 msgr2=0x7f453806f290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:19.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.285+0000 7f453dc00640 1 -- 172.21.15.6:0/3132620070 shutdown_connections 2024-09-10T20:56:19.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.285+0000 7f453dc00640 1 -- 172.21.15.6:0/3132620070 wait complete. 2024-09-10T20:56:19.304 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T20:56:19.304 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T20:56:19.404 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T20:56:19.506 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T20:56:19.506 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-10T20:56:19.506 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:56:19.542 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-10T20:56:19.542 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:56:19.617 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T20:56:19.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.816+0000 7f94eea00640 1 -- 172.21.15.6:0/1232358563 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94e8073cd0 msgr2=0x7f94e81668e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:19.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.816+0000 7f94eea00640 1 --2- 172.21.15.6:0/1232358563 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94e8073cd0 0x7f94e81668e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f94e0009be0 tx=0x7f94e002a8d0 comp rx=0 tx=0).stop 2024-09-10T20:56:19.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.816+0000 7f94eea00640 1 -- 172.21.15.6:0/1232358563 shutdown_connections 2024-09-10T20:56:19.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.816+0000 7f94eea00640 1 --2- 172.21.15.6:0/1232358563 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94e8073cd0 0x7f94e81668e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:19.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.816+0000 7f94eea00640 1 -- 172.21.15.6:0/1232358563 >> 172.21.15.6:0/1232358563 conn(0x7f94e80b27c0 msgr2=0x7f94e80b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:19.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.816+0000 7f94eea00640 1 -- 172.21.15.6:0/1232358563 shutdown_connections 2024-09-10T20:56:19.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.816+0000 7f94eea00640 1 -- 172.21.15.6:0/1232358563 wait complete. 2024-09-10T20:56:19.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.818+0000 7f94eea00640 1 Processor -- start 2024-09-10T20:56:19.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.818+0000 7f94eea00640 1 -- start start 2024-09-10T20:56:19.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.819+0000 7f94eea00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94e806faf0 0x7f94e8165ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:19.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.819+0000 7f94eea00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94e8073cd0 0x7f94e8163a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:19.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.819+0000 7f94eea00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94e815b9d0 0x7f94e8163fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:19.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.819+0000 7f94eea00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f94e8166fa0 con 0x7f94e815b9d0 2024-09-10T20:56:19.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.819+0000 7f94eea00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f94e8166e20 con 0x7f94e806faf0 2024-09-10T20:56:19.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.819+0000 7f94eea00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f94e8167120 con 0x7f94e8073cd0 2024-09-10T20:56:19.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.819+0000 7f94eca00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94e815b9d0 0x7f94e8163fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:19.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.819+0000 7f94eca00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94e815b9d0 0x7f94e8163fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52330/0 (socket says 172.21.15.6:52330) 2024-09-10T20:56:19.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.819+0000 7f94eca00640 1 -- 172.21.15.6:0/1168687473 learned_addr learned my addr 172.21.15.6:0/1168687473 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:19.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.819+0000 7f94dfe00640 1 --2- 172.21.15.6:0/1168687473 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94e8073cd0 0x7f94e8163a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:19.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.819+0000 7f94e7e00640 1 --2- 172.21.15.6:0/1168687473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94e806faf0 0x7f94e8165ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:19.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.820+0000 7f94eca00640 1 -- 172.21.15.6:0/1168687473 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94e8073cd0 msgr2=0x7f94e8163a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:19.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.820+0000 7f94eca00640 1 --2- 172.21.15.6:0/1168687473 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94e8073cd0 0x7f94e8163a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:19.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.820+0000 7f94eca00640 1 -- 172.21.15.6:0/1168687473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94e806faf0 msgr2=0x7f94e8165ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:19.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.820+0000 7f94eca00640 1 --2- 172.21.15.6:0/1168687473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94e806faf0 0x7f94e8165ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:19.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.820+0000 7f94eca00640 1 -- 172.21.15.6:0/1168687473 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94e8166570 con 0x7f94e815b9d0 2024-09-10T20:56:19.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.820+0000 7f94eca00640 1 --2- 172.21.15.6:0/1168687473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94e815b9d0 0x7f94e8163fc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f94e0009be0 tx=0x7f94e0003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:19.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.820+0000 7f94e4c00640 1 -- 172.21.15.6:0/1168687473 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e0031d80 con 0x7f94e815b9d0 2024-09-10T20:56:19.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.820+0000 7f94e4c00640 1 -- 172.21.15.6:0/1168687473 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f94e0004130 con 0x7f94e815b9d0 2024-09-10T20:56:19.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.820+0000 7f94e4c00640 1 -- 172.21.15.6:0/1168687473 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e0004560 con 0x7f94e815b9d0 2024-09-10T20:56:19.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.820+0000 7f94eea00640 1 -- 172.21.15.6:0/1168687473 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94e80b3d60 con 0x7f94e815b9d0 2024-09-10T20:56:19.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.820+0000 7f94eea00640 1 -- 172.21.15.6:0/1168687473 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94e80b4320 con 0x7f94e815b9d0 2024-09-10T20:56:19.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.822+0000 7f94eea00640 1 -- 172.21.15.6:0/1168687473 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94e80735c0 con 0x7f94e815b9d0 2024-09-10T20:56:19.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.822+0000 7f94e4c00640 1 -- 172.21.15.6:0/1168687473 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f94e003c420 con 0x7f94e815b9d0 2024-09-10T20:56:19.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.824+0000 7f94e4c00640 1 --2- 172.21.15.6:0/1168687473 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f94c4077f70 0x7f94c407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:19.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.824+0000 7f94e4c00640 1 -- 172.21.15.6:0/1168687473 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f94e00bb200 con 0x7f94e815b9d0 2024-09-10T20:56:19.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.825+0000 7f94e7e00640 1 --2- 172.21.15.6:0/1168687473 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f94c4077f70 0x7f94c407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:19.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.825+0000 7f94e7e00640 1 --2- 172.21.15.6:0/1168687473 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f94c4077f70 0x7f94c407a430 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f94d8000f60 tx=0x7f94d8009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:19.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:19.829+0000 7f94e4c00640 1 -- 172.21.15.6:0/1168687473 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f94e0040030 con 0x7f94e815b9d0 2024-09-10T20:56:20.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.037+0000 7f94eea00640 1 -- 172.21.15.6:0/1168687473 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f94e8072020 con 0x7f94e815b9d0 2024-09-10T20:56:20.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.038+0000 7f94e4c00640 1 -- 172.21.15.6:0/1168687473 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f94e0083610 con 0x7f94e815b9d0 2024-09-10T20:56:20.042 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2024-09-10T20:56:20.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.040+0000 7f94eea00640 1 -- 172.21.15.6:0/1168687473 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f94c4077f70 msgr2=0x7f94c407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:20.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.040+0000 7f94eea00640 1 --2- 172.21.15.6:0/1168687473 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f94c4077f70 0x7f94c407a430 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f94d8000f60 tx=0x7f94d8009040 comp rx=0 tx=0).stop 2024-09-10T20:56:20.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.040+0000 7f94eea00640 1 -- 172.21.15.6:0/1168687473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94e815b9d0 msgr2=0x7f94e8163fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:20.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.040+0000 7f94eea00640 1 --2- 172.21.15.6:0/1168687473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94e815b9d0 0x7f94e8163fc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f94e0009be0 tx=0x7f94e0003f10 comp rx=0 tx=0).stop 2024-09-10T20:56:20.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.040+0000 7f94eea00640 1 -- 172.21.15.6:0/1168687473 shutdown_connections 2024-09-10T20:56:20.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.040+0000 7f94eea00640 1 --2- 172.21.15.6:0/1168687473 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f94c4077f70 0x7f94c407a430 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:20.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.040+0000 7f94eea00640 1 --2- 172.21.15.6:0/1168687473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94e815b9d0 0x7f94e8163fc0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:20.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.040+0000 7f94eea00640 1 --2- 172.21.15.6:0/1168687473 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94e8073cd0 0x7f94e8163a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:20.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.040+0000 7f94eea00640 1 --2- 172.21.15.6:0/1168687473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94e806faf0 0x7f94e8165ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:20.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.040+0000 7f94eea00640 1 -- 172.21.15.6:0/1168687473 >> 172.21.15.6:0/1168687473 conn(0x7f94e80b27c0 msgr2=0x7f94e815e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:20.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.040+0000 7f94eea00640 1 -- 172.21.15.6:0/1168687473 shutdown_connections 2024-09-10T20:56:20.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.040+0000 7f94eea00640 1 -- 172.21.15.6:0/1168687473 wait complete. 2024-09-10T20:56:20.060 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-10T20:56:20.060 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:56:20.096 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T20:56:20.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.291+0000 7ff20d000640 1 -- 172.21.15.6:0/1419786460 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff208070450 msgr2=0x7ff2080b5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:20.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.291+0000 7ff20d000640 1 --2- 172.21.15.6:0/1419786460 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff208070450 0x7ff2080b5020 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff200005fd0 tx=0x7ff20002a8b0 comp rx=0 tx=0).stop 2024-09-10T20:56:20.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.291+0000 7ff20d000640 1 -- 172.21.15.6:0/1419786460 shutdown_connections 2024-09-10T20:56:20.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.291+0000 7ff20d000640 1 --2- 172.21.15.6:0/1419786460 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff208070450 0x7ff2080b5020 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:20.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.291+0000 7ff20d000640 1 -- 172.21.15.6:0/1419786460 >> 172.21.15.6:0/1419786460 conn(0x7ff2080cfa20 msgr2=0x7ff2080cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:20.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.291+0000 7ff20d000640 1 -- 172.21.15.6:0/1419786460 shutdown_connections 2024-09-10T20:56:20.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.291+0000 7ff20d000640 1 -- 172.21.15.6:0/1419786460 wait complete. 2024-09-10T20:56:20.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.293+0000 7ff20d000640 1 Processor -- start 2024-09-10T20:56:20.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.293+0000 7ff20d000640 1 -- start start 2024-09-10T20:56:20.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.294+0000 7ff20d000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff208070450 0x7ff208150f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:20.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.294+0000 7ff20d000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff208159670 0x7ff2080b43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:20.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.294+0000 7ff20d000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff20815c170 0x7ff20815ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:20.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.294+0000 7ff20d000640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff208074740 con 0x7ff20815c170 2024-09-10T20:56:20.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.294+0000 7ff20d000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff2080745c0 con 0x7ff208070450 2024-09-10T20:56:20.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.294+0000 7ff20d000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ff2080cd920 con 0x7ff208159670 2024-09-10T20:56:20.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.294+0000 7ff206800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff20815c170 0x7ff20815ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:20.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.294+0000 7ff206800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff20815c170 0x7ff20815ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52334/0 (socket says 172.21.15.6:52334) 2024-09-10T20:56:20.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.294+0000 7ff206800640 1 -- 172.21.15.6:0/2673159980 learned_addr learned my addr 172.21.15.6:0/2673159980 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:20.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.294+0000 7ff205e00640 1 --2- 172.21.15.6:0/2673159980 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff208070450 0x7ff208150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:20.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.294+0000 7ff205400640 1 --2- 172.21.15.6:0/2673159980 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff208159670 0x7ff2080b43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:20.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.294+0000 7ff206800640 1 -- 172.21.15.6:0/2673159980 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff208159670 msgr2=0x7ff2080b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:20.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.294+0000 7ff206800640 1 --2- 172.21.15.6:0/2673159980 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff208159670 0x7ff2080b43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:20.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.294+0000 7ff206800640 1 -- 172.21.15.6:0/2673159980 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff208070450 msgr2=0x7ff208150f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:20.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.294+0000 7ff206800640 1 --2- 172.21.15.6:0/2673159980 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff208070450 0x7ff208150f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:20.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.294+0000 7ff206800640 1 -- 172.21.15.6:0/2673159980 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2081584a0 con 0x7ff20815c170 2024-09-10T20:56:20.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.294+0000 7ff205e00640 1 --2- 172.21.15.6:0/2673159980 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff208070450 0x7ff208150f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:56:20.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.294+0000 7ff205400640 1 --2- 172.21.15.6:0/2673159980 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff208159670 0x7ff2080b43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:56:20.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.295+0000 7ff206800640 1 --2- 172.21.15.6:0/2673159980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff20815c170 0x7ff20815ade0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff200009cd0 tx=0x7ff200031670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:20.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.295+0000 7ff1fe000640 1 -- 172.21.15.6:0/2673159980 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff200031e60 con 0x7ff20815c170 2024-09-10T20:56:20.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.295+0000 7ff1fe000640 1 -- 172.21.15.6:0/2673159980 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff200003a60 con 0x7ff20815c170 2024-09-10T20:56:20.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.295+0000 7ff20d000640 1 -- 172.21.15.6:0/2673159980 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff208151480 con 0x7ff20815c170 2024-09-10T20:56:20.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.295+0000 7ff1fe000640 1 -- 172.21.15.6:0/2673159980 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2000330d0 con 0x7ff20815c170 2024-09-10T20:56:20.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.295+0000 7ff20d000640 1 -- 172.21.15.6:0/2673159980 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2080b2d70 con 0x7ff20815c170 2024-09-10T20:56:20.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.296+0000 7ff20d000640 1 -- 172.21.15.6:0/2673159980 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff20806fd40 con 0x7ff20815c170 2024-09-10T20:56:20.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.297+0000 7ff1fe000640 1 -- 172.21.15.6:0/2673159980 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff200033270 con 0x7ff20815c170 2024-09-10T20:56:20.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.298+0000 7ff1fe000640 1 --2- 172.21.15.6:0/2673159980 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ff1e8077f70 0x7ff1e807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:20.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.298+0000 7ff1fe000640 1 -- 172.21.15.6:0/2673159980 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ff2000bb130 con 0x7ff20815c170 2024-09-10T20:56:20.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.299+0000 7ff205e00640 1 --2- 172.21.15.6:0/2673159980 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ff1e8077f70 0x7ff1e807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:20.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.299+0000 7ff205e00640 1 --2- 172.21.15.6:0/2673159980 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ff1e8077f70 0x7ff1e807a430 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff1f8001240 tx=0x7ff1f8009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:20.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.302+0000 7ff1fe000640 1 -- 172.21.15.6:0/2673159980 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff2081584a0 con 0x7ff20815c170 2024-09-10T20:56:20.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.508+0000 7ff20d000640 1 -- 172.21.15.6:0/2673159980 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff208069d20 con 0x7ff20815c170 2024-09-10T20:56:20.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.508+0000 7ff1fe000640 1 -- 172.21.15.6:0/2673159980 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7ff20003f030 con 0x7ff20815c170 2024-09-10T20:56:20.512 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2024-09-10T20:56:20.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.510+0000 7ff20d000640 1 -- 172.21.15.6:0/2673159980 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ff1e8077f70 msgr2=0x7ff1e807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:20.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.510+0000 7ff20d000640 1 --2- 172.21.15.6:0/2673159980 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ff1e8077f70 0x7ff1e807a430 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff1f8001240 tx=0x7ff1f8009040 comp rx=0 tx=0).stop 2024-09-10T20:56:20.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.510+0000 7ff20d000640 1 -- 172.21.15.6:0/2673159980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff20815c170 msgr2=0x7ff20815ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:20.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.510+0000 7ff20d000640 1 --2- 172.21.15.6:0/2673159980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff20815c170 0x7ff20815ade0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff200009cd0 tx=0x7ff200031670 comp rx=0 tx=0).stop 2024-09-10T20:56:20.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.510+0000 7ff20d000640 1 -- 172.21.15.6:0/2673159980 shutdown_connections 2024-09-10T20:56:20.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.510+0000 7ff20d000640 1 --2- 172.21.15.6:0/2673159980 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ff1e8077f70 0x7ff1e807a430 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:20.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.510+0000 7ff20d000640 1 --2- 172.21.15.6:0/2673159980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff20815c170 0x7ff20815ade0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:20.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.510+0000 7ff20d000640 1 --2- 172.21.15.6:0/2673159980 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff208159670 0x7ff2080b43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:20.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.510+0000 7ff20d000640 1 --2- 172.21.15.6:0/2673159980 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff208070450 0x7ff208150f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:20.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.511+0000 7ff20d000640 1 -- 172.21.15.6:0/2673159980 >> 172.21.15.6:0/2673159980 conn(0x7ff2080cfa20 msgr2=0x7ff208073be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:20.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.511+0000 7ff20d000640 1 -- 172.21.15.6:0/2673159980 shutdown_connections 2024-09-10T20:56:20.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.511+0000 7ff20d000640 1 -- 172.21.15.6:0/2673159980 wait complete. 2024-09-10T20:56:20.530 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi006.front.sepia.ceph.com... 2024-09-10T20:56:20.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:20.530 DEBUG:teuthology.orchestra.run.smithi006:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-10T20:56:20.587 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:56:20.587 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2024-09-10T20:56:20.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:20.588 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T20:56:20.630 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-10T20:56:20.631 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:56:20.671 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-10T20:56:20.672 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:56:20.750 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T20:56:20.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.907+0000 7f7af2200640 1 -- 172.21.15.6:0/4110685588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aec159670 msgr2=0x7f7aec0743b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:20.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.907+0000 7f7af2200640 1 --2- 172.21.15.6:0/4110685588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aec159670 0x7f7aec0743b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7adc005fd0 tx=0x7f7adc02a540 comp rx=0 tx=0).stop 2024-09-10T20:56:20.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.908+0000 7f7af2200640 1 -- 172.21.15.6:0/4110685588 shutdown_connections 2024-09-10T20:56:20.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.908+0000 7f7af2200640 1 --2- 172.21.15.6:0/4110685588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aec159670 0x7f7aec0743b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:20.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.908+0000 7f7af2200640 1 -- 172.21.15.6:0/4110685588 >> 172.21.15.6:0/4110685588 conn(0x7f7aec0cfa20 msgr2=0x7f7aec0cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:20.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.908+0000 7f7af2200640 1 -- 172.21.15.6:0/4110685588 shutdown_connections 2024-09-10T20:56:20.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.908+0000 7f7af2200640 1 -- 172.21.15.6:0/4110685588 wait complete. 2024-09-10T20:56:20.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.909+0000 7f7af2200640 1 Processor -- start 2024-09-10T20:56:20.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.909+0000 7f7af2200640 1 -- start start 2024-09-10T20:56:20.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.910+0000 7f7af2200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7aec070450 0x7f7aec14dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:20.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.910+0000 7f7af2200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7aec159670 0x7f7aec15af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:20.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.910+0000 7f7af2200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aec15c170 0x7f7aec0c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:20.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.910+0000 7f7af2200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7aec0b53b0 con 0x7f7aec15c170 2024-09-10T20:56:20.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.910+0000 7f7af2200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7aec0b5230 con 0x7f7aec159670 2024-09-10T20:56:20.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.910+0000 7f7af2200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f7aec14e3e0 con 0x7f7aec070450 2024-09-10T20:56:20.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.911+0000 7f7aebe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aec15c170 0x7f7aec0c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:20.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.911+0000 7f7aebe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aec15c170 0x7f7aec0c8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52356/0 (socket says 172.21.15.6:52356) 2024-09-10T20:56:20.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.911+0000 7f7aebe00640 1 -- 172.21.15.6:0/2567470427 learned_addr learned my addr 172.21.15.6:0/2567470427 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:20.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.911+0000 7f7aeb400640 1 --2- 172.21.15.6:0/2567470427 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7aec070450 0x7f7aec14dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:20.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.911+0000 7f7ae2a00640 1 --2- 172.21.15.6:0/2567470427 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7aec159670 0x7f7aec15af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:20.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.911+0000 7f7aebe00640 1 -- 172.21.15.6:0/2567470427 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7aec070450 msgr2=0x7f7aec14dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:20.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.911+0000 7f7aebe00640 1 --2- 172.21.15.6:0/2567470427 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7aec070450 0x7f7aec14dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:20.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.911+0000 7f7aebe00640 1 -- 172.21.15.6:0/2567470427 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7aec159670 msgr2=0x7f7aec15af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:20.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.911+0000 7f7aebe00640 1 --2- 172.21.15.6:0/2567470427 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7aec159670 0x7f7aec15af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:20.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.911+0000 7f7aebe00640 1 -- 172.21.15.6:0/2567470427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aec159ec0 con 0x7f7aec15c170 2024-09-10T20:56:20.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.911+0000 7f7aebe00640 1 --2- 172.21.15.6:0/2567470427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aec15c170 0x7f7aec0c8b50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7ae400b970 tx=0x7f7ae400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:20.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.912+0000 7f7ae3e00640 1 -- 172.21.15.6:0/2567470427 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae4019070 con 0x7f7aec15c170 2024-09-10T20:56:20.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.912+0000 7f7ae3e00640 1 -- 172.21.15.6:0/2567470427 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ae400cbd0 con 0x7f7aec15c170 2024-09-10T20:56:20.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.912+0000 7f7ae3e00640 1 -- 172.21.15.6:0/2567470427 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae40146a0 con 0x7f7aec15c170 2024-09-10T20:56:20.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.912+0000 7f7af2200640 1 -- 172.21.15.6:0/2567470427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7aec15a1a0 con 0x7f7aec15c170 2024-09-10T20:56:20.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.912+0000 7f7af2200640 1 -- 172.21.15.6:0/2567470427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7aec15a760 con 0x7f7aec15c170 2024-09-10T20:56:20.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.913+0000 7f7af2200640 1 -- 172.21.15.6:0/2567470427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7aec0cdbc0 con 0x7f7aec15c170 2024-09-10T20:56:20.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.914+0000 7f7ae3e00640 1 -- 172.21.15.6:0/2567470427 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f7ae401e440 con 0x7f7aec15c170 2024-09-10T20:56:20.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.915+0000 7f7ae3e00640 1 --2- 172.21.15.6:0/2567470427 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f7ac8077f70 0x7f7ac807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:20.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.915+0000 7f7ae3e00640 1 -- 172.21.15.6:0/2567470427 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f7ae4099be0 con 0x7f7aec15c170 2024-09-10T20:56:20.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.915+0000 7f7aeb400640 1 --2- 172.21.15.6:0/2567470427 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f7ac8077f70 0x7f7ac807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:20.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.916+0000 7f7aeb400640 1 --2- 172.21.15.6:0/2567470427 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f7ac8077f70 0x7f7ac807a430 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7adc033000 tx=0x7f7adc004730 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:20.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:20.919+0000 7f7ae3e00640 1 -- 172.21.15.6:0/2567470427 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f7ae4062080 con 0x7f7aec15c170 2024-09-10T20:56:21.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.127+0000 7f7af2200640 1 -- 172.21.15.6:0/2567470427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7aec069d20 con 0x7f7aec15c170 2024-09-10T20:56:21.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.127+0000 7f7ae3e00640 1 -- 172.21.15.6:0/2567470427 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f7ae4066ab0 con 0x7f7aec15c170 2024-09-10T20:56:21.131 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2024-09-10T20:56:21.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.130+0000 7f7af2200640 1 -- 172.21.15.6:0/2567470427 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f7ac8077f70 msgr2=0x7f7ac807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:21.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.130+0000 7f7af2200640 1 --2- 172.21.15.6:0/2567470427 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f7ac8077f70 0x7f7ac807a430 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7adc033000 tx=0x7f7adc004730 comp rx=0 tx=0).stop 2024-09-10T20:56:21.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.130+0000 7f7af2200640 1 -- 172.21.15.6:0/2567470427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aec15c170 msgr2=0x7f7aec0c8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:21.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.130+0000 7f7af2200640 1 --2- 172.21.15.6:0/2567470427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aec15c170 0x7f7aec0c8b50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7ae400b970 tx=0x7f7ae400be30 comp rx=0 tx=0).stop 2024-09-10T20:56:21.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.130+0000 7f7af2200640 1 -- 172.21.15.6:0/2567470427 shutdown_connections 2024-09-10T20:56:21.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.130+0000 7f7af2200640 1 --2- 172.21.15.6:0/2567470427 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f7ac8077f70 0x7f7ac807a430 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:21.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.130+0000 7f7af2200640 1 --2- 172.21.15.6:0/2567470427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aec15c170 0x7f7aec0c8b50 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:21.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.130+0000 7f7af2200640 1 --2- 172.21.15.6:0/2567470427 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7aec159670 0x7f7aec15af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:21.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.130+0000 7f7af2200640 1 --2- 172.21.15.6:0/2567470427 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7aec070450 0x7f7aec14dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:21.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.130+0000 7f7af2200640 1 -- 172.21.15.6:0/2567470427 >> 172.21.15.6:0/2567470427 conn(0x7f7aec0cfa20 msgr2=0x7f7aec0cfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:21.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.130+0000 7f7af2200640 1 -- 172.21.15.6:0/2567470427 shutdown_connections 2024-09-10T20:56:21.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.130+0000 7f7af2200640 1 -- 172.21.15.6:0/2567470427 wait complete. 2024-09-10T20:56:21.149 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-10T20:56:21.149 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:56:21.190 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T20:56:21.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.347+0000 7f49cfe00640 1 -- 172.21.15.6:0/778872664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49c815bb30 msgr2=0x7f49c80cf340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:21.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.347+0000 7f49cfe00640 1 --2- 172.21.15.6:0/778872664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49c815bb30 0x7f49c80cf340 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f49c80af390 tx=0x7f49bc02a560 comp rx=0 tx=0).stop 2024-09-10T20:56:21.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.347+0000 7f49cfe00640 1 -- 172.21.15.6:0/778872664 shutdown_connections 2024-09-10T20:56:21.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.347+0000 7f49cfe00640 1 --2- 172.21.15.6:0/778872664 >> v2:172.21.15.150:3300/0 conn(0x7f49c80caa40 0x7f49c8161a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:21.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.347+0000 7f49cfe00640 1 --2- 172.21.15.6:0/778872664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49c815bb30 0x7f49c80cf340 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:21.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.347+0000 7f49cfe00640 1 -- 172.21.15.6:0/778872664 >> 172.21.15.6:0/778872664 conn(0x7f49c80cfa20 msgr2=0x7f49c80cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:21.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.347+0000 7f49cfe00640 1 -- 172.21.15.6:0/778872664 shutdown_connections 2024-09-10T20:56:21.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.347+0000 7f49cfe00640 1 -- 172.21.15.6:0/778872664 wait complete. 2024-09-10T20:56:21.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.349+0000 7f49cfe00640 1 Processor -- start 2024-09-10T20:56:21.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.349+0000 7f49cfe00640 1 -- start start 2024-09-10T20:56:21.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.350+0000 7f49cfe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49c80caa40 0x7f49c80b5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:21.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.350+0000 7f49cfe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49c815bb30 0x7f49c81f5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:21.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.350+0000 7f49cfe00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49c8161f60 0x7f49c8158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:21.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.350+0000 7f49cfe00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f49c80aea10 con 0x7f49c815bb30 2024-09-10T20:56:21.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.350+0000 7f49cfe00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f49c80ae890 con 0x7f49c80caa40 2024-09-10T20:56:21.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.350+0000 7f49cfe00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f49c815eb40 con 0x7f49c8161f60 2024-09-10T20:56:21.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.350+0000 7f49cca00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49c815bb30 0x7f49c81f5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:21.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.350+0000 7f49cca00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49c815bb30 0x7f49c81f5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52370/0 (socket says 172.21.15.6:52370) 2024-09-10T20:56:21.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.350+0000 7f49cca00640 1 -- 172.21.15.6:0/1496778774 learned_addr learned my addr 172.21.15.6:0/1496778774 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:21.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.350+0000 7f49cd400640 1 --2- 172.21.15.6:0/1496778774 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49c80caa40 0x7f49c80b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:21.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.351+0000 7f49cde00640 1 --2- 172.21.15.6:0/1496778774 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49c8161f60 0x7f49c8158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:21.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.351+0000 7f49cca00640 1 -- 172.21.15.6:0/1496778774 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49c8161f60 msgr2=0x7f49c8158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:21.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.351+0000 7f49cca00640 1 --2- 172.21.15.6:0/1496778774 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49c8161f60 0x7f49c8158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:21.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.351+0000 7f49cca00640 1 -- 172.21.15.6:0/1496778774 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49c80caa40 msgr2=0x7f49c80b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:21.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.351+0000 7f49cca00640 1 --2- 172.21.15.6:0/1496778774 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49c80caa40 0x7f49c80b5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:21.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.351+0000 7f49cca00640 1 -- 172.21.15.6:0/1496778774 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49c81f5570 con 0x7f49c815bb30 2024-09-10T20:56:21.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.351+0000 7f49cd400640 1 --2- 172.21.15.6:0/1496778774 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49c80caa40 0x7f49c80b5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:56:21.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.351+0000 7f49cca00640 1 --2- 172.21.15.6:0/1496778774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49c815bb30 0x7f49c81f5030 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f49b400c920 tx=0x7f49b400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:21.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.351+0000 7f49c5600640 1 -- 172.21.15.6:0/1496778774 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b4007c70 con 0x7f49c815bb30 2024-09-10T20:56:21.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.351+0000 7f49c5600640 1 -- 172.21.15.6:0/1496778774 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f49b400f450 con 0x7f49c815bb30 2024-09-10T20:56:21.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.351+0000 7f49c5600640 1 -- 172.21.15.6:0/1496778774 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b400f8a0 con 0x7f49c815bb30 2024-09-10T20:56:21.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.351+0000 7f49cfe00640 1 -- 172.21.15.6:0/1496778774 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49c815f330 con 0x7f49c815bb30 2024-09-10T20:56:21.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.351+0000 7f49cfe00640 1 -- 172.21.15.6:0/1496778774 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49c815f8f0 con 0x7f49c815bb30 2024-09-10T20:56:21.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.353+0000 7f49cfe00640 1 -- 172.21.15.6:0/1496778774 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49c815eff0 con 0x7f49c815bb30 2024-09-10T20:56:21.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.354+0000 7f49c5600640 1 -- 172.21.15.6:0/1496778774 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f49b4020030 con 0x7f49c815bb30 2024-09-10T20:56:21.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.355+0000 7f49c5600640 1 --2- 172.21.15.6:0/1496778774 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f49a8077fa0 0x7f49a807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:21.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.355+0000 7f49c5600640 1 -- 172.21.15.6:0/1496778774 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f49b409a270 con 0x7f49c815bb30 2024-09-10T20:56:21.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.355+0000 7f49cd400640 1 --2- 172.21.15.6:0/1496778774 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f49a8077fa0 0x7f49a807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:21.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.356+0000 7f49cd400640 1 --2- 172.21.15.6:0/1496778774 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f49a8077fa0 0x7f49a807a460 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f49bc033000 tx=0x7f49bc004730 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:21.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.359+0000 7f49c5600640 1 -- 172.21.15.6:0/1496778774 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f49b4014030 con 0x7f49c815bb30 2024-09-10T20:56:21.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.568+0000 7f49cfe00640 1 -- 172.21.15.6:0/1496778774 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f49c8069d20 con 0x7f49c815bb30 2024-09-10T20:56:21.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.568+0000 7f49c5600640 1 -- 172.21.15.6:0/1496778774 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f49b4062d60 con 0x7f49c815bb30 2024-09-10T20:56:21.572 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2024-09-10T20:56:21.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.570+0000 7f49cfe00640 1 -- 172.21.15.6:0/1496778774 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f49a8077fa0 msgr2=0x7f49a807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:21.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.570+0000 7f49cfe00640 1 --2- 172.21.15.6:0/1496778774 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f49a8077fa0 0x7f49a807a460 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f49bc033000 tx=0x7f49bc004730 comp rx=0 tx=0).stop 2024-09-10T20:56:21.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.571+0000 7f49cfe00640 1 -- 172.21.15.6:0/1496778774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49c815bb30 msgr2=0x7f49c81f5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:21.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.571+0000 7f49cfe00640 1 --2- 172.21.15.6:0/1496778774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49c815bb30 0x7f49c81f5030 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f49b400c920 tx=0x7f49b400cde0 comp rx=0 tx=0).stop 2024-09-10T20:56:21.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.571+0000 7f49cfe00640 1 -- 172.21.15.6:0/1496778774 shutdown_connections 2024-09-10T20:56:21.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.571+0000 7f49cfe00640 1 --2- 172.21.15.6:0/1496778774 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f49a8077fa0 0x7f49a807a460 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:21.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.571+0000 7f49cfe00640 1 --2- 172.21.15.6:0/1496778774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49c815bb30 0x7f49c81f5030 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:21.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.571+0000 7f49cfe00640 1 --2- 172.21.15.6:0/1496778774 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49c8161f60 0x7f49c8158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:21.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.571+0000 7f49cfe00640 1 --2- 172.21.15.6:0/1496778774 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49c80caa40 0x7f49c80b5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:21.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.571+0000 7f49cfe00640 1 -- 172.21.15.6:0/1496778774 >> 172.21.15.6:0/1496778774 conn(0x7f49c80cfa20 msgr2=0x7f49c80ad880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:21.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.571+0000 7f49cfe00640 1 -- 172.21.15.6:0/1496778774 shutdown_connections 2024-09-10T20:56:21.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:21.571+0000 7f49cfe00640 1 -- 172.21.15.6:0/1496778774 wait complete. 2024-09-10T20:56:21.590 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi150.front.sepia.ceph.com... 2024-09-10T20:56:21.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:21.590 DEBUG:teuthology.orchestra.run.smithi150:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-10T20:56:21.654 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:56:21.654 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2024-09-10T20:56:21.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:21.654 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-10T20:56:21.700 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-10T20:56:21.700 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:56:21.735 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-10T20:56:21.735 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:56:21.811 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T20:56:22.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.009+0000 7f56eb200640 1 -- 172.21.15.6:0/777471026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56ec0cf7a0 msgr2=0x7f56ec1619c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:22.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.009+0000 7f56eb200640 1 --2- 172.21.15.6:0/777471026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56ec0cf7a0 0x7f56ec1619c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f56ec08e200 tx=0x7f56e402aa30 comp rx=0 tx=0).stop 2024-09-10T20:56:22.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.009+0000 7f56eb200640 1 -- 172.21.15.6:0/777471026 shutdown_connections 2024-09-10T20:56:22.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.009+0000 7f56eb200640 1 --2- 172.21.15.6:0/777471026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56ec0cf7a0 0x7f56ec1619c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:22.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.009+0000 7f56eb200640 1 --2- 172.21.15.6:0/777471026 >> v2:172.21.15.150:3300/0 conn(0x7f56ec15dcb0 0x7f56ec0d0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:22.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.009+0000 7f56eb200640 1 -- 172.21.15.6:0/777471026 >> 172.21.15.6:0/777471026 conn(0x7f56ec09d100 msgr2=0x7f56ec0d3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:22.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.009+0000 7f56eb200640 1 -- 172.21.15.6:0/777471026 shutdown_connections 2024-09-10T20:56:22.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.009+0000 7f56eb200640 1 -- 172.21.15.6:0/777471026 wait complete. 2024-09-10T20:56:22.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.010+0000 7f56eb200640 1 Processor -- start 2024-09-10T20:56:22.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.011+0000 7f56eb200640 1 -- start start 2024-09-10T20:56:22.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.012+0000 7f56eb200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56ec0cf7a0 0x7f56ec152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:22.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.012+0000 7f56eb200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56ec15dcb0 0x7f56ec0ca300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:22.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.012+0000 7f56eb200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56ec15e090 0x7f56ec0ca840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:22.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.012+0000 7f56eb200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f56ec0b6c40 con 0x7f56ec0cf7a0 2024-09-10T20:56:22.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.012+0000 7f56eb200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f56ec0b6dc0 con 0x7f56ec15dcb0 2024-09-10T20:56:22.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.012+0000 7f56eb200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f56ec0b6f40 con 0x7f56ec15e090 2024-09-10T20:56:22.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.012+0000 7f56e9e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56ec0cf7a0 0x7f56ec152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:22.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.012+0000 7f56e9e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56ec0cf7a0 0x7f56ec152ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52396/0 (socket says 172.21.15.6:52396) 2024-09-10T20:56:22.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.012+0000 7f56e9e00640 1 -- 172.21.15.6:0/3488566396 learned_addr learned my addr 172.21.15.6:0/3488566396 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:22.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.012+0000 7f56ea800640 1 --2- 172.21.15.6:0/3488566396 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56ec15e090 0x7f56ec0ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:22.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.012+0000 7f56e9400640 1 --2- 172.21.15.6:0/3488566396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56ec15dcb0 0x7f56ec0ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:22.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.012+0000 7f56e9e00640 1 -- 172.21.15.6:0/3488566396 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56ec15e090 msgr2=0x7f56ec0ca840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:22.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.012+0000 7f56e9e00640 1 --2- 172.21.15.6:0/3488566396 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56ec15e090 0x7f56ec0ca840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:22.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.012+0000 7f56e9e00640 1 -- 172.21.15.6:0/3488566396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56ec15dcb0 msgr2=0x7f56ec0ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:22.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.012+0000 7f56e9e00640 1 --2- 172.21.15.6:0/3488566396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56ec15dcb0 0x7f56ec0ca300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:22.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.012+0000 7f56e9e00640 1 -- 172.21.15.6:0/3488566396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56ec0b88a0 con 0x7f56ec0cf7a0 2024-09-10T20:56:22.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.013+0000 7f56e9e00640 1 --2- 172.21.15.6:0/3488566396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56ec0cf7a0 0x7f56ec152ec0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f56dc00d770 tx=0x7f56dc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:22.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.013+0000 7f56e2000640 1 -- 172.21.15.6:0/3488566396 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56dc017070 con 0x7f56ec0cf7a0 2024-09-10T20:56:22.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.013+0000 7f56e2000640 1 -- 172.21.15.6:0/3488566396 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56dc009cc0 con 0x7f56ec0cf7a0 2024-09-10T20:56:22.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.013+0000 7f56e2000640 1 -- 172.21.15.6:0/3488566396 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56dc005280 con 0x7f56ec0cf7a0 2024-09-10T20:56:22.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.013+0000 7f56eb200640 1 -- 172.21.15.6:0/3488566396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56ec0b8b80 con 0x7f56ec0cf7a0 2024-09-10T20:56:22.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.013+0000 7f56eb200640 1 -- 172.21.15.6:0/3488566396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56ec0b9140 con 0x7f56ec0cf7a0 2024-09-10T20:56:22.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.014+0000 7f56eb200640 1 -- 172.21.15.6:0/3488566396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56ec0b9380 con 0x7f56ec0cf7a0 2024-09-10T20:56:22.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.015+0000 7f56e2000640 1 -- 172.21.15.6:0/3488566396 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f56dc005420 con 0x7f56ec0cf7a0 2024-09-10T20:56:22.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.016+0000 7f56e2000640 1 --2- 172.21.15.6:0/3488566396 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f56cc077f70 0x7f56cc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:22.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.016+0000 7f56e2000640 1 -- 172.21.15.6:0/3488566396 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f56dc099e20 con 0x7f56ec0cf7a0 2024-09-10T20:56:22.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.017+0000 7f56e9400640 1 --2- 172.21.15.6:0/3488566396 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f56cc077f70 0x7f56cc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:22.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.017+0000 7f56e9400640 1 --2- 172.21.15.6:0/3488566396 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f56cc077f70 0x7f56cc07a430 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f56ec0b97d0 tx=0x7f56d8009060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:22.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.020+0000 7f56e2000640 1 -- 172.21.15.6:0/3488566396 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f56ec0b9380 con 0x7f56ec0cf7a0 2024-09-10T20:56:22.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.225+0000 7f56eb200640 1 -- 172.21.15.6:0/3488566396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f56ec158fd0 con 0x7f56ec0cf7a0 2024-09-10T20:56:22.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.225+0000 7f56e2000640 1 -- 172.21.15.6:0/3488566396 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f56dc0622c0 con 0x7f56ec0cf7a0 2024-09-10T20:56:22.229 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2024-09-10T20:56:22.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.227+0000 7f56eb200640 1 -- 172.21.15.6:0/3488566396 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f56cc077f70 msgr2=0x7f56cc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:22.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.227+0000 7f56eb200640 1 --2- 172.21.15.6:0/3488566396 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f56cc077f70 0x7f56cc07a430 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f56ec0b97d0 tx=0x7f56d8009060 comp rx=0 tx=0).stop 2024-09-10T20:56:22.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.227+0000 7f56eb200640 1 -- 172.21.15.6:0/3488566396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56ec0cf7a0 msgr2=0x7f56ec152ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:22.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.227+0000 7f56eb200640 1 --2- 172.21.15.6:0/3488566396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56ec0cf7a0 0x7f56ec152ec0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f56dc00d770 tx=0x7f56dc00dc30 comp rx=0 tx=0).stop 2024-09-10T20:56:22.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.227+0000 7f56eb200640 1 -- 172.21.15.6:0/3488566396 shutdown_connections 2024-09-10T20:56:22.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.227+0000 7f56eb200640 1 --2- 172.21.15.6:0/3488566396 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f56cc077f70 0x7f56cc07a430 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:22.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.227+0000 7f56eb200640 1 --2- 172.21.15.6:0/3488566396 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56ec15e090 0x7f56ec0ca840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:22.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.227+0000 7f56eb200640 1 --2- 172.21.15.6:0/3488566396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56ec15dcb0 0x7f56ec0ca300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:22.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.227+0000 7f56eb200640 1 --2- 172.21.15.6:0/3488566396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56ec0cf7a0 0x7f56ec152ec0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:22.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.227+0000 7f56eb200640 1 -- 172.21.15.6:0/3488566396 >> 172.21.15.6:0/3488566396 conn(0x7f56ec09d100 msgr2=0x7f56ec0b79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:22.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.227+0000 7f56eb200640 1 -- 172.21.15.6:0/3488566396 shutdown_connections 2024-09-10T20:56:22.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.228+0000 7f56eb200640 1 -- 172.21.15.6:0/3488566396 wait complete. 2024-09-10T20:56:22.247 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-10T20:56:22.247 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:56:22.283 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T20:56:22.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.479+0000 7f8e09800640 1 -- 172.21.15.6:0/3207645167 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8de80051c0 msgr2=0x7f8de800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:22.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.479+0000 7f8e09800640 1 --2- 172.21.15.6:0/3207645167 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8de80051c0 0x7f8de800b9c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc001dc0 tx=0x7f8de8005830 comp rx=0 tx=0).stop 2024-09-10T20:56:22.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.480+0000 7f8e09800640 1 -- 172.21.15.6:0/3207645167 shutdown_connections 2024-09-10T20:56:22.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.480+0000 7f8e09800640 1 --2- 172.21.15.6:0/3207645167 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8de80051c0 0x7f8de800b9c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:22.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.480+0000 7f8e09800640 1 -- 172.21.15.6:0/3207645167 >> 172.21.15.6:0/3207645167 conn(0x7f8e0409d100 msgr2=0x7f8e040d3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:22.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.480+0000 7f8e09800640 1 -- 172.21.15.6:0/3207645167 shutdown_connections 2024-09-10T20:56:22.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.480+0000 7f8e09800640 1 -- 172.21.15.6:0/3207645167 wait complete. 2024-09-10T20:56:22.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.481+0000 7f8e09800640 1 Processor -- start 2024-09-10T20:56:22.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.481+0000 7f8e09800640 1 -- start start 2024-09-10T20:56:22.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.482+0000 7f8e09800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8de80051c0 0x7f8e041f8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:22.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.482+0000 7f8e09800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e040b78a0 0x7f8e040d1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:22.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.482+0000 7f8e09800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e040b85b0 0x7f8e040cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:22.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.482+0000 7f8e09800640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8e040d4800 con 0x7f8de80051c0 2024-09-10T20:56:22.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.482+0000 7f8e09800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8e040d13e0 con 0x7f8e040b78a0 2024-09-10T20:56:22.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.482+0000 7f8e09800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8e040d4980 con 0x7f8e040b85b0 2024-09-10T20:56:22.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.483+0000 7f8e03e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8de80051c0 0x7f8e041f8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:22.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.483+0000 7f8e03e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8de80051c0 0x7f8e041f8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52408/0 (socket says 172.21.15.6:52408) 2024-09-10T20:56:22.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.483+0000 7f8e03e00640 1 -- 172.21.15.6:0/3455599492 learned_addr learned my addr 172.21.15.6:0/3455599492 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:22.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.483+0000 7f8e08e00640 1 --2- 172.21.15.6:0/3455599492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e040b85b0 0x7f8e040cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:22.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.483+0000 7f8e03400640 1 --2- 172.21.15.6:0/3455599492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e040b78a0 0x7f8e040d1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:22.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.483+0000 7f8e03e00640 1 -- 172.21.15.6:0/3455599492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e040b85b0 msgr2=0x7f8e040cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:22.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.483+0000 7f8e03e00640 1 --2- 172.21.15.6:0/3455599492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e040b85b0 0x7f8e040cc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:22.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.483+0000 7f8e03e00640 1 -- 172.21.15.6:0/3455599492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e040b78a0 msgr2=0x7f8e040d1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:22.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.483+0000 7f8e03e00640 1 --2- 172.21.15.6:0/3455599492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e040b78a0 0x7f8e040d1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:22.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.483+0000 7f8e03e00640 1 -- 172.21.15.6:0/3455599492 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e040b8b50 con 0x7f8de80051c0 2024-09-10T20:56:22.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.483+0000 7f8e03e00640 1 --2- 172.21.15.6:0/3455599492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8de80051c0 0x7f8e041f8c80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8df4011ae0 tx=0x7f8df4009e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:22.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.483+0000 7f8dfbe00640 1 -- 172.21.15.6:0/3455599492 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df401e070 con 0x7f8de80051c0 2024-09-10T20:56:22.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.484+0000 7f8dfbe00640 1 -- 172.21.15.6:0/3455599492 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8df4004480 con 0x7f8de80051c0 2024-09-10T20:56:22.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.484+0000 7f8e09800640 1 -- 172.21.15.6:0/3455599492 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e040b6dc0 con 0x7f8de80051c0 2024-09-10T20:56:22.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.484+0000 7f8dfbe00640 1 -- 172.21.15.6:0/3455599492 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df400fc60 con 0x7f8de80051c0 2024-09-10T20:56:22.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.484+0000 7f8e09800640 1 -- 172.21.15.6:0/3455599492 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e040b7380 con 0x7f8de80051c0 2024-09-10T20:56:22.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.485+0000 7f8e09800640 1 -- 172.21.15.6:0/3455599492 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e041619c0 con 0x7f8de80051c0 2024-09-10T20:56:22.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.486+0000 7f8dfbe00640 1 -- 172.21.15.6:0/3455599492 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8df40035f0 con 0x7f8de80051c0 2024-09-10T20:56:22.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.487+0000 7f8dfbe00640 1 --2- 172.21.15.6:0/3455599492 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f8de4077f70 0x7f8de407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:22.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.487+0000 7f8dfbe00640 1 -- 172.21.15.6:0/3455599492 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f8df409ab50 con 0x7f8de80051c0 2024-09-10T20:56:22.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.487+0000 7f8e03400640 1 --2- 172.21.15.6:0/3455599492 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f8de4077f70 0x7f8de407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:22.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.488+0000 7f8e03400640 1 --2- 172.21.15.6:0/3455599492 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f8de4077f70 0x7f8de407a430 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8e040b8540 tx=0x7f8df00067a0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:22.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.491+0000 7f8dfbe00640 1 -- 172.21.15.6:0/3455599492 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f8df4062f60 con 0x7f8de80051c0 2024-09-10T20:56:22.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.696+0000 7f8e09800640 1 -- 172.21.15.6:0/3455599492 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8e040d4500 con 0x7f8de80051c0 2024-09-10T20:56:22.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.696+0000 7f8dfbe00640 1 -- 172.21.15.6:0/3455599492 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f8df4067990 con 0x7f8de80051c0 2024-09-10T20:56:22.700 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2024-09-10T20:56:22.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.698+0000 7f8e09800640 1 -- 172.21.15.6:0/3455599492 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f8de4077f70 msgr2=0x7f8de407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:22.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.698+0000 7f8e09800640 1 --2- 172.21.15.6:0/3455599492 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f8de4077f70 0x7f8de407a430 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8e040b8540 tx=0x7f8df00067a0 comp rx=0 tx=0).stop 2024-09-10T20:56:22.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.698+0000 7f8e09800640 1 -- 172.21.15.6:0/3455599492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8de80051c0 msgr2=0x7f8e041f8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:22.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.698+0000 7f8e09800640 1 --2- 172.21.15.6:0/3455599492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8de80051c0 0x7f8e041f8c80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8df4011ae0 tx=0x7f8df4009e40 comp rx=0 tx=0).stop 2024-09-10T20:56:22.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.698+0000 7f8e09800640 1 -- 172.21.15.6:0/3455599492 shutdown_connections 2024-09-10T20:56:22.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.699+0000 7f8e09800640 1 --2- 172.21.15.6:0/3455599492 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f8de4077f70 0x7f8de407a430 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:22.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.699+0000 7f8e09800640 1 --2- 172.21.15.6:0/3455599492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e040b85b0 0x7f8e040cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:22.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.699+0000 7f8e09800640 1 --2- 172.21.15.6:0/3455599492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e040b78a0 0x7f8e040d1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:22.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.699+0000 7f8e09800640 1 --2- 172.21.15.6:0/3455599492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8de80051c0 0x7f8e041f8c80 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:22.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.699+0000 7f8e09800640 1 -- 172.21.15.6:0/3455599492 >> 172.21.15.6:0/3455599492 conn(0x7f8e0409d100 msgr2=0x7f8e0406d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:22.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.699+0000 7f8e09800640 1 -- 172.21.15.6:0/3455599492 shutdown_connections 2024-09-10T20:56:22.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:22.699+0000 7f8e09800640 1 -- 172.21.15.6:0/3455599492 wait complete. 2024-09-10T20:56:22.718 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi006.front.sepia.ceph.com... 2024-09-10T20:56:22.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:22.718 DEBUG:teuthology.orchestra.run.smithi006:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-09-10T20:56:22.774 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:56:22.775 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2024-09-10T20:56:22.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:22.775 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-10T20:56:22.810 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-10T20:56:22.810 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:56:22.851 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-10T20:56:22.851 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:56:22.930 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T20:56:23.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.086+0000 7fcbcb000640 1 -- 172.21.15.6:0/1990645992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbc40caa40 msgr2=0x7fcbc4161a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:23.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.086+0000 7fcbcb000640 1 --2- 172.21.15.6:0/1990645992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbc40caa40 0x7fcbc4161a20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0005fd0 tx=0x7fcbb002a5d0 comp rx=0 tx=0).stop 2024-09-10T20:56:23.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.086+0000 7fcbcb000640 1 -- 172.21.15.6:0/1990645992 shutdown_connections 2024-09-10T20:56:23.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.086+0000 7fcbcb000640 1 --2- 172.21.15.6:0/1990645992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbc40caa40 0x7fcbc4161a20 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:23.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.086+0000 7fcbcb000640 1 --2- 172.21.15.6:0/1990645992 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcbc415bb30 0x7fcbc40cf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:23.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.086+0000 7fcbcb000640 1 -- 172.21.15.6:0/1990645992 >> 172.21.15.6:0/1990645992 conn(0x7fcbc40cfa20 msgr2=0x7fcbc40cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:23.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.086+0000 7fcbcb000640 1 -- 172.21.15.6:0/1990645992 shutdown_connections 2024-09-10T20:56:23.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.086+0000 7fcbcb000640 1 -- 172.21.15.6:0/1990645992 wait complete. 2024-09-10T20:56:23.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.087+0000 7fcbcb000640 1 Processor -- start 2024-09-10T20:56:23.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.088+0000 7fcbcb000640 1 -- start start 2024-09-10T20:56:23.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.088+0000 7fcbcb000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcbc40caa40 0x7fcbc40b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:23.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.089+0000 7fcbcb000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbc415bb30 0x7fcbc4157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:23.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.089+0000 7fcbcb000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbc4161f60 0x7fcbc41f48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:23.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.089+0000 7fcbcb000640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcbc40cb000 con 0x7fcbc4161f60 2024-09-10T20:56:23.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.089+0000 7fcbcb000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fcbc40aeaa0 con 0x7fcbc415bb30 2024-09-10T20:56:23.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.089+0000 7fcbcb000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fcbc415eb40 con 0x7fcbc40caa40 2024-09-10T20:56:23.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.089+0000 7fcbc9000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbc4161f60 0x7fcbc41f48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:23.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.089+0000 7fcbc3400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbc415bb30 0x7fcbc4157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:23.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.089+0000 7fcbc3e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcbc40caa40 0x7fcbc40b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:23.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.089+0000 7fcbc3400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbc415bb30 0x7fcbc4157fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.6:38944/0 (socket says 172.21.15.6:38944) 2024-09-10T20:56:23.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.089+0000 7fcbc3400640 1 -- 172.21.15.6:0/4020463659 learned_addr learned my addr 172.21.15.6:0/4020463659 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:23.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.089+0000 7fcbc9000640 1 -- 172.21.15.6:0/4020463659 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcbc40caa40 msgr2=0x7fcbc40b3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:23.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.089+0000 7fcbc9000640 1 --2- 172.21.15.6:0/4020463659 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcbc40caa40 0x7fcbc40b3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:23.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.089+0000 7fcbc9000640 1 -- 172.21.15.6:0/4020463659 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbc415bb30 msgr2=0x7fcbc4157fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:23.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.089+0000 7fcbc9000640 1 --2- 172.21.15.6:0/4020463659 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbc415bb30 0x7fcbc4157fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:23.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.089+0000 7fcbc9000640 1 -- 172.21.15.6:0/4020463659 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbc41f5330 con 0x7fcbc4161f60 2024-09-10T20:56:23.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.090+0000 7fcbc9000640 1 --2- 172.21.15.6:0/4020463659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbc4161f60 0x7fcbc41f48e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc00c730 tx=0x7fcbbc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:23.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.090+0000 7fcbbbe00640 1 -- 172.21.15.6:0/4020463659 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc003b70 con 0x7fcbc4161f60 2024-09-10T20:56:23.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.090+0000 7fcbbbe00640 1 -- 172.21.15.6:0/4020463659 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcbbc003d10 con 0x7fcbc4161f60 2024-09-10T20:56:23.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.090+0000 7fcbbbe00640 1 -- 172.21.15.6:0/4020463659 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc005330 con 0x7fcbc4161f60 2024-09-10T20:56:23.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.090+0000 7fcbcb000640 1 -- 172.21.15.6:0/4020463659 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbc41f5610 con 0x7fcbc4161f60 2024-09-10T20:56:23.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.090+0000 7fcbcb000640 1 -- 172.21.15.6:0/4020463659 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbc40b35a0 con 0x7fcbc4161f60 2024-09-10T20:56:23.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.091+0000 7fcbcb000640 1 -- 172.21.15.6:0/4020463659 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbc40b30e0 con 0x7fcbc4161f60 2024-09-10T20:56:23.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.092+0000 7fcbbbe00640 1 -- 172.21.15.6:0/4020463659 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fcbbc00a640 con 0x7fcbc4161f60 2024-09-10T20:56:23.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.093+0000 7fcbbbe00640 1 --2- 172.21.15.6:0/4020463659 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fcba4077f70 0x7fcba407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:23.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.093+0000 7fcbbbe00640 1 -- 172.21.15.6:0/4020463659 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fcbbc099be0 con 0x7fcbc4161f60 2024-09-10T20:56:23.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.094+0000 7fcbc3e00640 1 --2- 172.21.15.6:0/4020463659 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fcba4077f70 0x7fcba407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:23.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.094+0000 7fcbc3e00640 1 --2- 172.21.15.6:0/4020463659 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fcba4077f70 0x7fcba407a430 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcbc40b05d0 tx=0x7fcbb400b390 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:23.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.098+0000 7fcbbbe00640 1 -- 172.21.15.6:0/4020463659 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fcbc40b30e0 con 0x7fcbc4161f60 2024-09-10T20:56:23.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.307+0000 7fcbcb000640 1 -- 172.21.15.6:0/4020463659 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fcbc4161a20 con 0x7fcbc4161f60 2024-09-10T20:56:23.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.307+0000 7fcbbbe00640 1 -- 172.21.15.6:0/4020463659 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7fcbc40ce720 con 0x7fcbc4161f60 2024-09-10T20:56:23.641 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2024-09-10T20:56:23.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.310+0000 7fcbcb000640 1 -- 172.21.15.6:0/4020463659 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fcba4077f70 msgr2=0x7fcba407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:23.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.310+0000 7fcbcb000640 1 --2- 172.21.15.6:0/4020463659 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fcba4077f70 0x7fcba407a430 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcbc40b05d0 tx=0x7fcbb400b390 comp rx=0 tx=0).stop 2024-09-10T20:56:23.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.310+0000 7fcbcb000640 1 -- 172.21.15.6:0/4020463659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbc4161f60 msgr2=0x7fcbc41f48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:23.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.310+0000 7fcbcb000640 1 --2- 172.21.15.6:0/4020463659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbc4161f60 0x7fcbc41f48e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc00c730 tx=0x7fcbbc00cbf0 comp rx=0 tx=0).stop 2024-09-10T20:56:23.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.310+0000 7fcbcb000640 1 -- 172.21.15.6:0/4020463659 shutdown_connections 2024-09-10T20:56:23.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.310+0000 7fcbcb000640 1 --2- 172.21.15.6:0/4020463659 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fcba4077f70 0x7fcba407a430 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:23.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.310+0000 7fcbcb000640 1 --2- 172.21.15.6:0/4020463659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbc4161f60 0x7fcbc41f48e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:23.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.310+0000 7fcbcb000640 1 --2- 172.21.15.6:0/4020463659 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcbc415bb30 0x7fcbc4157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:23.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.310+0000 7fcbcb000640 1 --2- 172.21.15.6:0/4020463659 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcbc40caa40 0x7fcbc40b3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:23.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.310+0000 7fcbcb000640 1 -- 172.21.15.6:0/4020463659 >> 172.21.15.6:0/4020463659 conn(0x7fcbc40cfa20 msgr2=0x7fcbc40724d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:23.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.310+0000 7fcbcb000640 1 -- 172.21.15.6:0/4020463659 shutdown_connections 2024-09-10T20:56:23.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.310+0000 7fcbcb000640 1 -- 172.21.15.6:0/4020463659 wait complete. 2024-09-10T20:56:23.642 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-10T20:56:23.642 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:56:23.683 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T20:56:23.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.841+0000 7f5e3a000640 1 -- 172.21.15.6:0/2896637373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e340cf340 msgr2=0x7f5e34161a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:23.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.841+0000 7f5e3a000640 1 --2- 172.21.15.6:0/2896637373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e340cf340 0x7f5e34161a20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c005fd0 tx=0x7f5e1c02a670 comp rx=0 tx=0).stop 2024-09-10T20:56:23.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.841+0000 7f5e3a000640 1 -- 172.21.15.6:0/2896637373 shutdown_connections 2024-09-10T20:56:23.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.841+0000 7f5e3a000640 1 --2- 172.21.15.6:0/2896637373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e340cf340 0x7f5e34161a20 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:23.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.841+0000 7f5e3a000640 1 -- 172.21.15.6:0/2896637373 >> 172.21.15.6:0/2896637373 conn(0x7f5e340cfa20 msgr2=0x7f5e340cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:23.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.841+0000 7f5e3a000640 1 -- 172.21.15.6:0/2896637373 shutdown_connections 2024-09-10T20:56:23.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.841+0000 7f5e3a000640 1 -- 172.21.15.6:0/2896637373 wait complete. 2024-09-10T20:56:23.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.843+0000 7f5e3a000640 1 Processor -- start 2024-09-10T20:56:23.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.843+0000 7f5e3a000640 1 -- start start 2024-09-10T20:56:23.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.844+0000 7f5e3a000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e340cf340 0x7f5e34158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:23.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.844+0000 7f5e3a000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e3415bb30 0x7f5e3415d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:23.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.844+0000 7f5e3a000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e34161f60 0x7f5e341f8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:23.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.844+0000 7f5e3a000640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5e340ae320 con 0x7f5e340cf340 2024-09-10T20:56:23.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.844+0000 7f5e3a000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5e340ae1a0 con 0x7f5e34161f60 2024-09-10T20:56:23.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.844+0000 7f5e3a000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f5e340ae4a0 con 0x7f5e3415bb30 2024-09-10T20:56:23.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.844+0000 7f5e33400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e340cf340 0x7f5e34158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:23.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.844+0000 7f5e33400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e340cf340 0x7f5e34158590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52448/0 (socket says 172.21.15.6:52448) 2024-09-10T20:56:23.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.844+0000 7f5e33400640 1 -- 172.21.15.6:0/2265329263 learned_addr learned my addr 172.21.15.6:0/2265329263 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:23.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.845+0000 7f5e33e00640 1 --2- 172.21.15.6:0/2265329263 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e34161f60 0x7f5e341f8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:23.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.845+0000 7f5e2aa00640 1 --2- 172.21.15.6:0/2265329263 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e3415bb30 0x7f5e3415d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:23.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.845+0000 7f5e33400640 1 -- 172.21.15.6:0/2265329263 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e3415bb30 msgr2=0x7f5e3415d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:23.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.845+0000 7f5e33400640 1 --2- 172.21.15.6:0/2265329263 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e3415bb30 0x7f5e3415d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:23.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.845+0000 7f5e33400640 1 -- 172.21.15.6:0/2265329263 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e34161f60 msgr2=0x7f5e341f8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:23.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.845+0000 7f5e33400640 1 --2- 172.21.15.6:0/2265329263 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e34161f60 0x7f5e341f8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:23.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.845+0000 7f5e33400640 1 -- 172.21.15.6:0/2265329263 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e3415d8c0 con 0x7f5e340cf340 2024-09-10T20:56:23.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.845+0000 7f5e2aa00640 1 --2- 172.21.15.6:0/2265329263 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e3415bb30 0x7f5e3415d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:56:23.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.845+0000 7f5e33400640 1 --2- 172.21.15.6:0/2265329263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e340cf340 0x7f5e34158590 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5e2400c730 tx=0x7f5e2400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:23.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.845+0000 7f5e2be00640 1 -- 172.21.15.6:0/2265329263 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e24005070 con 0x7f5e340cf340 2024-09-10T20:56:23.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.845+0000 7f5e2be00640 1 -- 172.21.15.6:0/2265329263 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e24005230 con 0x7f5e340cf340 2024-09-10T20:56:23.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.845+0000 7f5e3a000640 1 -- 172.21.15.6:0/2265329263 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e341f4b90 con 0x7f5e340cf340 2024-09-10T20:56:23.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.845+0000 7f5e2be00640 1 -- 172.21.15.6:0/2265329263 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e2400a640 con 0x7f5e340cf340 2024-09-10T20:56:23.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.846+0000 7f5e3a000640 1 -- 172.21.15.6:0/2265329263 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e341f5150 con 0x7f5e340cf340 2024-09-10T20:56:23.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.847+0000 7f5e3a000640 1 -- 172.21.15.6:0/2265329263 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e340ae900 con 0x7f5e340cf340 2024-09-10T20:56:23.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.848+0000 7f5e2be00640 1 -- 172.21.15.6:0/2265329263 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5e2400a7e0 con 0x7f5e340cf340 2024-09-10T20:56:23.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.849+0000 7f5e2be00640 1 --2- 172.21.15.6:0/2265329263 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5e10077f70 0x7f5e1007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:23.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.849+0000 7f5e2be00640 1 -- 172.21.15.6:0/2265329263 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f5e240998e0 con 0x7f5e340cf340 2024-09-10T20:56:23.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.849+0000 7f5e2aa00640 1 --2- 172.21.15.6:0/2265329263 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5e10077f70 0x7f5e1007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:23.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.850+0000 7f5e2aa00640 1 --2- 172.21.15.6:0/2265329263 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5e10077f70 0x7f5e1007a430 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c033000 tx=0x7f5e1c004730 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:23.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:23.853+0000 7f5e2be00640 1 -- 172.21.15.6:0/2265329263 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5e340ce720 con 0x7f5e340cf340 2024-09-10T20:56:24.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.057+0000 7f5e3a000640 1 -- 172.21.15.6:0/2265329263 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5e34069d20 con 0x7f5e340cf340 2024-09-10T20:56:24.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.058+0000 7f5e2be00640 1 -- 172.21.15.6:0/2265329263 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f5e24062350 con 0x7f5e340cf340 2024-09-10T20:56:24.062 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2024-09-10T20:56:24.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.060+0000 7f5e3a000640 1 -- 172.21.15.6:0/2265329263 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5e10077f70 msgr2=0x7f5e1007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:24.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.060+0000 7f5e3a000640 1 --2- 172.21.15.6:0/2265329263 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5e10077f70 0x7f5e1007a430 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c033000 tx=0x7f5e1c004730 comp rx=0 tx=0).stop 2024-09-10T20:56:24.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.060+0000 7f5e3a000640 1 -- 172.21.15.6:0/2265329263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e340cf340 msgr2=0x7f5e34158590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:24.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.060+0000 7f5e3a000640 1 --2- 172.21.15.6:0/2265329263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e340cf340 0x7f5e34158590 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5e2400c730 tx=0x7f5e2400cbf0 comp rx=0 tx=0).stop 2024-09-10T20:56:24.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.060+0000 7f5e3a000640 1 -- 172.21.15.6:0/2265329263 shutdown_connections 2024-09-10T20:56:24.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.060+0000 7f5e3a000640 1 --2- 172.21.15.6:0/2265329263 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5e10077f70 0x7f5e1007a430 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:24.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.060+0000 7f5e3a000640 1 --2- 172.21.15.6:0/2265329263 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e34161f60 0x7f5e341f8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:24.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.060+0000 7f5e3a000640 1 --2- 172.21.15.6:0/2265329263 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e3415bb30 0x7f5e3415d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:24.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.060+0000 7f5e3a000640 1 --2- 172.21.15.6:0/2265329263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e340cf340 0x7f5e34158590 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:24.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.060+0000 7f5e3a000640 1 -- 172.21.15.6:0/2265329263 >> 172.21.15.6:0/2265329263 conn(0x7f5e340cfa20 msgr2=0x7f5e340738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:24.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.060+0000 7f5e3a000640 1 -- 172.21.15.6:0/2265329263 shutdown_connections 2024-09-10T20:56:24.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.060+0000 7f5e3a000640 1 -- 172.21.15.6:0/2265329263 wait complete. 2024-09-10T20:56:24.080 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi150.front.sepia.ceph.com... 2024-09-10T20:56:24.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:24.080 DEBUG:teuthology.orchestra.run.smithi150:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-09-10T20:56:24.144 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:56:24.144 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2024-09-10T20:56:24.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:24.144 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-10T20:56:24.182 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T20:56:24.182 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:56:24.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.338+0000 7ff7b8c00640 1 -- 172.21.15.6:0/3692050070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7b4070450 msgr2=0x7ff7b40cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:24.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.338+0000 7ff7b8c00640 1 --2- 172.21.15.6:0/3692050070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7b4070450 0x7ff7b40cd920 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4051860 tx=0x7ff7ac02a820 comp rx=0 tx=0).stop 2024-09-10T20:56:24.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.338+0000 7ff7b8c00640 1 -- 172.21.15.6:0/3692050070 shutdown_connections 2024-09-10T20:56:24.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.338+0000 7ff7b8c00640 1 --2- 172.21.15.6:0/3692050070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7b4070450 0x7ff7b40cd920 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:24.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.338+0000 7ff7b8c00640 1 --2- 172.21.15.6:0/3692050070 >> v2:172.21.15.150:3300/0 conn(0x7ff7b4159670 0x7ff7b40743b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:24.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.338+0000 7ff7b8c00640 1 -- 172.21.15.6:0/3692050070 >> 172.21.15.6:0/3692050070 conn(0x7ff7b40cfa20 msgr2=0x7ff7b40cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:24.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.338+0000 7ff7b8c00640 1 -- 172.21.15.6:0/3692050070 shutdown_connections 2024-09-10T20:56:24.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.338+0000 7ff7b8c00640 1 -- 172.21.15.6:0/3692050070 wait complete. 2024-09-10T20:56:24.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.340+0000 7ff7b8c00640 1 Processor -- start 2024-09-10T20:56:24.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.340+0000 7ff7b8c00640 1 -- start start 2024-09-10T20:56:24.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.341+0000 7ff7b8c00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7b4070450 0x7ff7b414a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:24.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.341+0000 7ff7b8c00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7b4159670 0x7ff7b40c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:24.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.341+0000 7ff7b8c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7b415c170 0x7ff7b40c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:24.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.341+0000 7ff7b8c00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b40b4a90 con 0x7ff7b4159670 2024-09-10T20:56:24.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.341+0000 7ff7b8c00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b40b4910 con 0x7ff7b415c170 2024-09-10T20:56:24.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.341+0000 7ff7b8c00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ff7b40b4c10 con 0x7ff7b4070450 2024-09-10T20:56:24.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.341+0000 7ff7a9400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7b4159670 0x7ff7b40c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:24.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.341+0000 7ff7a9400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7b4159670 0x7ff7b40c6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52472/0 (socket says 172.21.15.6:52472) 2024-09-10T20:56:24.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.341+0000 7ff7a9400640 1 -- 172.21.15.6:0/935720936 learned_addr learned my addr 172.21.15.6:0/935720936 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:24.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.341+0000 7ff7b1e00640 1 --2- 172.21.15.6:0/935720936 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7b4070450 0x7ff7b414a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:24.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.341+0000 7ff7b2800640 1 --2- 172.21.15.6:0/935720936 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7b415c170 0x7ff7b40c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:24.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.342+0000 7ff7a9400640 1 -- 172.21.15.6:0/935720936 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7b4070450 msgr2=0x7ff7b414a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:24.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.342+0000 7ff7a9400640 1 --2- 172.21.15.6:0/935720936 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7b4070450 0x7ff7b414a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:24.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.342+0000 7ff7a9400640 1 -- 172.21.15.6:0/935720936 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7b415c170 msgr2=0x7ff7b40c97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:24.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.342+0000 7ff7a9400640 1 --2- 172.21.15.6:0/935720936 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7b415c170 0x7ff7b40c97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:24.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.342+0000 7ff7a9400640 1 -- 172.21.15.6:0/935720936 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7b414af90 con 0x7ff7b4159670 2024-09-10T20:56:24.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.342+0000 7ff7a9400640 1 --2- 172.21.15.6:0/935720936 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7b4159670 0x7ff7b40c6c80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff79c00c430 tx=0x7ff79c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:24.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.342+0000 7ff7aaa00640 1 -- 172.21.15.6:0/935720936 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff79c006890 con 0x7ff7b4159670 2024-09-10T20:56:24.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.342+0000 7ff7aaa00640 1 -- 172.21.15.6:0/935720936 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff79c006b40 con 0x7ff7b4159670 2024-09-10T20:56:24.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.342+0000 7ff7aaa00640 1 -- 172.21.15.6:0/935720936 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff79c007020 con 0x7ff7b4159670 2024-09-10T20:56:24.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.342+0000 7ff7b8c00640 1 -- 172.21.15.6:0/935720936 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7b414b270 con 0x7ff7b4159670 2024-09-10T20:56:24.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.342+0000 7ff7b8c00640 1 -- 172.21.15.6:0/935720936 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7b40c71c0 con 0x7ff7b4159670 2024-09-10T20:56:24.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.343+0000 7ff7b8c00640 1 -- 172.21.15.6:0/935720936 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7b40743b0 con 0x7ff7b4159670 2024-09-10T20:56:24.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.345+0000 7ff7aaa00640 1 -- 172.21.15.6:0/935720936 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff79c0071c0 con 0x7ff7b4159670 2024-09-10T20:56:24.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.346+0000 7ff7aaa00640 1 --2- 172.21.15.6:0/935720936 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ff790077f70 0x7ff79007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:24.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.346+0000 7ff7aaa00640 1 -- 172.21.15.6:0/935720936 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7ff79c099780 con 0x7ff7b4159670 2024-09-10T20:56:24.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.346+0000 7ff7b1e00640 1 --2- 172.21.15.6:0/935720936 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ff790077f70 0x7ff79007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:24.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.347+0000 7ff7b1e00640 1 --2- 172.21.15.6:0/935720936 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ff790077f70 0x7ff79007a430 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4009bd0 tx=0x7ff7a4005f90 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:24.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.350+0000 7ff7aaa00640 1 -- 172.21.15.6:0/935720936 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff79c061b10 con 0x7ff7b4159670 2024-09-10T20:56:24.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.588+0000 7ff7b8c00640 1 -- 172.21.15.6:0/935720936 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff7b4069d20 con 0x7ff7b4159670 2024-09-10T20:56:24.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.589+0000 7ff7aaa00640 1 -- 172.21.15.6:0/935720936 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5211 (secure 0 0 0) 0x7ff79c066540 con 0x7ff7b4159670 2024-09-10T20:56:24.593 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:56:24.593 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"btime":"2024-09-10T20:55:47:367368+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4329,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/77885972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":77885972},{"type":"v1","addr":"172.21.15.6:6834","nonce":77885972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4341,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/1181849476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1181849476},{"type":"v1","addr":"172.21.15.150:6836","nonce":1181849476}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4344,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/3860565837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":3860565837},{"type":"v1","addr":"172.21.15.150:6837","nonce":3860565837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:55:43.801792+0000","modified":"2024-09-10T20:55:46.798409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4375},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4375":{"gid":4375,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/3230367141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3230367141},{"type":"v1","addr":"172.21.15.6:6835","nonce":3230367141}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4375,"qdb_cluster":[4375]},"id":1}]} 2024-09-10T20:56:24.593 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2024-09-10T20:56:24.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.591+0000 7ff7b8c00640 1 -- 172.21.15.6:0/935720936 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ff790077f70 msgr2=0x7ff79007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:24.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.591+0000 7ff7b8c00640 1 --2- 172.21.15.6:0/935720936 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ff790077f70 0x7ff79007a430 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4009bd0 tx=0x7ff7a4005f90 comp rx=0 tx=0).stop 2024-09-10T20:56:24.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.591+0000 7ff7b8c00640 1 -- 172.21.15.6:0/935720936 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7b4159670 msgr2=0x7ff7b40c6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:24.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.591+0000 7ff7b8c00640 1 --2- 172.21.15.6:0/935720936 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7b4159670 0x7ff7b40c6c80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff79c00c430 tx=0x7ff79c00c8f0 comp rx=0 tx=0).stop 2024-09-10T20:56:24.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.591+0000 7ff7b8c00640 1 -- 172.21.15.6:0/935720936 shutdown_connections 2024-09-10T20:56:24.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.591+0000 7ff7b8c00640 1 --2- 172.21.15.6:0/935720936 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ff790077f70 0x7ff79007a430 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:24.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.591+0000 7ff7b8c00640 1 --2- 172.21.15.6:0/935720936 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7b4159670 0x7ff7b40c6c80 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:24.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.591+0000 7ff7b8c00640 1 --2- 172.21.15.6:0/935720936 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7b415c170 0x7ff7b40c97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:24.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.591+0000 7ff7b8c00640 1 --2- 172.21.15.6:0/935720936 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7b4070450 0x7ff7b414a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:24.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.591+0000 7ff7b8c00640 1 -- 172.21.15.6:0/935720936 >> 172.21.15.6:0/935720936 conn(0x7ff7b40cfa20 msgr2=0x7ff7b40b3040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:24.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.591+0000 7ff7b8c00640 1 -- 172.21.15.6:0/935720936 shutdown_connections 2024-09-10T20:56:24.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.592+0000 7ff7b8c00640 1 -- 172.21.15.6:0/935720936 wait complete. 2024-09-10T20:56:24.612 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:56:24.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.769+0000 7f140f600640 1 -- 172.21.15.6:0/4256299914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f140815c170 msgr2=0x7f14080cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:24.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.769+0000 7f140f600640 1 --2- 172.21.15.6:0/4256299914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f140815c170 0x7f14080cd920 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f13f0005fd0 tx=0x7f13f002a540 comp rx=0 tx=0).stop 2024-09-10T20:56:24.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.769+0000 7f140f600640 1 -- 172.21.15.6:0/4256299914 shutdown_connections 2024-09-10T20:56:24.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.769+0000 7f140f600640 1 --2- 172.21.15.6:0/4256299914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f140815c170 0x7f14080cd920 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:24.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.769+0000 7f140f600640 1 --2- 172.21.15.6:0/4256299914 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1408159670 0x7f14080743b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:24.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.769+0000 7f140f600640 1 -- 172.21.15.6:0/4256299914 >> 172.21.15.6:0/4256299914 conn(0x7f14080cfa20 msgr2=0x7f14080cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:24.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.770+0000 7f140f600640 1 -- 172.21.15.6:0/4256299914 shutdown_connections 2024-09-10T20:56:24.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.770+0000 7f140f600640 1 -- 172.21.15.6:0/4256299914 wait complete. 2024-09-10T20:56:24.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.771+0000 7f140f600640 1 Processor -- start 2024-09-10T20:56:24.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.771+0000 7f140f600640 1 -- start start 2024-09-10T20:56:24.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.772+0000 7f140f600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f140806fd40 0x7f140814ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:24.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.772+0000 7f140f600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1408159670 0x7f14080ad880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:24.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.772+0000 7f140f600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f140815c170 0x7f14080addc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:24.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.772+0000 7f140f600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f14080b4ca0 con 0x7f1408159670 2024-09-10T20:56:24.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.772+0000 7f140f600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f14080b4b20 con 0x7f140815c170 2024-09-10T20:56:24.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.772+0000 7f140f600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f14080b4e20 con 0x7f140806fd40 2024-09-10T20:56:24.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.772+0000 7f13ffe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1408159670 0x7f14080ad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:24.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.773+0000 7f13ffe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1408159670 0x7f14080ad880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52492/0 (socket says 172.21.15.6:52492) 2024-09-10T20:56:24.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.773+0000 7f13ffe00640 1 -- 172.21.15.6:0/1690020371 learned_addr learned my addr 172.21.15.6:0/1690020371 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:24.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.773+0000 7f140cc00640 1 --2- 172.21.15.6:0/1690020371 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f140806fd40 0x7f140814ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:24.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.773+0000 7f140d600640 1 --2- 172.21.15.6:0/1690020371 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f140815c170 0x7f14080addc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:24.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.773+0000 7f13ffe00640 1 -- 172.21.15.6:0/1690020371 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f140806fd40 msgr2=0x7f140814ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:24.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.773+0000 7f13ffe00640 1 --2- 172.21.15.6:0/1690020371 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f140806fd40 0x7f140814ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:24.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.773+0000 7f13ffe00640 1 -- 172.21.15.6:0/1690020371 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f140815c170 msgr2=0x7f14080addc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:24.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.773+0000 7f13ffe00640 1 --2- 172.21.15.6:0/1690020371 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f140815c170 0x7f14080addc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:24.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.773+0000 7f13ffe00640 1 -- 172.21.15.6:0/1690020371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14080c6af0 con 0x7f1408159670 2024-09-10T20:56:24.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.773+0000 7f13ffe00640 1 --2- 172.21.15.6:0/1690020371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1408159670 0x7f14080ad880 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f13f0009850 tx=0x7f13f00038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:24.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.774+0000 7f1405600640 1 -- 172.21.15.6:0/1690020371 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f003f070 con 0x7f1408159670 2024-09-10T20:56:24.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.774+0000 7f1405600640 1 -- 172.21.15.6:0/1690020371 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f13f00047a0 con 0x7f1408159670 2024-09-10T20:56:24.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.774+0000 7f1405600640 1 -- 172.21.15.6:0/1690020371 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f0035030 con 0x7f1408159670 2024-09-10T20:56:24.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.774+0000 7f140f600640 1 -- 172.21.15.6:0/1690020371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14080ca210 con 0x7f1408159670 2024-09-10T20:56:24.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.774+0000 7f140f600640 1 -- 172.21.15.6:0/1690020371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14080ca7d0 con 0x7f1408159670 2024-09-10T20:56:24.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.775+0000 7f140f600640 1 -- 172.21.15.6:0/1690020371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14080b5340 con 0x7f1408159670 2024-09-10T20:56:24.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.776+0000 7f1405600640 1 -- 172.21.15.6:0/1690020371 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f13f0004b90 con 0x7f1408159670 2024-09-10T20:56:24.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.777+0000 7f1405600640 1 --2- 172.21.15.6:0/1690020371 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f13e4077f70 0x7f13e407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:24.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.777+0000 7f1405600640 1 -- 172.21.15.6:0/1690020371 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f13f00bb070 con 0x7f1408159670 2024-09-10T20:56:24.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.777+0000 7f140cc00640 1 --2- 172.21.15.6:0/1690020371 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f13e4077f70 0x7f13e407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:24.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.778+0000 7f140cc00640 1 --2- 172.21.15.6:0/1690020371 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f13e4077f70 0x7f13e407a430 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f13f800bbe0 tx=0x7f13f800b390 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:24.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:24.781+0000 7f1405600640 1 -- 172.21.15.6:0/1690020371 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f13f0083370 con 0x7f1408159670 2024-09-10T20:56:25.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.017+0000 7f140f600640 1 -- 172.21.15.6:0/1690020371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1408069d20 con 0x7f1408159670 2024-09-10T20:56:25.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.017+0000 7f1405600640 1 -- 172.21.15.6:0/1690020371 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5211 (secure 0 0 0) 0x7f13f0087da0 con 0x7f1408159670 2024-09-10T20:56:25.022 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:56:25.022 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"btime":"2024-09-10T20:55:47:367368+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4329,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/77885972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":77885972},{"type":"v1","addr":"172.21.15.6:6834","nonce":77885972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4341,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/1181849476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1181849476},{"type":"v1","addr":"172.21.15.150:6836","nonce":1181849476}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4344,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/3860565837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":3860565837},{"type":"v1","addr":"172.21.15.150:6837","nonce":3860565837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:55:43.801792+0000","modified":"2024-09-10T20:55:46.798409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4375},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4375":{"gid":4375,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/3230367141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3230367141},{"type":"v1","addr":"172.21.15.6:6835","nonce":3230367141}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4375,"qdb_cluster":[4375]},"id":1}]} 2024-09-10T20:56:25.022 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2024-09-10T20:56:25.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.020+0000 7f140f600640 1 -- 172.21.15.6:0/1690020371 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f13e4077f70 msgr2=0x7f13e407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:25.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.020+0000 7f140f600640 1 --2- 172.21.15.6:0/1690020371 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f13e4077f70 0x7f13e407a430 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f13f800bbe0 tx=0x7f13f800b390 comp rx=0 tx=0).stop 2024-09-10T20:56:25.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.020+0000 7f140f600640 1 -- 172.21.15.6:0/1690020371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1408159670 msgr2=0x7f14080ad880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:25.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.020+0000 7f140f600640 1 --2- 172.21.15.6:0/1690020371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1408159670 0x7f14080ad880 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f13f0009850 tx=0x7f13f00038a0 comp rx=0 tx=0).stop 2024-09-10T20:56:25.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.020+0000 7f140f600640 1 -- 172.21.15.6:0/1690020371 shutdown_connections 2024-09-10T20:56:25.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.020+0000 7f140f600640 1 --2- 172.21.15.6:0/1690020371 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f13e4077f70 0x7f13e407a430 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:25.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.020+0000 7f140f600640 1 --2- 172.21.15.6:0/1690020371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1408159670 0x7f14080ad880 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:25.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.020+0000 7f140f600640 1 --2- 172.21.15.6:0/1690020371 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f140815c170 0x7f14080addc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:25.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.020+0000 7f140f600640 1 --2- 172.21.15.6:0/1690020371 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f140806fd40 0x7f140814ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:25.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.020+0000 7f140f600640 1 -- 172.21.15.6:0/1690020371 >> 172.21.15.6:0/1690020371 conn(0x7f14080cfa20 msgr2=0x7f140815ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:25.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.020+0000 7f140f600640 1 -- 172.21.15.6:0/1690020371 shutdown_connections 2024-09-10T20:56:25.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.020+0000 7f140f600640 1 -- 172.21.15.6:0/1690020371 wait complete. 2024-09-10T20:56:25.040 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T20:56:25.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.196+0000 7fdf9a800640 1 -- 172.21.15.6:0/2353798223 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf94159670 msgr2=0x7fdf940743b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:25.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.196+0000 7fdf9a800640 1 --2- 172.21.15.6:0/2353798223 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf94159670 0x7fdf940743b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdf84005fd0 tx=0x7fdf8402a540 comp rx=0 tx=0).stop 2024-09-10T20:56:25.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.197+0000 7fdf9a800640 1 -- 172.21.15.6:0/2353798223 shutdown_connections 2024-09-10T20:56:25.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.197+0000 7fdf9a800640 1 --2- 172.21.15.6:0/2353798223 >> v2:172.21.15.150:3300/0 conn(0x7fdf9415c170 0x7fdf940cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:25.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.197+0000 7fdf9a800640 1 --2- 172.21.15.6:0/2353798223 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf94159670 0x7fdf940743b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:25.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.197+0000 7fdf9a800640 1 -- 172.21.15.6:0/2353798223 >> 172.21.15.6:0/2353798223 conn(0x7fdf940cfa20 msgr2=0x7fdf940cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:25.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.197+0000 7fdf9a800640 1 -- 172.21.15.6:0/2353798223 shutdown_connections 2024-09-10T20:56:25.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.197+0000 7fdf9a800640 1 -- 172.21.15.6:0/2353798223 wait complete. 2024-09-10T20:56:25.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.198+0000 7fdf9a800640 1 Processor -- start 2024-09-10T20:56:25.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.198+0000 7fdf9a800640 1 -- start start 2024-09-10T20:56:25.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.199+0000 7fdf9a800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf9406fd40 0x7fdf94154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:25.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.199+0000 7fdf9a800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf94159670 0x7fdf940ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:25.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.199+0000 7fdf9a800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf9415c170 0x7fdf940addf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:25.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.199+0000 7fdf9a800640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdf940b4ca0 con 0x7fdf9406fd40 2024-09-10T20:56:25.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.199+0000 7fdf9a800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fdf940b4b20 con 0x7fdf9415c170 2024-09-10T20:56:25.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.199+0000 7fdf9a800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fdf940b4e20 con 0x7fdf94159670 2024-09-10T20:56:25.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.200+0000 7fdf93400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf9406fd40 0x7fdf94154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:25.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.200+0000 7fdf93400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf9406fd40 0x7fdf94154f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52506/0 (socket says 172.21.15.6:52506) 2024-09-10T20:56:25.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.200+0000 7fdf93400640 1 -- 172.21.15.6:0/870151156 learned_addr learned my addr 172.21.15.6:0/870151156 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:25.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.200+0000 7fdf92a00640 1 --2- 172.21.15.6:0/870151156 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf94159670 0x7fdf940ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:25.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.200+0000 7fdf93e00640 1 --2- 172.21.15.6:0/870151156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf9415c170 0x7fdf940addf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:25.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.200+0000 7fdf93400640 1 -- 172.21.15.6:0/870151156 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf94159670 msgr2=0x7fdf940ad8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:25.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.200+0000 7fdf93400640 1 --2- 172.21.15.6:0/870151156 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf94159670 0x7fdf940ad8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:25.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.200+0000 7fdf93400640 1 -- 172.21.15.6:0/870151156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf9415c170 msgr2=0x7fdf940addf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:25.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.200+0000 7fdf93400640 1 --2- 172.21.15.6:0/870151156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf9415c170 0x7fdf940addf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:25.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.200+0000 7fdf93400640 1 -- 172.21.15.6:0/870151156 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf941f9360 con 0x7fdf9406fd40 2024-09-10T20:56:25.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.200+0000 7fdf93400640 1 --2- 172.21.15.6:0/870151156 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf9406fd40 0x7fdf94154f10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdf84009850 tx=0x7fdf840038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:25.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.201+0000 7fdf8b400640 1 -- 172.21.15.6:0/870151156 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8403f070 con 0x7fdf9406fd40 2024-09-10T20:56:25.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.201+0000 7fdf8b400640 1 -- 172.21.15.6:0/870151156 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf840047a0 con 0x7fdf9406fd40 2024-09-10T20:56:25.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.201+0000 7fdf8b400640 1 -- 172.21.15.6:0/870151156 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf84035030 con 0x7fdf9406fd40 2024-09-10T20:56:25.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.201+0000 7fdf9a800640 1 -- 172.21.15.6:0/870151156 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf941574b0 con 0x7fdf9406fd40 2024-09-10T20:56:25.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.201+0000 7fdf9a800640 1 -- 172.21.15.6:0/870151156 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf94155450 con 0x7fdf9406fd40 2024-09-10T20:56:25.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.202+0000 7fdf9a800640 1 -- 172.21.15.6:0/870151156 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf940b5340 con 0x7fdf9406fd40 2024-09-10T20:56:25.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.203+0000 7fdf8b400640 1 -- 172.21.15.6:0/870151156 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fdf84004b90 con 0x7fdf9406fd40 2024-09-10T20:56:25.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.204+0000 7fdf8b400640 1 --2- 172.21.15.6:0/870151156 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fdf74077f70 0x7fdf7407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:25.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.204+0000 7fdf8b400640 1 -- 172.21.15.6:0/870151156 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7fdf840bb290 con 0x7fdf9406fd40 2024-09-10T20:56:25.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.205+0000 7fdf92a00640 1 --2- 172.21.15.6:0/870151156 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fdf74077f70 0x7fdf7407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:25.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.205+0000 7fdf92a00640 1 --2- 172.21.15.6:0/870151156 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fdf74077f70 0x7fdf7407a430 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdf940c34f0 tx=0x7fdf80005f90 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:25.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.208+0000 7fdf8b400640 1 -- 172.21.15.6:0/870151156 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fdf84083590 con 0x7fdf9406fd40 2024-09-10T20:56:25.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.404+0000 7fdf9a800640 1 -- 172.21.15.6:0/870151156 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdf94069d20 con 0x7fdf9406fd40 2024-09-10T20:56:25.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.405+0000 7fdf8b400640 1 -- 172.21.15.6:0/870151156 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+16854 (secure 0 0 0) 0x7fdf84087fc0 con 0x7fdf9406fd40 2024-09-10T20:56:25.409 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:56:25.409 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":24,"fsid":"9e04309e-61c3-4c78-82db-9576e465d98a","created":"2024-09-10T20:55:17.972466+0000","modified":"2024-09-10T20:56:24.500506+0000","last_up_change":"2024-09-10T20:55:32.392769+0000","last_in_change":"2024-09-10T20:55:22.232252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:55:33.196464+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:55:41.833420+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T20:55:42.749182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0918c5c8-a028-4987-bad2-406c412ec3f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6801","nonce":895515615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6803","nonce":895515615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6807","nonce":895515615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6805","nonce":895515615}]},"public_addr":"172.21.15.6:6801/895515615","cluster_addr":"172.21.15.6:6803/895515615","heartbeat_back_addr":"172.21.15.6:6807/895515615","heartbeat_front_addr":"172.21.15.6:6805/895515615","state":["exists","up"]},{"osd":1,"uuid":"415e9c78-c3d9-46d6-b277-348453f42155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6809","nonce":1129113250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6811","nonce":1129113250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6815","nonce":1129113250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6813","nonce":1129113250}]},"public_addr":"172.21.15.6:6809/1129113250","cluster_addr":"172.21.15.6:6811/1129113250","heartbeat_back_addr":"172.21.15.6:6815/1129113250","heartbeat_front_addr":"172.21.15.6:6813/1129113250","state":["exists","up"]},{"osd":2,"uuid":"763c1cf2-a43d-4c10-815d-eaf4a32afc1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6825","nonce":3847470051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6827","nonce":3847470051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6831","nonce":3847470051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6829","nonce":3847470051}]},"public_addr":"172.21.15.6:6825/3847470051","cluster_addr":"172.21.15.6:6827/3847470051","heartbeat_back_addr":"172.21.15.6:6831/3847470051","heartbeat_front_addr":"172.21.15.6:6829/3847470051","state":["exists","up"]},{"osd":3,"uuid":"877b1cc1-2434-4b32-af66-9c2485eac9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6817","nonce":3911674247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6819","nonce":3911674247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6823","nonce":3911674247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6821","nonce":3911674247}]},"public_addr":"172.21.15.6:6817/3911674247","cluster_addr":"172.21.15.6:6819/3911674247","heartbeat_back_addr":"172.21.15.6:6823/3911674247","heartbeat_front_addr":"172.21.15.6:6821/3911674247","state":["exists","up"]},{"osd":4,"uuid":"e0b27501-dfdc-4e7f-b73a-9573c869267a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6827","nonce":2568527750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6829","nonce":2568527750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6833","nonce":2568527750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6831","nonce":2568527750}]},"public_addr":"172.21.15.150:6827/2568527750","cluster_addr":"172.21.15.150:6829/2568527750","heartbeat_back_addr":"172.21.15.150:6833/2568527750","heartbeat_front_addr":"172.21.15.150:6831/2568527750","state":["exists","up"]},{"osd":5,"uuid":"67e48053-4f15-44fd-a30c-c9522f86d169","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6811","nonce":371417736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6813","nonce":371417736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6817","nonce":371417736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6815","nonce":371417736}]},"public_addr":"172.21.15.150:6811/371417736","cluster_addr":"172.21.15.150:6813/371417736","heartbeat_back_addr":"172.21.15.150:6817/371417736","heartbeat_front_addr":"172.21.15.150:6815/371417736","state":["exists","up"]},{"osd":6,"uuid":"1456df2e-ae91-45a4-bc3a-a06c753092af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6819","nonce":2329248366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6821","nonce":2329248366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6825","nonce":2329248366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6823","nonce":2329248366}]},"public_addr":"172.21.15.150:6819/2329248366","cluster_addr":"172.21.15.150:6821/2329248366","heartbeat_back_addr":"172.21.15.150:6825/2329248366","heartbeat_front_addr":"172.21.15.150:6823/2329248366","state":["exists","up"]},{"osd":7,"uuid":"a9daafcb-5ecd-43bd-ab0a-dc4b480cfc2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6803","nonce":527018351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6805","nonce":527018351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6809","nonce":527018351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6807","nonce":527018351}]},"public_addr":"172.21.15.150:6803/527018351","cluster_addr":"172.21.15.150:6805/527018351","heartbeat_back_addr":"172.21.15.150:6809/527018351","heartbeat_front_addr":"172.21.15.150:6807/527018351","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.710061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.024506+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.824320+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.431608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.637032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.054828+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.333290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.358875+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":1}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:56:25.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.407+0000 7fdf9a800640 1 -- 172.21.15.6:0/870151156 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fdf74077f70 msgr2=0x7fdf7407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:25.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.407+0000 7fdf9a800640 1 --2- 172.21.15.6:0/870151156 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fdf74077f70 0x7fdf7407a430 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdf940c34f0 tx=0x7fdf80005f90 comp rx=0 tx=0).stop 2024-09-10T20:56:25.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.407+0000 7fdf9a800640 1 -- 172.21.15.6:0/870151156 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf9406fd40 msgr2=0x7fdf94154f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:25.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.407+0000 7fdf9a800640 1 --2- 172.21.15.6:0/870151156 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf9406fd40 0x7fdf94154f10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdf84009850 tx=0x7fdf840038a0 comp rx=0 tx=0).stop 2024-09-10T20:56:25.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.408+0000 7fdf9a800640 1 -- 172.21.15.6:0/870151156 shutdown_connections 2024-09-10T20:56:25.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.408+0000 7fdf9a800640 1 --2- 172.21.15.6:0/870151156 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fdf74077f70 0x7fdf7407a430 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:25.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.408+0000 7fdf9a800640 1 --2- 172.21.15.6:0/870151156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf9415c170 0x7fdf940addf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:25.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.408+0000 7fdf9a800640 1 --2- 172.21.15.6:0/870151156 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf94159670 0x7fdf940ad8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:25.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.408+0000 7fdf9a800640 1 --2- 172.21.15.6:0/870151156 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf9406fd40 0x7fdf94154f10 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:25.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.408+0000 7fdf9a800640 1 -- 172.21.15.6:0/870151156 >> 172.21.15.6:0/870151156 conn(0x7fdf940cfa20 msgr2=0x7fdf940cdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:25.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.408+0000 7fdf9a800640 1 -- 172.21.15.6:0/870151156 shutdown_connections 2024-09-10T20:56:25.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.408+0000 7fdf9a800640 1 -- 172.21.15.6:0/870151156 wait complete. 2024-09-10T20:56:25.427 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T20:56:25.428 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:56:25.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.584+0000 7f9f62000640 1 -- 172.21.15.6:0/960272169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f5c0ce9b0 msgr2=0x7f9f5c0cab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:25.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.584+0000 7f9f62000640 1 --2- 172.21.15.6:0/960272169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f5c0ce9b0 0x7f9f5c0cab60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9f54005fd0 tx=0x7f9f5402ab20 comp rx=0 tx=0).stop 2024-09-10T20:56:25.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.585+0000 7f9f62000640 1 -- 172.21.15.6:0/960272169 shutdown_connections 2024-09-10T20:56:25.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.585+0000 7f9f62000640 1 --2- 172.21.15.6:0/960272169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f5c0ce9b0 0x7f9f5c0cab60 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:25.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.585+0000 7f9f62000640 1 --2- 172.21.15.6:0/960272169 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f5c0cbe30 0x7f9f5c0ce470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:25.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.585+0000 7f9f62000640 1 -- 172.21.15.6:0/960272169 >> 172.21.15.6:0/960272169 conn(0x7f9f5c0d0250 msgr2=0x7f9f5c0d0660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:25.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.585+0000 7f9f62000640 1 -- 172.21.15.6:0/960272169 shutdown_connections 2024-09-10T20:56:25.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.585+0000 7f9f62000640 1 -- 172.21.15.6:0/960272169 wait complete. 2024-09-10T20:56:25.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.586+0000 7f9f62000640 1 Processor -- start 2024-09-10T20:56:25.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.586+0000 7f9f62000640 1 -- start start 2024-09-10T20:56:25.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.587+0000 7f9f62000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f5c0cbe30 0x7f9f5c0b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:25.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.587+0000 7f9f62000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f5c0ce090 0x7f9f5c0b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:25.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.587+0000 7f9f62000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f5c0ce9b0 0x7f9f5c1563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:25.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.587+0000 7f9f62000640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9f5c0cc3f0 con 0x7f9f5c0ce9b0 2024-09-10T20:56:25.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.587+0000 7f9f62000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9f5c0cc270 con 0x7f9f5c0ce090 2024-09-10T20:56:25.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.587+0000 7f9f62000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f9f5c0cc7c0 con 0x7f9f5c0cbe30 2024-09-10T20:56:25.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.588+0000 7f9f5be00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f5c0ce9b0 0x7f9f5c1563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:25.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.588+0000 7f9f5be00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f5c0ce9b0 0x7f9f5c1563f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52534/0 (socket says 172.21.15.6:52534) 2024-09-10T20:56:25.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.588+0000 7f9f52a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f5c0ce090 0x7f9f5c0b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:25.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.588+0000 7f9f5be00640 1 -- 172.21.15.6:0/779388696 learned_addr learned my addr 172.21.15.6:0/779388696 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:25.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.588+0000 7f9f5b400640 1 --2- 172.21.15.6:0/779388696 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f5c0cbe30 0x7f9f5c0b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:25.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.588+0000 7f9f5be00640 1 -- 172.21.15.6:0/779388696 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f5c0cbe30 msgr2=0x7f9f5c0b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:25.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.588+0000 7f9f5be00640 1 --2- 172.21.15.6:0/779388696 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f5c0cbe30 0x7f9f5c0b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:25.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.588+0000 7f9f5be00640 1 -- 172.21.15.6:0/779388696 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f5c0ce090 msgr2=0x7f9f5c0b41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:25.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.588+0000 7f9f5be00640 1 --2- 172.21.15.6:0/779388696 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f5c0ce090 0x7f9f5c0b41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:25.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.588+0000 7f9f5be00640 1 -- 172.21.15.6:0/779388696 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f5c0b4950 con 0x7f9f5c0ce9b0 2024-09-10T20:56:25.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.588+0000 7f9f5be00640 1 --2- 172.21.15.6:0/779388696 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f5c0ce9b0 0x7f9f5c1563f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9f54006010 tx=0x7f9f54003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:25.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.589+0000 7f9f53e00640 1 -- 172.21.15.6:0/779388696 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f54044070 con 0x7f9f5c0ce9b0 2024-09-10T20:56:25.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.589+0000 7f9f53e00640 1 -- 172.21.15.6:0/779388696 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f5402c820 con 0x7f9f5c0ce9b0 2024-09-10T20:56:25.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.589+0000 7f9f62000640 1 -- 172.21.15.6:0/779388696 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f5c1f8030 con 0x7f9f5c0ce9b0 2024-09-10T20:56:25.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.589+0000 7f9f53e00640 1 -- 172.21.15.6:0/779388696 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f540044b0 con 0x7f9f5c0ce9b0 2024-09-10T20:56:25.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.589+0000 7f9f62000640 1 -- 172.21.15.6:0/779388696 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f5c1f82d0 con 0x7f9f5c0ce9b0 2024-09-10T20:56:25.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.590+0000 7f9f62000640 1 -- 172.21.15.6:0/779388696 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f5c0ce470 con 0x7f9f5c0ce9b0 2024-09-10T20:56:25.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.591+0000 7f9f53e00640 1 -- 172.21.15.6:0/779388696 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f9f54004650 con 0x7f9f5c0ce9b0 2024-09-10T20:56:25.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.592+0000 7f9f53e00640 1 --2- 172.21.15.6:0/779388696 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f9f38077fa0 0x7f9f3807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:25.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.592+0000 7f9f53e00640 1 -- 172.21.15.6:0/779388696 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f9f540ba470 con 0x7f9f5c0ce9b0 2024-09-10T20:56:25.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.592+0000 7f9f5b400640 1 --2- 172.21.15.6:0/779388696 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f9f38077fa0 0x7f9f3807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:25.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.593+0000 7f9f5b400640 1 --2- 172.21.15.6:0/779388696 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f9f38077fa0 0x7f9f3807a460 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c06fe50 tx=0x7f9f4c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:25.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.596+0000 7f9f53e00640 1 -- 172.21.15.6:0/779388696 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f9f54032030 con 0x7f9f5c0ce9b0 2024-09-10T20:56:25.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.824+0000 7f9f62000640 1 -- 172.21.15.6:0/779388696 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9f5c0cd360 con 0x7f9f5c0ce9b0 2024-09-10T20:56:25.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.824+0000 7f9f53e00640 1 -- 172.21.15.6:0/779388696 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5211 (secure 0 0 0) 0x7f9f54082890 con 0x7f9f5c0ce9b0 2024-09-10T20:56:25.828 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:56:25.829 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"btime":"2024-09-10T20:55:47:367368+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4329,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/77885972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":77885972},{"type":"v1","addr":"172.21.15.6:6834","nonce":77885972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4341,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/1181849476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1181849476},{"type":"v1","addr":"172.21.15.150:6836","nonce":1181849476}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4344,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/3860565837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":3860565837},{"type":"v1","addr":"172.21.15.150:6837","nonce":3860565837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:55:43.801792+0000","modified":"2024-09-10T20:55:46.798409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4375},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4375":{"gid":4375,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/3230367141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3230367141},{"type":"v1","addr":"172.21.15.6:6835","nonce":3230367141}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4375,"qdb_cluster":[4375]},"id":1}]} 2024-09-10T20:56:25.829 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2024-09-10T20:56:25.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.826+0000 7f9f62000640 1 -- 172.21.15.6:0/779388696 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f9f38077fa0 msgr2=0x7f9f3807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:25.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.826+0000 7f9f62000640 1 --2- 172.21.15.6:0/779388696 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f9f38077fa0 0x7f9f3807a460 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c06fe50 tx=0x7f9f4c009040 comp rx=0 tx=0).stop 2024-09-10T20:56:25.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.827+0000 7f9f62000640 1 -- 172.21.15.6:0/779388696 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f5c0ce9b0 msgr2=0x7f9f5c1563f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:25.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.827+0000 7f9f62000640 1 --2- 172.21.15.6:0/779388696 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f5c0ce9b0 0x7f9f5c1563f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9f54006010 tx=0x7f9f54003f10 comp rx=0 tx=0).stop 2024-09-10T20:56:25.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.827+0000 7f9f62000640 1 -- 172.21.15.6:0/779388696 shutdown_connections 2024-09-10T20:56:25.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.827+0000 7f9f62000640 1 --2- 172.21.15.6:0/779388696 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f9f38077fa0 0x7f9f3807a460 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:25.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.827+0000 7f9f62000640 1 --2- 172.21.15.6:0/779388696 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f5c0ce9b0 0x7f9f5c1563f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:25.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.827+0000 7f9f62000640 1 --2- 172.21.15.6:0/779388696 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f5c0ce090 0x7f9f5c0b41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:25.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.827+0000 7f9f62000640 1 --2- 172.21.15.6:0/779388696 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f5c0cbe30 0x7f9f5c0b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:25.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.827+0000 7f9f62000640 1 -- 172.21.15.6:0/779388696 >> 172.21.15.6:0/779388696 conn(0x7f9f5c0d0250 msgr2=0x7f9f5c0702c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:25.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.827+0000 7f9f62000640 1 -- 172.21.15.6:0/779388696 shutdown_connections 2024-09-10T20:56:25.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:25.827+0000 7f9f62000640 1 -- 172.21.15.6:0/779388696 wait complete. 2024-09-10T20:56:25.847 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:56:26.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.003+0000 7fbbf4a00640 1 -- 172.21.15.6:0/3094201267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbf015e120 msgr2=0x7fbbf015e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:26.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.003+0000 7fbbf4a00640 1 --2- 172.21.15.6:0/3094201267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbf015e120 0x7fbbf015e580 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbbf0072bc0 tx=0x7fbbd802a5f0 comp rx=0 tx=0).stop 2024-09-10T20:56:26.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.004+0000 7fbbf4a00640 1 -- 172.21.15.6:0/3094201267 shutdown_connections 2024-09-10T20:56:26.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.004+0000 7fbbf4a00640 1 --2- 172.21.15.6:0/3094201267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbf015e120 0x7fbbf015e580 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:26.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.004+0000 7fbbf4a00640 1 --2- 172.21.15.6:0/3094201267 >> v2:172.21.15.150:3300/0 conn(0x7fbbf0073790 0x7fbbf0073be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:26.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.004+0000 7fbbf4a00640 1 -- 172.21.15.6:0/3094201267 >> 172.21.15.6:0/3094201267 conn(0x7fbbf006cf90 msgr2=0x7fbbf006d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:26.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.004+0000 7fbbf4a00640 1 -- 172.21.15.6:0/3094201267 shutdown_connections 2024-09-10T20:56:26.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.004+0000 7fbbf4a00640 1 -- 172.21.15.6:0/3094201267 wait complete. 2024-09-10T20:56:26.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.005+0000 7fbbf4a00640 1 Processor -- start 2024-09-10T20:56:26.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.005+0000 7fbbf4a00640 1 -- start start 2024-09-10T20:56:26.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.006+0000 7fbbf4a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbf0073790 0x7fbbf01fb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:26.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.006+0000 7fbbf4a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbbf00b3390 0x7fbbf014bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:26.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.006+0000 7fbbf4a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbbf015e120 0x7fbbf014c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:26.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.006+0000 7fbbf4a00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf015f480 con 0x7fbbf0073790 2024-09-10T20:56:26.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.006+0000 7fbbf4a00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf01550a0 con 0x7fbbf015e120 2024-09-10T20:56:26.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.006+0000 7fbbf4a00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fbbf0074120 con 0x7fbbf00b3390 2024-09-10T20:56:26.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.006+0000 7fbbef400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbf0073790 0x7fbbf01fb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:26.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.007+0000 7fbbef400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbf0073790 0x7fbbf01fb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52540/0 (socket says 172.21.15.6:52540) 2024-09-10T20:56:26.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.007+0000 7fbbef400640 1 -- 172.21.15.6:0/4195614396 learned_addr learned my addr 172.21.15.6:0/4195614396 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:26.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.007+0000 7fbbefe00640 1 --2- 172.21.15.6:0/4195614396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbbf015e120 0x7fbbf014c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:26.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.007+0000 7fbbe6a00640 1 --2- 172.21.15.6:0/4195614396 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbbf00b3390 0x7fbbf014bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:26.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.007+0000 7fbbef400640 1 -- 172.21.15.6:0/4195614396 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbbf00b3390 msgr2=0x7fbbf014bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:26.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.007+0000 7fbbef400640 1 --2- 172.21.15.6:0/4195614396 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbbf00b3390 0x7fbbf014bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:26.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.007+0000 7fbbef400640 1 -- 172.21.15.6:0/4195614396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbbf015e120 msgr2=0x7fbbf014c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:26.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.007+0000 7fbbef400640 1 --2- 172.21.15.6:0/4195614396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbbf015e120 0x7fbbf014c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:26.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.007+0000 7fbbef400640 1 -- 172.21.15.6:0/4195614396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbf01582b0 con 0x7fbbf0073790 2024-09-10T20:56:26.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.007+0000 7fbbe6a00640 1 --2- 172.21.15.6:0/4195614396 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbbf00b3390 0x7fbbf014bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:56:26.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.007+0000 7fbbef400640 1 --2- 172.21.15.6:0/4195614396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbf0073790 0x7fbbf01fb6f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbbe000c450 tx=0x7fbbe000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:26.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.007+0000 7fbbe7e00640 1 -- 172.21.15.6:0/4195614396 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe00052d0 con 0x7fbbf0073790 2024-09-10T20:56:26.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.008+0000 7fbbe7e00640 1 -- 172.21.15.6:0/4195614396 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbbe0005470 con 0x7fbbf0073790 2024-09-10T20:56:26.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.008+0000 7fbbe7e00640 1 -- 172.21.15.6:0/4195614396 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe0012870 con 0x7fbbf0073790 2024-09-10T20:56:26.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.008+0000 7fbbf4a00640 1 -- 172.21.15.6:0/4195614396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbf00cf150 con 0x7fbbf0073790 2024-09-10T20:56:26.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.008+0000 7fbbf4a00640 1 -- 172.21.15.6:0/4195614396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbf0157ab0 con 0x7fbbf0073790 2024-09-10T20:56:26.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.009+0000 7fbbf4a00640 1 -- 172.21.15.6:0/4195614396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbf0074640 con 0x7fbbf0073790 2024-09-10T20:56:26.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.010+0000 7fbbe7e00640 1 -- 172.21.15.6:0/4195614396 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fbbe00035f0 con 0x7fbbf0073790 2024-09-10T20:56:26.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.011+0000 7fbbe7e00640 1 --2- 172.21.15.6:0/4195614396 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbbcc077f70 0x7fbbcc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:26.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.011+0000 7fbbe7e00640 1 -- 172.21.15.6:0/4195614396 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7fbbe00998a0 con 0x7fbbf0073790 2024-09-10T20:56:26.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.011+0000 7fbbe6a00640 1 --2- 172.21.15.6:0/4195614396 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbbcc077f70 0x7fbbcc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:26.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.012+0000 7fbbe6a00640 1 --2- 172.21.15.6:0/4195614396 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbbcc077f70 0x7fbbcc07a430 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8033000 tx=0x7fbbd8004730 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:26.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.015+0000 7fbbe7e00640 1 -- 172.21.15.6:0/4195614396 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fbbf00728c0 con 0x7fbbf0073790 2024-09-10T20:56:26.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.248+0000 7fbbf4a00640 1 -- 172.21.15.6:0/4195614396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbbf01530a0 con 0x7fbbf0073790 2024-09-10T20:56:26.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.249+0000 7fbbe7e00640 1 -- 172.21.15.6:0/4195614396 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5211 (secure 0 0 0) 0x7fbbe0062310 con 0x7fbbf0073790 2024-09-10T20:56:26.253 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:56:26.253 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"btime":"2024-09-10T20:55:47:367368+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4329,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/77885972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":77885972},{"type":"v1","addr":"172.21.15.6:6834","nonce":77885972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4341,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/1181849476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1181849476},{"type":"v1","addr":"172.21.15.150:6836","nonce":1181849476}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4344,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/3860565837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":3860565837},{"type":"v1","addr":"172.21.15.150:6837","nonce":3860565837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:55:43.801792+0000","modified":"2024-09-10T20:55:46.798409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4375},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4375":{"gid":4375,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/3230367141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":3230367141},{"type":"v1","addr":"172.21.15.6:6835","nonce":3230367141}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4375,"qdb_cluster":[4375]},"id":1}]} 2024-09-10T20:56:26.253 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2024-09-10T20:56:26.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.251+0000 7fbbf4a00640 1 -- 172.21.15.6:0/4195614396 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbbcc077f70 msgr2=0x7fbbcc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:26.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.251+0000 7fbbf4a00640 1 --2- 172.21.15.6:0/4195614396 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbbcc077f70 0x7fbbcc07a430 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8033000 tx=0x7fbbd8004730 comp rx=0 tx=0).stop 2024-09-10T20:56:26.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.251+0000 7fbbf4a00640 1 -- 172.21.15.6:0/4195614396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbf0073790 msgr2=0x7fbbf01fb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:26.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.251+0000 7fbbf4a00640 1 --2- 172.21.15.6:0/4195614396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbf0073790 0x7fbbf01fb6f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbbe000c450 tx=0x7fbbe000c910 comp rx=0 tx=0).stop 2024-09-10T20:56:26.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.251+0000 7fbbf4a00640 1 -- 172.21.15.6:0/4195614396 shutdown_connections 2024-09-10T20:56:26.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.251+0000 7fbbf4a00640 1 --2- 172.21.15.6:0/4195614396 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbbcc077f70 0x7fbbcc07a430 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:26.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.251+0000 7fbbf4a00640 1 --2- 172.21.15.6:0/4195614396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbbf015e120 0x7fbbf014c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:26.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.251+0000 7fbbf4a00640 1 --2- 172.21.15.6:0/4195614396 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbbf00b3390 0x7fbbf014bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:26.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.251+0000 7fbbf4a00640 1 --2- 172.21.15.6:0/4195614396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbf0073790 0x7fbbf01fb6f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:26.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.251+0000 7fbbf4a00640 1 -- 172.21.15.6:0/4195614396 >> 172.21.15.6:0/4195614396 conn(0x7fbbf006cf90 msgr2=0x7fbbf006f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:26.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.251+0000 7fbbf4a00640 1 -- 172.21.15.6:0/4195614396 shutdown_connections 2024-09-10T20:56:26.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.251+0000 7fbbf4a00640 1 -- 172.21.15.6:0/4195614396 wait complete. 2024-09-10T20:56:26.271 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T20:56:26.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.427+0000 7fb309600640 1 -- 172.21.15.6:0/1556813520 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb30415c170 msgr2=0x7fb3040743b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:26.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.427+0000 7fb309600640 1 --2- 172.21.15.6:0/1556813520 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb30415c170 0x7fb3040743b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec005fd0 tx=0x7fb2ec02a540 comp rx=0 tx=0).stop 2024-09-10T20:56:26.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.427+0000 7fb309600640 1 -- 172.21.15.6:0/1556813520 shutdown_connections 2024-09-10T20:56:26.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.427+0000 7fb309600640 1 --2- 172.21.15.6:0/1556813520 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb30415c170 0x7fb3040743b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:26.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.427+0000 7fb309600640 1 --2- 172.21.15.6:0/1556813520 >> v2:172.21.15.150:3300/0 conn(0x7fb304070450 0x7fb3040cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:26.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.427+0000 7fb309600640 1 -- 172.21.15.6:0/1556813520 >> 172.21.15.6:0/1556813520 conn(0x7fb3040cfa20 msgr2=0x7fb3040cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:26.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.427+0000 7fb309600640 1 -- 172.21.15.6:0/1556813520 shutdown_connections 2024-09-10T20:56:26.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.427+0000 7fb309600640 1 -- 172.21.15.6:0/1556813520 wait complete. 2024-09-10T20:56:26.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.429+0000 7fb309600640 1 Processor -- start 2024-09-10T20:56:26.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.429+0000 7fb309600640 1 -- start start 2024-09-10T20:56:26.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.430+0000 7fb309600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb304070450 0x7fb3041eecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:26.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.430+0000 7fb309600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb304159670 0x7fb3040b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:26.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.430+0000 7fb309600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb30415c170 0x7fb3040b4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:26.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.430+0000 7fb309600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb3040b4ca0 con 0x7fb304159670 2024-09-10T20:56:26.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.430+0000 7fb309600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb3040b4b20 con 0x7fb304070450 2024-09-10T20:56:26.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.430+0000 7fb309600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb3040b4e20 con 0x7fb30415c170 2024-09-10T20:56:26.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.430+0000 7fb2fa000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb304159670 0x7fb3040b3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:26.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.430+0000 7fb2fa000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb304159670 0x7fb3040b3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52554/0 (socket says 172.21.15.6:52554) 2024-09-10T20:56:26.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.430+0000 7fb303400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb30415c170 0x7fb3040b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:26.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.430+0000 7fb2fa000640 1 -- 172.21.15.6:0/2336347431 learned_addr learned my addr 172.21.15.6:0/2336347431 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:26.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.430+0000 7fb302a00640 1 --2- 172.21.15.6:0/2336347431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb304070450 0x7fb3041eecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:26.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.431+0000 7fb2fa000640 1 -- 172.21.15.6:0/2336347431 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb30415c170 msgr2=0x7fb3040b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:26.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.431+0000 7fb2fa000640 1 --2- 172.21.15.6:0/2336347431 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb30415c170 0x7fb3040b4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:26.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.431+0000 7fb2fa000640 1 -- 172.21.15.6:0/2336347431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb304070450 msgr2=0x7fb3041eecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:26.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.431+0000 7fb2fa000640 1 --2- 172.21.15.6:0/2336347431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb304070450 0x7fb3041eecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:26.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.431+0000 7fb2fa000640 1 -- 172.21.15.6:0/2336347431 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3041f9030 con 0x7fb304159670 2024-09-10T20:56:26.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.431+0000 7fb303400640 1 --2- 172.21.15.6:0/2336347431 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb30415c170 0x7fb3040b4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:56:26.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.431+0000 7fb2fa000640 1 --2- 172.21.15.6:0/2336347431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb304159670 0x7fb3040b3d50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec009850 tx=0x7fb2ec0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:26.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.431+0000 7fb2fb400640 1 -- 172.21.15.6:0/2336347431 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec03f070 con 0x7fb304159670 2024-09-10T20:56:26.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.431+0000 7fb2fb400640 1 -- 172.21.15.6:0/2336347431 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb2ec0047a0 con 0x7fb304159670 2024-09-10T20:56:26.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.431+0000 7fb2fb400640 1 -- 172.21.15.6:0/2336347431 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec035030 con 0x7fb304159670 2024-09-10T20:56:26.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.431+0000 7fb309600640 1 -- 172.21.15.6:0/2336347431 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3041f5000 con 0x7fb304159670 2024-09-10T20:56:26.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.432+0000 7fb309600640 1 -- 172.21.15.6:0/2336347431 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3041f55c0 con 0x7fb304159670 2024-09-10T20:56:26.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.433+0000 7fb309600640 1 -- 172.21.15.6:0/2336347431 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3040b5340 con 0x7fb304159670 2024-09-10T20:56:26.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.434+0000 7fb2fb400640 1 -- 172.21.15.6:0/2336347431 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb2ec004b90 con 0x7fb304159670 2024-09-10T20:56:26.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.435+0000 7fb2fb400640 1 --2- 172.21.15.6:0/2336347431 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb2e0077f70 0x7fb2e007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:26.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.435+0000 7fb2fb400640 1 -- 172.21.15.6:0/2336347431 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7fb2ec0bb250 con 0x7fb304159670 2024-09-10T20:56:26.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.436+0000 7fb302a00640 1 --2- 172.21.15.6:0/2336347431 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb2e0077f70 0x7fb2e007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:26.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.437+0000 7fb302a00640 1 --2- 172.21.15.6:0/2336347431 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb2e0077f70 0x7fb2e007a430 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb30415da80 tx=0x7fb2f4009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:26.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.440+0000 7fb2fb400640 1 -- 172.21.15.6:0/2336347431 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb2ec0835e0 con 0x7fb304159670 2024-09-10T20:56:26.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.636+0000 7fb309600640 1 -- 172.21.15.6:0/2336347431 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb304069d20 con 0x7fb304159670 2024-09-10T20:56:26.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.637+0000 7fb2fb400640 1 -- 172.21.15.6:0/2336347431 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+16854 (secure 0 0 0) 0x7fb2ec088010 con 0x7fb304159670 2024-09-10T20:56:26.641 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:56:26.641 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":24,"fsid":"9e04309e-61c3-4c78-82db-9576e465d98a","created":"2024-09-10T20:55:17.972466+0000","modified":"2024-09-10T20:56:24.500506+0000","last_up_change":"2024-09-10T20:55:32.392769+0000","last_in_change":"2024-09-10T20:55:22.232252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:55:33.196464+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:55:41.833420+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T20:55:42.749182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0918c5c8-a028-4987-bad2-406c412ec3f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6801","nonce":895515615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6803","nonce":895515615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6807","nonce":895515615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6805","nonce":895515615}]},"public_addr":"172.21.15.6:6801/895515615","cluster_addr":"172.21.15.6:6803/895515615","heartbeat_back_addr":"172.21.15.6:6807/895515615","heartbeat_front_addr":"172.21.15.6:6805/895515615","state":["exists","up"]},{"osd":1,"uuid":"415e9c78-c3d9-46d6-b277-348453f42155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6809","nonce":1129113250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6811","nonce":1129113250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6815","nonce":1129113250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6813","nonce":1129113250}]},"public_addr":"172.21.15.6:6809/1129113250","cluster_addr":"172.21.15.6:6811/1129113250","heartbeat_back_addr":"172.21.15.6:6815/1129113250","heartbeat_front_addr":"172.21.15.6:6813/1129113250","state":["exists","up"]},{"osd":2,"uuid":"763c1cf2-a43d-4c10-815d-eaf4a32afc1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6825","nonce":3847470051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6827","nonce":3847470051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6831","nonce":3847470051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6829","nonce":3847470051}]},"public_addr":"172.21.15.6:6825/3847470051","cluster_addr":"172.21.15.6:6827/3847470051","heartbeat_back_addr":"172.21.15.6:6831/3847470051","heartbeat_front_addr":"172.21.15.6:6829/3847470051","state":["exists","up"]},{"osd":3,"uuid":"877b1cc1-2434-4b32-af66-9c2485eac9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6817","nonce":3911674247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6819","nonce":3911674247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6823","nonce":3911674247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6821","nonce":3911674247}]},"public_addr":"172.21.15.6:6817/3911674247","cluster_addr":"172.21.15.6:6819/3911674247","heartbeat_back_addr":"172.21.15.6:6823/3911674247","heartbeat_front_addr":"172.21.15.6:6821/3911674247","state":["exists","up"]},{"osd":4,"uuid":"e0b27501-dfdc-4e7f-b73a-9573c869267a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6827","nonce":2568527750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6829","nonce":2568527750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6833","nonce":2568527750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6831","nonce":2568527750}]},"public_addr":"172.21.15.150:6827/2568527750","cluster_addr":"172.21.15.150:6829/2568527750","heartbeat_back_addr":"172.21.15.150:6833/2568527750","heartbeat_front_addr":"172.21.15.150:6831/2568527750","state":["exists","up"]},{"osd":5,"uuid":"67e48053-4f15-44fd-a30c-c9522f86d169","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6811","nonce":371417736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6813","nonce":371417736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6817","nonce":371417736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6815","nonce":371417736}]},"public_addr":"172.21.15.150:6811/371417736","cluster_addr":"172.21.15.150:6813/371417736","heartbeat_back_addr":"172.21.15.150:6817/371417736","heartbeat_front_addr":"172.21.15.150:6815/371417736","state":["exists","up"]},{"osd":6,"uuid":"1456df2e-ae91-45a4-bc3a-a06c753092af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6819","nonce":2329248366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6821","nonce":2329248366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6825","nonce":2329248366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6823","nonce":2329248366}]},"public_addr":"172.21.15.150:6819/2329248366","cluster_addr":"172.21.15.150:6821/2329248366","heartbeat_back_addr":"172.21.15.150:6825/2329248366","heartbeat_front_addr":"172.21.15.150:6823/2329248366","state":["exists","up"]},{"osd":7,"uuid":"a9daafcb-5ecd-43bd-ab0a-dc4b480cfc2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6803","nonce":527018351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6805","nonce":527018351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6809","nonce":527018351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6807","nonce":527018351}]},"public_addr":"172.21.15.150:6803/527018351","cluster_addr":"172.21.15.150:6805/527018351","heartbeat_back_addr":"172.21.15.150:6809/527018351","heartbeat_front_addr":"172.21.15.150:6807/527018351","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.710061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.024506+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.824320+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.431608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.637032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.054828+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.333290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.358875+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":1}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:56:26.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.639+0000 7fb309600640 1 -- 172.21.15.6:0/2336347431 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb2e0077f70 msgr2=0x7fb2e007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:26.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.639+0000 7fb309600640 1 --2- 172.21.15.6:0/2336347431 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb2e0077f70 0x7fb2e007a430 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb30415da80 tx=0x7fb2f4009040 comp rx=0 tx=0).stop 2024-09-10T20:56:26.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.639+0000 7fb309600640 1 -- 172.21.15.6:0/2336347431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb304159670 msgr2=0x7fb3040b3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:26.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.639+0000 7fb309600640 1 --2- 172.21.15.6:0/2336347431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb304159670 0x7fb3040b3d50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec009850 tx=0x7fb2ec0038a0 comp rx=0 tx=0).stop 2024-09-10T20:56:26.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.639+0000 7fb309600640 1 -- 172.21.15.6:0/2336347431 shutdown_connections 2024-09-10T20:56:26.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.639+0000 7fb309600640 1 --2- 172.21.15.6:0/2336347431 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb2e0077f70 0x7fb2e007a430 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:26.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.639+0000 7fb309600640 1 --2- 172.21.15.6:0/2336347431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb304159670 0x7fb3040b3d50 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:26.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.639+0000 7fb309600640 1 --2- 172.21.15.6:0/2336347431 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb30415c170 0x7fb3040b4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:26.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.639+0000 7fb309600640 1 --2- 172.21.15.6:0/2336347431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb304070450 0x7fb3041eecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:26.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.639+0000 7fb309600640 1 -- 172.21.15.6:0/2336347431 >> 172.21.15.6:0/2336347431 conn(0x7fb3040cfa20 msgr2=0x7fb304072940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:26.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.639+0000 7fb309600640 1 -- 172.21.15.6:0/2336347431 shutdown_connections 2024-09-10T20:56:26.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.639+0000 7fb309600640 1 -- 172.21.15.6:0/2336347431 wait complete. 2024-09-10T20:56:26.659 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T20:56:26.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.817+0000 7fb09b200640 1 -- 172.21.15.6:0/2610436475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb09415bb30 msgr2=0x7fb0940cf340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:26.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.817+0000 7fb09b200640 1 --2- 172.21.15.6:0/2610436475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb09415bb30 0x7fb0940cf340 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb084005fd0 tx=0x7fb08402a5d0 comp rx=0 tx=0).stop 2024-09-10T20:56:26.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.817+0000 7fb09b200640 1 -- 172.21.15.6:0/2610436475 shutdown_connections 2024-09-10T20:56:26.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.817+0000 7fb09b200640 1 --2- 172.21.15.6:0/2610436475 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0940caa40 0x7fb094161a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:26.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.817+0000 7fb09b200640 1 --2- 172.21.15.6:0/2610436475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb09415bb30 0x7fb0940cf340 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:26.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.817+0000 7fb09b200640 1 -- 172.21.15.6:0/2610436475 >> 172.21.15.6:0/2610436475 conn(0x7fb0940cfa20 msgr2=0x7fb0940cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:26.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.817+0000 7fb09b200640 1 -- 172.21.15.6:0/2610436475 shutdown_connections 2024-09-10T20:56:26.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.818+0000 7fb09b200640 1 -- 172.21.15.6:0/2610436475 wait complete. 2024-09-10T20:56:26.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.819+0000 7fb09b200640 1 Processor -- start 2024-09-10T20:56:26.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.819+0000 7fb09b200640 1 -- start start 2024-09-10T20:56:26.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.820+0000 7fb09b200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0940caa40 0x7fb09415fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:26.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.820+0000 7fb09b200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb09415bb30 0x7fb0940b3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:26.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.820+0000 7fb09b200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb094161f60 0x7fb0940b3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:26.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.820+0000 7fb09b200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb0940cb000 con 0x7fb09415bb30 2024-09-10T20:56:26.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.820+0000 7fb09b200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb0940aeaa0 con 0x7fb0940caa40 2024-09-10T20:56:26.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.820+0000 7fb09b200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb09415eb40 con 0x7fb094161f60 2024-09-10T20:56:26.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.820+0000 7fb08b400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb09415bb30 0x7fb0940b3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:26.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.821+0000 7fb08b400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb09415bb30 0x7fb0940b3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52572/0 (socket says 172.21.15.6:52572) 2024-09-10T20:56:26.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.821+0000 7fb08b400640 1 -- 172.21.15.6:0/4076007219 learned_addr learned my addr 172.21.15.6:0/4076007219 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:26.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.821+0000 7fb093e00640 1 --2- 172.21.15.6:0/4076007219 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0940caa40 0x7fb09415fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:26.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.821+0000 7fb099200640 1 --2- 172.21.15.6:0/4076007219 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb094161f60 0x7fb0940b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:26.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.821+0000 7fb08b400640 1 -- 172.21.15.6:0/4076007219 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb094161f60 msgr2=0x7fb0940b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:26.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.821+0000 7fb08b400640 1 --2- 172.21.15.6:0/4076007219 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb094161f60 0x7fb0940b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:26.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.821+0000 7fb08b400640 1 -- 172.21.15.6:0/4076007219 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0940caa40 msgr2=0x7fb09415fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:26.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.821+0000 7fb08b400640 1 --2- 172.21.15.6:0/4076007219 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0940caa40 0x7fb09415fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:26.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.821+0000 7fb08b400640 1 -- 172.21.15.6:0/4076007219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb094160660 con 0x7fb09415bb30 2024-09-10T20:56:26.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.821+0000 7fb099200640 1 --2- 172.21.15.6:0/4076007219 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb094161f60 0x7fb0940b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:56:26.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.821+0000 7fb08b400640 1 --2- 172.21.15.6:0/4076007219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb09415bb30 0x7fb0940b3400 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb07c00d950 tx=0x7fb07c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:26.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.821+0000 7fb090c00640 1 -- 172.21.15.6:0/4076007219 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb07c017070 con 0x7fb09415bb30 2024-09-10T20:56:26.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.822+0000 7fb090c00640 1 -- 172.21.15.6:0/4076007219 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb07c009d20 con 0x7fb09415bb30 2024-09-10T20:56:26.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.822+0000 7fb090c00640 1 -- 172.21.15.6:0/4076007219 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb07c0106c0 con 0x7fb09415bb30 2024-09-10T20:56:26.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.822+0000 7fb09b200640 1 -- 172.21.15.6:0/4076007219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb094160940 con 0x7fb09415bb30 2024-09-10T20:56:26.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.822+0000 7fb09b200640 1 -- 172.21.15.6:0/4076007219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0941611e0 con 0x7fb09415bb30 2024-09-10T20:56:26.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.823+0000 7fb09b200640 1 -- 172.21.15.6:0/4076007219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb094069d20 con 0x7fb09415bb30 2024-09-10T20:56:26.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.824+0000 7fb090c00640 1 -- 172.21.15.6:0/4076007219 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb07c010860 con 0x7fb09415bb30 2024-09-10T20:56:26.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.825+0000 7fb090c00640 1 --2- 172.21.15.6:0/4076007219 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb070077f70 0x7fb07007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:26.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.825+0000 7fb090c00640 1 -- 172.21.15.6:0/4076007219 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7fb07c09a380 con 0x7fb09415bb30 2024-09-10T20:56:26.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.825+0000 7fb093e00640 1 --2- 172.21.15.6:0/4076007219 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb070077f70 0x7fb07007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:26.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.826+0000 7fb093e00640 1 --2- 172.21.15.6:0/4076007219 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb070077f70 0x7fb07007a430 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb084033000 tx=0x7fb084004730 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:26.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:26.829+0000 7fb090c00640 1 -- 172.21.15.6:0/4076007219 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb07c062d60 con 0x7fb09415bb30 2024-09-10T20:56:27.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.064+0000 7fb09b200640 1 -- 172.21.15.6:0/4076007219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb0940d0850 con 0x7fb09415bb30 2024-09-10T20:56:27.068 INFO:tasks.ceph.mon.a.smithi006.stderr:2024-09-10T20:56:27.064+0000 7f7840600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T20:56:27.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.067+0000 7fb090c00640 1 -- 172.21.15.6:0/4076007219 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7fb07c062660 con 0x7fb09415bb30 2024-09-10T20:56:27.071 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T20:56:27.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.070+0000 7fb09b200640 1 -- 172.21.15.6:0/4076007219 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb070077f70 msgr2=0x7fb07007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:27.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.070+0000 7fb09b200640 1 --2- 172.21.15.6:0/4076007219 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb070077f70 0x7fb07007a430 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb084033000 tx=0x7fb084004730 comp rx=0 tx=0).stop 2024-09-10T20:56:27.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.070+0000 7fb09b200640 1 -- 172.21.15.6:0/4076007219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb09415bb30 msgr2=0x7fb0940b3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:27.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.070+0000 7fb09b200640 1 --2- 172.21.15.6:0/4076007219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb09415bb30 0x7fb0940b3400 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb07c00d950 tx=0x7fb07c00de10 comp rx=0 tx=0).stop 2024-09-10T20:56:27.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.070+0000 7fb09b200640 1 -- 172.21.15.6:0/4076007219 shutdown_connections 2024-09-10T20:56:27.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.070+0000 7fb09b200640 1 --2- 172.21.15.6:0/4076007219 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb070077f70 0x7fb07007a430 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:27.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.070+0000 7fb09b200640 1 --2- 172.21.15.6:0/4076007219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb09415bb30 0x7fb0940b3400 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:27.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.070+0000 7fb09b200640 1 --2- 172.21.15.6:0/4076007219 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb094161f60 0x7fb0940b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:27.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.070+0000 7fb09b200640 1 --2- 172.21.15.6:0/4076007219 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0940caa40 0x7fb09415fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:27.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.070+0000 7fb09b200640 1 -- 172.21.15.6:0/4076007219 >> 172.21.15.6:0/4076007219 conn(0x7fb0940cfa20 msgr2=0x7fb0940b01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:27.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.070+0000 7fb09b200640 1 -- 172.21.15.6:0/4076007219 shutdown_connections 2024-09-10T20:56:27.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.070+0000 7fb09b200640 1 -- 172.21.15.6:0/4076007219 wait complete. 2024-09-10T20:56:27.081 INFO:tasks.ceph.mds.c.smithi006.stderr: -2620> 2024-09-10T20:55:49.328+0000 7ff70f200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T20:56:27.091 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T20:56:27.130 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2024-09-10T20:56:27.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.251+0000 7fd7cc400640 1 -- 172.21.15.6:0/2334979411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7ac0039e0 msgr2=0x7fd7ac003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:27.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.251+0000 7fd7cc400640 1 --2- 172.21.15.6:0/2334979411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7ac0039e0 0x7fd7ac003dc0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8009d20 tx=0x7fd7ac005830 comp rx=0 tx=0).stop 2024-09-10T20:56:27.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.251+0000 7fd7ca400640 1 -- 172.21.15.6:0/2334979411 reap_dead start 2024-09-10T20:56:27.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.251+0000 7fd7cc400640 1 -- 172.21.15.6:0/2334979411 shutdown_connections 2024-09-10T20:56:27.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.251+0000 7fd7cc400640 1 -- 172.21.15.6:0/2334979411 >> 172.21.15.6:0/2334979411 conn(0x7fd7c40cfa20 msgr2=0x7fd7c40cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:27.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.251+0000 7fd7cc400640 1 -- 172.21.15.6:0/2334979411 shutdown_connections 2024-09-10T20:56:27.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.251+0000 7fd7cc400640 1 -- 172.21.15.6:0/2334979411 wait complete. 2024-09-10T20:56:27.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.253+0000 7fd7cc400640 1 Processor -- start 2024-09-10T20:56:27.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.253+0000 7fd7cc400640 1 -- start start 2024-09-10T20:56:27.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.254+0000 7fd7cc400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7ac0039e0 0x7fd7c41f2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:27.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.254+0000 7fd7cc400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7c41f3720 0x7fd7c40c5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:27.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.254+0000 7fd7cc400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7c415a2d0 0x7fd7c415a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:27.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.254+0000 7fd7cc400640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c40b53b0 con 0x7fd7ac0039e0 2024-09-10T20:56:27.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.254+0000 7fd7cc400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c40b5230 con 0x7fd7c415a2d0 2024-09-10T20:56:27.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.254+0000 7fd7cc400640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd7c40743b0 con 0x7fd7c41f3720 2024-09-10T20:56:27.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.254+0000 7fd7c9a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7ac0039e0 0x7fd7c41f2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:27.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.254+0000 7fd7c9a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7ac0039e0 0x7fd7c41f2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52592/0 (socket says 172.21.15.6:52592) 2024-09-10T20:56:27.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.254+0000 7fd7c9a00640 1 -- 172.21.15.6:0/1885891486 learned_addr learned my addr 172.21.15.6:0/1885891486 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:27.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.254+0000 7fd7ca400640 1 --2- 172.21.15.6:0/1885891486 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7c415a2d0 0x7fd7c415a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:27.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.255+0000 7fd7c9000640 1 --2- 172.21.15.6:0/1885891486 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7c41f3720 0x7fd7c40c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:27.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.255+0000 7fd7c9a00640 1 -- 172.21.15.6:0/1885891486 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7c41f3720 msgr2=0x7fd7c40c5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:27.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.255+0000 7fd7c9a00640 1 --2- 172.21.15.6:0/1885891486 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7c41f3720 0x7fd7c40c5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:27.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.255+0000 7fd7c9a00640 1 -- 172.21.15.6:0/1885891486 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7c415a2d0 msgr2=0x7fd7c415a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:27.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.255+0000 7fd7c9a00640 1 --2- 172.21.15.6:0/1885891486 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7c415a2d0 0x7fd7c415a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:27.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.255+0000 7fd7c9a00640 1 -- 172.21.15.6:0/1885891486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7c40b2990 con 0x7fd7ac0039e0 2024-09-10T20:56:27.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.255+0000 7fd7c9000640 1 --2- 172.21.15.6:0/1885891486 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7c41f3720 0x7fd7c40c5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:56:27.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.255+0000 7fd7ca400640 1 --2- 172.21.15.6:0/1885891486 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7c415a2d0 0x7fd7c415a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:56:27.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.255+0000 7fd7c9a00640 1 --2- 172.21.15.6:0/1885891486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7ac0039e0 0x7fd7c41f2560 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8009e10 tx=0x7fd7b8003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:27.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.255+0000 7fd7c1600640 1 -- 172.21.15.6:0/1885891486 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b8042020 con 0x7fd7ac0039e0 2024-09-10T20:56:27.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.255+0000 7fd7c1600640 1 -- 172.21.15.6:0/1885891486 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd7b8009470 con 0x7fd7ac0039e0 2024-09-10T20:56:27.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.255+0000 7fd7c1600640 1 -- 172.21.15.6:0/1885891486 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b80098f0 con 0x7fd7ac0039e0 2024-09-10T20:56:27.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.255+0000 7fd7cc400640 1 -- 172.21.15.6:0/1885891486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7c41f2bb0 con 0x7fd7ac0039e0 2024-09-10T20:56:27.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.256+0000 7fd7cc400640 1 -- 172.21.15.6:0/1885891486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7c41f3170 con 0x7fd7ac0039e0 2024-09-10T20:56:27.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.256+0000 7fd7cc400640 1 -- 172.21.15.6:0/1885891486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7c40cd920 con 0x7fd7ac0039e0 2024-09-10T20:56:27.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.257+0000 7fd7c1600640 1 -- 172.21.15.6:0/1885891486 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd7b8003ad0 con 0x7fd7ac0039e0 2024-09-10T20:56:27.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.258+0000 7fd7c1600640 1 --2- 172.21.15.6:0/1885891486 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd7a4077fa0 0x7fd7a407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:27.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.259+0000 7fd7c1600640 1 -- 172.21.15.6:0/1885891486 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5911+0+0 (secure 0 0 0) 0x7fd7b80bb380 con 0x7fd7ac0039e0 2024-09-10T20:56:27.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.259+0000 7fd7c9000640 1 --2- 172.21.15.6:0/1885891486 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd7a4077fa0 0x7fd7a407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:27.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.260+0000 7fd7c9000640 1 --2- 172.21.15.6:0/1885891486 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd7a4077fa0 0x7fd7a407a460 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd7c41f5ab0 tx=0x7fd7b0006bd0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:27.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.262+0000 7fd7c1600640 1 -- 172.21.15.6:0/1885891486 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fd7b804c030 con 0x7fd7ac0039e0 2024-09-10T20:56:27.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:27.493+0000 7fd7cc400640 1 -- 172.21.15.6:0/1885891486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fd7c4069d20 con 0x7fd7ac0039e0 2024-09-10T20:56:28.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.073+0000 7fd7c1600640 1 -- 172.21.15.6:0/1885891486 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7fd7b8083c80 con 0x7fd7ac0039e0 2024-09-10T20:56:28.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.075+0000 7fd7cc400640 1 -- 172.21.15.6:0/1885891486 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd7a4077fa0 msgr2=0x7fd7a407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:28.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.076+0000 7fd7cc400640 1 --2- 172.21.15.6:0/1885891486 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd7a4077fa0 0x7fd7a407a460 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd7c41f5ab0 tx=0x7fd7b0006bd0 comp rx=0 tx=0).stop 2024-09-10T20:56:28.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.076+0000 7fd7cc400640 1 -- 172.21.15.6:0/1885891486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7ac0039e0 msgr2=0x7fd7c41f2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:28.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.076+0000 7fd7cc400640 1 --2- 172.21.15.6:0/1885891486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7ac0039e0 0x7fd7c41f2560 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8009e10 tx=0x7fd7b8003820 comp rx=0 tx=0).stop 2024-09-10T20:56:28.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.076+0000 7fd7cc400640 1 -- 172.21.15.6:0/1885891486 shutdown_connections 2024-09-10T20:56:28.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.076+0000 7fd7cc400640 1 --2- 172.21.15.6:0/1885891486 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd7a4077fa0 0x7fd7a407a460 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:28.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.076+0000 7fd7cc400640 1 --2- 172.21.15.6:0/1885891486 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7c415a2d0 0x7fd7c415a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:28.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.076+0000 7fd7cc400640 1 --2- 172.21.15.6:0/1885891486 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7c41f3720 0x7fd7c40c5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:28.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.076+0000 7fd7cc400640 1 --2- 172.21.15.6:0/1885891486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7ac0039e0 0x7fd7c41f2560 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:28.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.076+0000 7fd7cc400640 1 -- 172.21.15.6:0/1885891486 >> 172.21.15.6:0/1885891486 conn(0x7fd7c40cfa20 msgr2=0x7fd7c415d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:28.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.076+0000 7fd7cc400640 1 -- 172.21.15.6:0/1885891486 shutdown_connections 2024-09-10T20:56:28.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.076+0000 7fd7cc400640 1 -- 172.21.15.6:0/1885891486 wait complete. 2024-09-10T20:56:28.097 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T20:56:28.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.298+0000 7f6995400640 1 -- 172.21.15.6:0/1074578336 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69900ca310 msgr2=0x7f69900ca740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:28.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.298+0000 7f6995400640 1 --2- 172.21.15.6:0/1074578336 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69900ca310 0x7f69900ca740 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f69900d0ad0 tx=0x7f698802a9e0 comp rx=0 tx=0).stop 2024-09-10T20:56:28.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.298+0000 7f6995400640 1 -- 172.21.15.6:0/1074578336 shutdown_connections 2024-09-10T20:56:28.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.298+0000 7f6995400640 1 --2- 172.21.15.6:0/1074578336 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69900ca310 0x7f69900ca740 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:28.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.298+0000 7f6995400640 1 --2- 172.21.15.6:0/1074578336 >> v2:172.21.15.150:3300/0 conn(0x7f699006fe40 0x7f6990070220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:28.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.298+0000 7f6995400640 1 -- 172.21.15.6:0/1074578336 >> 172.21.15.6:0/1074578336 conn(0x7f69900cfa20 msgr2=0x7f69900cfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:28.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.299+0000 7f6995400640 1 -- 172.21.15.6:0/1074578336 shutdown_connections 2024-09-10T20:56:28.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.299+0000 7f6995400640 1 -- 172.21.15.6:0/1074578336 wait complete. 2024-09-10T20:56:28.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.300+0000 7f6995400640 1 Processor -- start 2024-09-10T20:56:28.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.300+0000 7f6995400640 1 -- start start 2024-09-10T20:56:28.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.301+0000 7f6995400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f699006fe40 0x7f69900b4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:28.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.301+0000 7f6995400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69900ca310 0x7f699014ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:28.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.301+0000 7f6995400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f699015bce0 0x7f69901f2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:28.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.301+0000 7f6995400640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f69900cb010 con 0x7f699006fe40 2024-09-10T20:56:28.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.301+0000 7f6995400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f69900cae90 con 0x7f69900ca310 2024-09-10T20:56:28.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.301+0000 7f6995400640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f69900cb190 con 0x7f699015bce0 2024-09-10T20:56:28.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.301+0000 7f698e800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f699006fe40 0x7f69900b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:28.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.302+0000 7f698e800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f699006fe40 0x7f69900b4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58808/0 (socket says 172.21.15.6:58808) 2024-09-10T20:56:28.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.302+0000 7f698e800640 1 -- 172.21.15.6:0/2616941106 learned_addr learned my addr 172.21.15.6:0/2616941106 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:28.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.302+0000 7f6985e00640 1 --2- 172.21.15.6:0/2616941106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69900ca310 0x7f699014ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:28.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.302+0000 7f698f200640 1 --2- 172.21.15.6:0/2616941106 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f699015bce0 0x7f69901f2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:28.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.302+0000 7f698e800640 1 -- 172.21.15.6:0/2616941106 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f699015bce0 msgr2=0x7f69901f2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:28.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.302+0000 7f698e800640 1 --2- 172.21.15.6:0/2616941106 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f699015bce0 0x7f69901f2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:28.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.302+0000 7f698e800640 1 -- 172.21.15.6:0/2616941106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69900ca310 msgr2=0x7f699014ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:28.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.302+0000 7f698e800640 1 --2- 172.21.15.6:0/2616941106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69900ca310 0x7f699014ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:28.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.302+0000 7f698e800640 1 -- 172.21.15.6:0/2616941106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69900a9c90 con 0x7f699006fe40 2024-09-10T20:56:28.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.302+0000 7f698f200640 1 --2- 172.21.15.6:0/2616941106 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f699015bce0 0x7f69901f2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:56:28.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.302+0000 7f698e800640 1 --2- 172.21.15.6:0/2616941106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f699006fe40 0x7f69900b4510 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f698000c920 tx=0x7f698000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:28.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.303+0000 7f6987400640 1 -- 172.21.15.6:0/2616941106 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6980007c70 con 0x7f699006fe40 2024-09-10T20:56:28.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.303+0000 7f6987400640 1 -- 172.21.15.6:0/2616941106 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f698000f450 con 0x7f699006fe40 2024-09-10T20:56:28.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.303+0000 7f6987400640 1 -- 172.21.15.6:0/2616941106 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f698000f8a0 con 0x7f699006fe40 2024-09-10T20:56:28.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.303+0000 7f6995400640 1 -- 172.21.15.6:0/2616941106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69900a9f70 con 0x7f699006fe40 2024-09-10T20:56:28.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.303+0000 7f6995400640 1 -- 172.21.15.6:0/2616941106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69901f4070 con 0x7f699006fe40 2024-09-10T20:56:28.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.304+0000 7f6995400640 1 -- 172.21.15.6:0/2616941106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69900cbdc0 con 0x7f699006fe40 2024-09-10T20:56:28.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.305+0000 7f6987400640 1 -- 172.21.15.6:0/2616941106 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f698000fa40 con 0x7f699006fe40 2024-09-10T20:56:28.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.306+0000 7f6987400640 1 --2- 172.21.15.6:0/2616941106 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f696c077f70 0x7f696c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:28.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.306+0000 7f6987400640 1 -- 172.21.15.6:0/2616941106 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5911+0+0 (secure 0 0 0) 0x7f698009a6d0 con 0x7f699006fe40 2024-09-10T20:56:28.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.306+0000 7f6985e00640 1 --2- 172.21.15.6:0/2616941106 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f696c077f70 0x7f696c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:28.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.307+0000 7f6985e00640 1 --2- 172.21.15.6:0/2616941106 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f696c077f70 0x7f696c07a430 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f699015f2e0 tx=0x7f6978009060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:28.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.310+0000 7f6987400640 1 -- 172.21.15.6:0/2616941106 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f69900cbdc0 con 0x7f699006fe40 2024-09-10T20:56:28.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:28.505+0000 7f6995400640 1 -- 172.21.15.6:0/2616941106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f69901588e0 con 0x7f699006fe40 2024-09-10T20:56:29.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.075+0000 7f6987400640 1 -- 172.21.15.6:0/2616941106 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v26) ==== 181+0+0 (secure 0 0 0) 0x7f6980014030 con 0x7f699006fe40 2024-09-10T20:56:29.079 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2024-09-10T20:56:29.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.078+0000 7f6995400640 1 -- 172.21.15.6:0/2616941106 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f696c077f70 msgr2=0x7f696c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:29.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.078+0000 7f6995400640 1 --2- 172.21.15.6:0/2616941106 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f696c077f70 0x7f696c07a430 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f699015f2e0 tx=0x7f6978009060 comp rx=0 tx=0).stop 2024-09-10T20:56:29.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.078+0000 7f6995400640 1 -- 172.21.15.6:0/2616941106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f699006fe40 msgr2=0x7f69900b4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:29.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.078+0000 7f6995400640 1 --2- 172.21.15.6:0/2616941106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f699006fe40 0x7f69900b4510 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f698000c920 tx=0x7f698000cde0 comp rx=0 tx=0).stop 2024-09-10T20:56:29.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.079+0000 7f6995400640 1 -- 172.21.15.6:0/2616941106 shutdown_connections 2024-09-10T20:56:29.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.079+0000 7f6995400640 1 --2- 172.21.15.6:0/2616941106 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f696c077f70 0x7f696c07a430 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:29.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.079+0000 7f6995400640 1 --2- 172.21.15.6:0/2616941106 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f699015bce0 0x7f69901f2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:29.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.079+0000 7f6995400640 1 --2- 172.21.15.6:0/2616941106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69900ca310 0x7f699014ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:29.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.079+0000 7f6995400640 1 --2- 172.21.15.6:0/2616941106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f699006fe40 0x7f69900b4510 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:29.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.079+0000 7f6995400640 1 -- 172.21.15.6:0/2616941106 >> 172.21.15.6:0/2616941106 conn(0x7f69900cfa20 msgr2=0x7f6990072510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:29.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.079+0000 7f6995400640 1 -- 172.21.15.6:0/2616941106 shutdown_connections 2024-09-10T20:56:29.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.079+0000 7f6995400640 1 -- 172.21.15.6:0/2616941106 wait complete. 2024-09-10T20:56:29.102 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T20:56:29.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.264+0000 7f42bee00640 1 -- 172.21.15.6:0/1711058381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42b8070de0 msgr2=0x7f42b815bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:29.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.264+0000 7f42bee00640 1 --2- 172.21.15.6:0/1711058381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42b8070de0 0x7f42b815bfb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f42b0005fd0 tx=0x7f42b002a780 comp rx=0 tx=0).stop 2024-09-10T20:56:29.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.264+0000 7f42bee00640 1 -- 172.21.15.6:0/1711058381 shutdown_connections 2024-09-10T20:56:29.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.264+0000 7f42bee00640 1 --2- 172.21.15.6:0/1711058381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42b8070de0 0x7f42b815bfb0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:29.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.264+0000 7f42bee00640 1 --2- 172.21.15.6:0/1711058381 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42b8073b40 0x7f42b80708a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:29.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.264+0000 7f42bee00640 1 -- 172.21.15.6:0/1711058381 >> 172.21.15.6:0/1711058381 conn(0x7f42b80d09c0 msgr2=0x7f42b80d0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:29.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.264+0000 7f42bee00640 1 -- 172.21.15.6:0/1711058381 shutdown_connections 2024-09-10T20:56:29.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.264+0000 7f42bee00640 1 -- 172.21.15.6:0/1711058381 wait complete. 2024-09-10T20:56:29.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.265+0000 7f42bee00640 1 Processor -- start 2024-09-10T20:56:29.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.266+0000 7f42bee00640 1 -- start start 2024-09-10T20:56:29.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.267+0000 7f42bee00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42b806eb30 0x7f42b80c4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:29.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.267+0000 7f42bee00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42b8070de0 0x7f42b81f5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:29.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.267+0000 7f42bee00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42b8073b40 0x7f42b81f6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:29.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.267+0000 7f42bee00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f42b815c900 con 0x7f42b806eb30 2024-09-10T20:56:29.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.267+0000 7f42bee00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f42b815c780 con 0x7f42b8073b40 2024-09-10T20:56:29.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.267+0000 7f42bee00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f42b815ca80 con 0x7f42b8070de0 2024-09-10T20:56:29.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.267+0000 7f42bda00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42b806eb30 0x7f42b80c4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:29.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.267+0000 7f42bda00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42b806eb30 0x7f42b80c4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58832/0 (socket says 172.21.15.6:58832) 2024-09-10T20:56:29.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.267+0000 7f42bda00640 1 -- 172.21.15.6:0/4253691953 learned_addr learned my addr 172.21.15.6:0/4253691953 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:29.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.267+0000 7f42bd000640 1 --2- 172.21.15.6:0/4253691953 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42b8070de0 0x7f42b81f5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:29.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.267+0000 7f42be400640 1 --2- 172.21.15.6:0/4253691953 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42b8073b40 0x7f42b81f6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:29.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.267+0000 7f42bda00640 1 -- 172.21.15.6:0/4253691953 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42b8070de0 msgr2=0x7f42b81f5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:29.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.267+0000 7f42bda00640 1 --2- 172.21.15.6:0/4253691953 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42b8070de0 0x7f42b81f5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:29.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.267+0000 7f42bda00640 1 -- 172.21.15.6:0/4253691953 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42b8073b40 msgr2=0x7f42b81f6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:29.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.267+0000 7f42bda00640 1 --2- 172.21.15.6:0/4253691953 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42b8073b40 0x7f42b81f6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:29.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.267+0000 7f42bda00640 1 -- 172.21.15.6:0/4253691953 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42b80b4360 con 0x7f42b806eb30 2024-09-10T20:56:29.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.267+0000 7f42bd000640 1 --2- 172.21.15.6:0/4253691953 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42b8070de0 0x7f42b81f5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:56:29.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.267+0000 7f42bda00640 1 --2- 172.21.15.6:0/4253691953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42b806eb30 0x7f42b80c4e90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f42ac00c4c0 tx=0x7f42ac00c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:29.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.268+0000 7f42b5600640 1 -- 172.21.15.6:0/4253691953 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ac016020 con 0x7f42b806eb30 2024-09-10T20:56:29.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.268+0000 7f42b5600640 1 -- 172.21.15.6:0/4253691953 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42ac012940 con 0x7f42b806eb30 2024-09-10T20:56:29.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.268+0000 7f42bee00640 1 -- 172.21.15.6:0/4253691953 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42b80b4640 con 0x7f42b806eb30 2024-09-10T20:56:29.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.268+0000 7f42b5600640 1 -- 172.21.15.6:0/4253691953 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ac012d90 con 0x7f42b806eb30 2024-09-10T20:56:29.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.268+0000 7f42bee00640 1 -- 172.21.15.6:0/4253691953 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42b80b5f50 con 0x7f42b806eb30 2024-09-10T20:56:29.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.269+0000 7f42bee00640 1 -- 172.21.15.6:0/4253691953 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42b815bfb0 con 0x7f42b806eb30 2024-09-10T20:56:29.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.270+0000 7f42b5600640 1 -- 172.21.15.6:0/4253691953 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f42ac01a3b0 con 0x7f42b806eb30 2024-09-10T20:56:29.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.271+0000 7f42b5600640 1 --2- 172.21.15.6:0/4253691953 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4298077f70 0x7f429807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:29.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.271+0000 7f42b5600640 1 -- 172.21.15.6:0/4253691953 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5473+0+0 (secure 0 0 0) 0x7f42ac099c50 con 0x7f42b806eb30 2024-09-10T20:56:29.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.272+0000 7f42bd000640 1 --2- 172.21.15.6:0/4253691953 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4298077f70 0x7f429807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:29.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.272+0000 7f42bd000640 1 --2- 172.21.15.6:0/4253691953 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4298077f70 0x7f429807a430 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f42a4005fd0 tx=0x7f42a400f360 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:29.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.275+0000 7f42b5600640 1 -- 172.21.15.6:0/4253691953 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f42ac020030 con 0x7f42b806eb30 2024-09-10T20:56:29.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:29.468+0000 7f42bee00640 1 -- 172.21.15.6:0/4253691953 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f42b80af930 con 0x7f42b806eb30 2024-09-10T20:56:30.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.081+0000 7f42b5600640 1 -- 172.21.15.6:0/4253691953 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v27) ==== 169+0+0 (secure 0 0 0) 0x7f42ac062820 con 0x7f42b806eb30 2024-09-10T20:56:30.085 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2024-09-10T20:56:30.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.086+0000 7f42bee00640 1 -- 172.21.15.6:0/4253691953 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4298077f70 msgr2=0x7f429807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:30.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.086+0000 7f42bee00640 1 --2- 172.21.15.6:0/4253691953 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4298077f70 0x7f429807a430 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f42a4005fd0 tx=0x7f42a400f360 comp rx=0 tx=0).stop 2024-09-10T20:56:30.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.086+0000 7f42bee00640 1 -- 172.21.15.6:0/4253691953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42b806eb30 msgr2=0x7f42b80c4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:30.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.086+0000 7f42bee00640 1 --2- 172.21.15.6:0/4253691953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42b806eb30 0x7f42b80c4e90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f42ac00c4c0 tx=0x7f42ac00c980 comp rx=0 tx=0).stop 2024-09-10T20:56:30.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.086+0000 7f42bee00640 1 -- 172.21.15.6:0/4253691953 shutdown_connections 2024-09-10T20:56:30.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.086+0000 7f42bee00640 1 --2- 172.21.15.6:0/4253691953 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4298077f70 0x7f429807a430 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:30.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.086+0000 7f42bee00640 1 --2- 172.21.15.6:0/4253691953 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42b8073b40 0x7f42b81f6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:30.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.087+0000 7f42bee00640 1 --2- 172.21.15.6:0/4253691953 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42b8070de0 0x7f42b81f5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:30.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.087+0000 7f42bee00640 1 --2- 172.21.15.6:0/4253691953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42b806eb30 0x7f42b80c4e90 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:30.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.087+0000 7f42bee00640 1 -- 172.21.15.6:0/4253691953 >> 172.21.15.6:0/4253691953 conn(0x7f42b80d09c0 msgr2=0x7f42b80b13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:30.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.087+0000 7f42bee00640 1 -- 172.21.15.6:0/4253691953 shutdown_connections 2024-09-10T20:56:30.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.087+0000 7f42bee00640 1 -- 172.21.15.6:0/4253691953 wait complete. 2024-09-10T20:56:30.111 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T20:56:30.111 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T20:56:30.112 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T20:56:30.112 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:56:30.112 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T20:56:30.112 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T20:56:30.112 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T20:56:30.112 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:56:30.112 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T20:56:30.112 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T20:56:30.113 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T20:56:30.113 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:56:30.113 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T20:56:30.113 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T20:56:30.113 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T20:56:30.113 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:56:30.127 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T20:56:30.127 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T20:56:30.129 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T20:56:30.129 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T20:56:30.130 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T20:56:30.130 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T20:56:30.131 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T20:56:30.131 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T20:56:30.174 INFO:tasks.ceph.mds.a:Started 2024-09-10T20:56:30.174 DEBUG:teuthology.parallel:result is None 2024-09-10T20:56:30.175 INFO:tasks.ceph.mds.b:Started 2024-09-10T20:56:30.175 DEBUG:teuthology.parallel:result is None 2024-09-10T20:56:30.176 INFO:tasks.ceph.mds.d:Started 2024-09-10T20:56:30.177 DEBUG:teuthology.parallel:result is None 2024-09-10T20:56:30.177 INFO:tasks.ceph.mds.c:Started 2024-09-10T20:56:30.177 DEBUG:teuthology.parallel:result is None 2024-09-10T20:56:30.178 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T20:56:30.308 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2024-09-10T20:56:30.308 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2024-09-10T20:56:30.309 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2024-09-10T20:56:30.309 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2024-09-10T20:56:30.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.344+0000 7f0806800640 1 -- 172.21.15.6:0/567339054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08001592f0 msgr2=0x7f080006e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:30.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.344+0000 7f0806800640 1 --2- 172.21.15.6:0/567339054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08001592f0 0x7f080006e420 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f08000cb900 tx=0x7f07f402aa10 comp rx=0 tx=0).stop 2024-09-10T20:56:30.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.344+0000 7f0806800640 1 -- 172.21.15.6:0/567339054 shutdown_connections 2024-09-10T20:56:30.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.344+0000 7f0806800640 1 --2- 172.21.15.6:0/567339054 >> v2:172.21.15.150:3300/0 conn(0x7f080006e960 0x7f0800073a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:30.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.344+0000 7f0806800640 1 --2- 172.21.15.6:0/567339054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08001592f0 0x7f080006e420 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:30.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.344+0000 7f0806800640 1 -- 172.21.15.6:0/567339054 >> 172.21.15.6:0/567339054 conn(0x7f080006d660 msgr2=0x7f08000b1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:30.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.344+0000 7f0806800640 1 -- 172.21.15.6:0/567339054 shutdown_connections 2024-09-10T20:56:30.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.344+0000 7f0806800640 1 -- 172.21.15.6:0/567339054 wait complete. 2024-09-10T20:56:30.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.346+0000 7f0806800640 1 Processor -- start 2024-09-10T20:56:30.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.346+0000 7f0806800640 1 -- start start 2024-09-10T20:56:30.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.347+0000 7f0806800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f080006e960 0x7f0800154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:30.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.347+0000 7f0806800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0800073f90 0x7f08001fc820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:30.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.347+0000 7f0806800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08001592f0 0x7f08001540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:30.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.347+0000 7f0806800640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0800159850 con 0x7f080006e960 2024-09-10T20:56:30.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.347+0000 7f0806800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f08001596d0 con 0x7f0800073f90 2024-09-10T20:56:30.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.347+0000 7f0806800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f080015fb60 con 0x7f08001592f0 2024-09-10T20:56:30.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.347+0000 7f0805400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f080006e960 0x7f0800154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:30.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.347+0000 7f0805400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f080006e960 0x7f0800154bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58878/0 (socket says 172.21.15.6:58878) 2024-09-10T20:56:30.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.347+0000 7f0805400640 1 -- 172.21.15.6:0/4012844140 learned_addr learned my addr 172.21.15.6:0/4012844140 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:30.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.347+0000 7f0805e00640 1 --2- 172.21.15.6:0/4012844140 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08001592f0 0x7f08001540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:30.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.347+0000 7f0804a00640 1 --2- 172.21.15.6:0/4012844140 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0800073f90 0x7f08001fc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:30.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.347+0000 7f0805400640 1 -- 172.21.15.6:0/4012844140 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08001592f0 msgr2=0x7f08001540c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:30.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.347+0000 7f0805400640 1 --2- 172.21.15.6:0/4012844140 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08001592f0 0x7f08001540c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:30.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.347+0000 7f0805400640 1 -- 172.21.15.6:0/4012844140 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0800073f90 msgr2=0x7f08001fc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:30.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.347+0000 7f0805400640 1 --2- 172.21.15.6:0/4012844140 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0800073f90 0x7f08001fc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:30.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.347+0000 7f0805400640 1 -- 172.21.15.6:0/4012844140 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f080014dac0 con 0x7f080006e960 2024-09-10T20:56:30.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.348+0000 7f0805400640 1 --2- 172.21.15.6:0/4012844140 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f080006e960 0x7f0800154bf0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f07f4009bf0 tx=0x7f07f4003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:30.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.348+0000 7f07fd600640 1 -- 172.21.15.6:0/4012844140 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f4033050 con 0x7f080006e960 2024-09-10T20:56:30.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.348+0000 7f07fd600640 1 -- 172.21.15.6:0/4012844140 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f07f40044d0 con 0x7f080006e960 2024-09-10T20:56:30.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.348+0000 7f0806800640 1 -- 172.21.15.6:0/4012844140 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f080014dda0 con 0x7f080006e960 2024-09-10T20:56:30.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.348+0000 7f07fd600640 1 -- 172.21.15.6:0/4012844140 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f4038450 con 0x7f080006e960 2024-09-10T20:56:30.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.348+0000 7f0806800640 1 -- 172.21.15.6:0/4012844140 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08001fcd60 con 0x7f080006e960 2024-09-10T20:56:30.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.350+0000 7f0806800640 1 -- 172.21.15.6:0/4012844140 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f080015ffb0 con 0x7f080006e960 2024-09-10T20:56:30.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.351+0000 7f07fd600640 1 -- 172.21.15.6:0/4012844140 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f07f4040070 con 0x7f080006e960 2024-09-10T20:56:30.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.352+0000 7f07fd600640 1 --2- 172.21.15.6:0/4012844140 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f07e0077f70 0x7f07e007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:30.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.352+0000 7f07fd600640 1 -- 172.21.15.6:0/4012844140 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4943+0+0 (secure 0 0 0) 0x7f07f40bacb0 con 0x7f080006e960 2024-09-10T20:56:30.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.353+0000 7f0804a00640 1 --2- 172.21.15.6:0/4012844140 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f07e0077f70 0x7f07e007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:30.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.353+0000 7f0804a00640 1 --2- 172.21.15.6:0/4012844140 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f07e0077f70 0x7f07e007a430 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f07ec004590 tx=0x7f07ec00b3c0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:30.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.357+0000 7f07fd600640 1 -- 172.21.15.6:0/4012844140 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f07f4083450 con 0x7f080006e960 2024-09-10T20:56:30.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:30.561+0000 7f0806800640 1 -- 172.21.15.6:0/4012844140 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f080014df70 con 0x7f080006e960 2024-09-10T20:56:31.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.098+0000 7f07fd600640 1 -- 172.21.15.6:0/4012844140 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v29) ==== 97+0+0 (secure 0 0 0) 0x7f07f4087e80 con 0x7f080006e960 2024-09-10T20:56:31.102 INFO:teuthology.orchestra.run.smithi006.stderr: removed all blocklist entries 2024-09-10T20:56:31.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.101+0000 7f0806800640 1 -- 172.21.15.6:0/4012844140 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f07e0077f70 msgr2=0x7f07e007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:31.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.101+0000 7f0806800640 1 --2- 172.21.15.6:0/4012844140 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f07e0077f70 0x7f07e007a430 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f07ec004590 tx=0x7f07ec00b3c0 comp rx=0 tx=0).stop 2024-09-10T20:56:31.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.101+0000 7f0806800640 1 -- 172.21.15.6:0/4012844140 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f080006e960 msgr2=0x7f0800154bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:31.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.101+0000 7f0806800640 1 --2- 172.21.15.6:0/4012844140 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f080006e960 0x7f0800154bf0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f07f4009bf0 tx=0x7f07f4003f90 comp rx=0 tx=0).stop 2024-09-10T20:56:31.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.101+0000 7f0806800640 1 -- 172.21.15.6:0/4012844140 shutdown_connections 2024-09-10T20:56:31.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.101+0000 7f0806800640 1 --2- 172.21.15.6:0/4012844140 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f07e0077f70 0x7f07e007a430 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:31.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.101+0000 7f0806800640 1 --2- 172.21.15.6:0/4012844140 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08001592f0 0x7f08001540c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:31.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.101+0000 7f0806800640 1 --2- 172.21.15.6:0/4012844140 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0800073f90 0x7f08001fc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:31.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.101+0000 7f0806800640 1 --2- 172.21.15.6:0/4012844140 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f080006e960 0x7f0800154bf0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:31.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.101+0000 7f0806800640 1 -- 172.21.15.6:0/4012844140 >> 172.21.15.6:0/4012844140 conn(0x7f080006d660 msgr2=0x7f080015a320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:31.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.101+0000 7f0806800640 1 -- 172.21.15.6:0/4012844140 shutdown_connections 2024-09-10T20:56:31.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.101+0000 7f0806800640 1 -- 172.21.15.6:0/4012844140 wait complete. 2024-09-10T20:56:31.125 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T20:56:31.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.284+0000 7fe700e00640 1 -- 172.21.15.6:0/3330142186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6fc161930 msgr2=0x7fe6fc161d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:31.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.284+0000 7fe700e00640 1 --2- 172.21.15.6:0/3330142186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6fc161930 0x7fe6fc161d60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4005fd0 tx=0x7fe6f402a8b0 comp rx=0 tx=0).stop 2024-09-10T20:56:31.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.284+0000 7fe700e00640 1 -- 172.21.15.6:0/3330142186 shutdown_connections 2024-09-10T20:56:31.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.284+0000 7fe700e00640 1 --2- 172.21.15.6:0/3330142186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6fc161930 0x7fe6fc161d60 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.284+0000 7fe700e00640 1 --2- 172.21.15.6:0/3330142186 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6fc15dc90 0x7fe6fc0d46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.284+0000 7fe700e00640 1 -- 172.21.15.6:0/3330142186 >> 172.21.15.6:0/3330142186 conn(0x7fe6fc09d0a0 msgr2=0x7fe6fc0d3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.284+0000 7fe700e00640 1 -- 172.21.15.6:0/3330142186 shutdown_connections 2024-09-10T20:56:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.284+0000 7fe700e00640 1 -- 172.21.15.6:0/3330142186 wait complete. 2024-09-10T20:56:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.286+0000 7fe700e00640 1 Processor -- start 2024-09-10T20:56:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.286+0000 7fe700e00640 1 -- start start 2024-09-10T20:56:31.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.287+0000 7fe700e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6fc0cf380 0x7fe6fc0cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:31.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.287+0000 7fe700e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6fc15dc90 0x7fe6fc160820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:31.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.287+0000 7fe700e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6fc161930 0x7fe6fc147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:31.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.287+0000 7fe700e00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe6fc15e1f0 con 0x7fe6fc15dc90 2024-09-10T20:56:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.287+0000 7fe700e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe6fc15e070 con 0x7fe6fc0cf380 2024-09-10T20:56:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.287+0000 7fe700e00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe6fc0b3350 con 0x7fe6fc161930 2024-09-10T20:56:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.287+0000 7fe6faa00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6fc15dc90 0x7fe6fc160820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.287+0000 7fe6faa00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6fc15dc90 0x7fe6fc160820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58892/0 (socket says 172.21.15.6:58892) 2024-09-10T20:56:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.287+0000 7fe6faa00640 1 -- 172.21.15.6:0/302765786 learned_addr learned my addr 172.21.15.6:0/302765786 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.287+0000 7fe6fb400640 1 --2- 172.21.15.6:0/302765786 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6fc0cf380 0x7fe6fc0cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.287+0000 7fe6fbe00640 1 --2- 172.21.15.6:0/302765786 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6fc161930 0x7fe6fc147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.287+0000 7fe6faa00640 1 -- 172.21.15.6:0/302765786 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6fc161930 msgr2=0x7fe6fc147ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.287+0000 7fe6faa00640 1 --2- 172.21.15.6:0/302765786 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6fc161930 0x7fe6fc147ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.287+0000 7fe6faa00640 1 -- 172.21.15.6:0/302765786 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6fc0cf380 msgr2=0x7fe6fc0cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.287+0000 7fe6faa00640 1 --2- 172.21.15.6:0/302765786 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6fc0cf380 0x7fe6fc0cd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.287+0000 7fe6faa00640 1 -- 172.21.15.6:0/302765786 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6fc1f4950 con 0x7fe6fc15dc90 2024-09-10T20:56:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.287+0000 7fe6fb400640 1 --2- 172.21.15.6:0/302765786 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6fc0cf380 0x7fe6fc0cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:56:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.287+0000 7fe6fbe00640 1 --2- 172.21.15.6:0/302765786 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6fc161930 0x7fe6fc147ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:56:31.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.288+0000 7fe6faa00640 1 --2- 172.21.15.6:0/302765786 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6fc15dc90 0x7fe6fc160820 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe6e800c480 tx=0x7fe6e800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:31.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.288+0000 7fe6f3400640 1 -- 172.21.15.6:0/302765786 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e8016020 con 0x7fe6fc15dc90 2024-09-10T20:56:31.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.288+0000 7fe6f3400640 1 -- 172.21.15.6:0/302765786 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe6e8012920 con 0x7fe6fc15dc90 2024-09-10T20:56:31.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.288+0000 7fe700e00640 1 -- 172.21.15.6:0/302765786 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6fc0b6d30 con 0x7fe6fc15dc90 2024-09-10T20:56:31.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.288+0000 7fe6f3400640 1 -- 172.21.15.6:0/302765786 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e8012d70 con 0x7fe6fc15dc90 2024-09-10T20:56:31.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.288+0000 7fe700e00640 1 -- 172.21.15.6:0/302765786 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6fc160020 con 0x7fe6fc15dc90 2024-09-10T20:56:31.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.289+0000 7fe700e00640 1 -- 172.21.15.6:0/302765786 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6fc069d10 con 0x7fe6fc15dc90 2024-09-10T20:56:31.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.290+0000 7fe6f3400640 1 -- 172.21.15.6:0/302765786 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe6e801b400 con 0x7fe6fc15dc90 2024-09-10T20:56:31.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.291+0000 7fe6f3400640 1 --2- 172.21.15.6:0/302765786 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fe6dc077f70 0x7fe6dc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:31.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.291+0000 7fe6f3400640 1 -- 172.21.15.6:0/302765786 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7fe6e8099d00 con 0x7fe6fc15dc90 2024-09-10T20:56:31.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.291+0000 7fe6fb400640 1 --2- 172.21.15.6:0/302765786 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fe6dc077f70 0x7fe6dc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:31.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.292+0000 7fe6fb400640 1 --2- 172.21.15.6:0/302765786 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fe6dc077f70 0x7fe6dc07a430 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec009c20 tx=0x7fe6ec005f90 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:31.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.295+0000 7fe6f3400640 1 -- 172.21.15.6:0/302765786 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe6e8020020 con 0x7fe6fc15dc90 2024-09-10T20:56:31.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.563+0000 7fe700e00640 1 -- 172.21.15.6:0/302765786 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fe6fc0b48a0 con 0x7fe6fc15dc90 2024-09-10T20:56:31.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.563+0000 7fe6f3400640 1 -- 172.21.15.6:0/302765786 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) ==== 80+0+6645 (secure 0 0 0) 0x7fe6e8062b40 con 0x7fe6fc15dc90 2024-09-10T20:56:31.568 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:56:31.568 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-10T20:56:31.568 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_dump": [ 2024-09-10T20:56:31.568 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-10T20:56:31.568 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.a", 2024-09-10T20:56:31.568 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQARsuBmk4/LJRAAXSZjQOCY1WqwkCk+HIu8cg==", 2024-09-10T20:56:31.568 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-09-10T20:56:31.568 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-09-10T20:56:31.568 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-09-10T20:56:31.568 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-09-10T20:56:31.568 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-09-10T20:56:31.569 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-10T20:56:31.569 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-10T20:56:31.569 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-10T20:56:31.569 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.b", 2024-09-10T20:56:31.569 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQARsuBmXbdeORAAVuyYaPlnRkyNSt0FXamAoQ==", 2024-09-10T20:56:31.569 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-09-10T20:56:31.569 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-09-10T20:56:31.569 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-09-10T20:56:31.569 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-09-10T20:56:31.569 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-09-10T20:56:31.569 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-10T20:56:31.569 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-10T20:56:31.569 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-10T20:56:31.570 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.c", 2024-09-10T20:56:31.570 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQARsuBmlJqHLxAAJU7v97KLRyCoVfQRBPPvog==", 2024-09-10T20:56:31.570 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-09-10T20:56:31.570 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-09-10T20:56:31.570 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-09-10T20:56:31.570 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-09-10T20:56:31.570 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-09-10T20:56:31.570 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-10T20:56:31.570 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-10T20:56:31.570 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-10T20:56:31.570 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.d", 2024-09-10T20:56:31.570 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQASsuBmGiWrBxAAcKZGtVlOMsx0jIyl6kWrcQ==", 2024-09-10T20:56:31.570 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-09-10T20:56:31.570 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-09-10T20:56:31.571 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-09-10T20:56:31.571 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-09-10T20:56:31.571 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-09-10T20:56:31.571 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-10T20:56:31.571 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-10T20:56:31.571 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-10T20:56:31.571 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.0", 2024-09-10T20:56:31.571 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAVsuBmXwgXHRAA89mA1xkQvChOC+LklFyOBw==", 2024-09-10T20:56:31.571 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-09-10T20:56:31.571 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-09-10T20:56:31.571 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-09-10T20:56:31.571 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-09-10T20:56:31.571 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-10T20:56:31.571 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-10T20:56:31.572 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-10T20:56:31.572 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.1", 2024-09-10T20:56:31.572 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAYsuBmuoWEKBAA+0FiqnZB10NjUy55/z39bg==", 2024-09-10T20:56:31.572 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-09-10T20:56:31.572 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-09-10T20:56:31.572 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-09-10T20:56:31.572 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-09-10T20:56:31.572 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-10T20:56:31.572 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-10T20:56:31.572 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-10T20:56:31.572 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.2", 2024-09-10T20:56:31.572 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAbsuBmsFJpMxAAIiax40up1IZ7++e1xUwxOw==", 2024-09-10T20:56:31.572 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-09-10T20:56:31.572 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-09-10T20:56:31.573 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-09-10T20:56:31.573 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-09-10T20:56:31.573 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-10T20:56:31.573 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-10T20:56:31.573 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-10T20:56:31.573 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.3", 2024-09-10T20:56:31.573 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAfsuBmcI3XAhAAmhBuOa922xY0GGPo9ysLLw==", 2024-09-10T20:56:31.573 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-09-10T20:56:31.573 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-09-10T20:56:31.573 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-09-10T20:56:31.573 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-09-10T20:56:31.573 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-10T20:56:31.573 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-10T20:56:31.573 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-10T20:56:31.574 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.4", 2024-09-10T20:56:31.574 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAlsuBmSvq7ABAAeJ/S0KQwg9kF67WggwRuiw==", 2024-09-10T20:56:31.574 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-09-10T20:56:31.574 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-09-10T20:56:31.574 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-09-10T20:56:31.574 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-09-10T20:56:31.574 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-10T20:56:31.574 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-10T20:56:31.574 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-10T20:56:31.574 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.5", 2024-09-10T20:56:31.574 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAosuBmCbH4ChAAZvLHlJLuKMy4VCIreeaMnw==", 2024-09-10T20:56:31.574 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-09-10T20:56:31.574 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-09-10T20:56:31.574 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-09-10T20:56:31.575 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-09-10T20:56:31.575 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-10T20:56:31.575 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-10T20:56:31.575 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-10T20:56:31.575 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.6", 2024-09-10T20:56:31.575 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQArsuBm/DFVFhAAaHlXz0HnV6DBdYho0IxqOw==", 2024-09-10T20:56:31.575 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-09-10T20:56:31.575 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-09-10T20:56:31.575 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-09-10T20:56:31.575 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-09-10T20:56:31.575 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-10T20:56:31.575 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-10T20:56:31.575 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-10T20:56:31.575 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.7", 2024-09-10T20:56:31.576 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAusuBmKU/kIBAAR2TxXPR6Yv7E61B/JYaVYA==", 2024-09-10T20:56:31.576 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-09-10T20:56:31.576 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-09-10T20:56:31.576 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-09-10T20:56:31.576 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-09-10T20:56:31.576 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-10T20:56:31.576 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-10T20:56:31.576 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-10T20:56:31.576 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.0", 2024-09-10T20:56:31.576 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQASsuBmdMMgEBAAKC0NFMDWd/XK9Za4e+RV8g==", 2024-09-10T20:56:31.576 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-09-10T20:56:31.576 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-09-10T20:56:31.576 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2024-09-10T20:56:31.577 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2024-09-10T20:56:31.577 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2024-09-10T20:56:31.577 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-10T20:56:31.577 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-10T20:56:31.577 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-10T20:56:31.577 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.1", 2024-09-10T20:56:31.577 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQASsuBmN5cRHRAAQWhcPRNq3YkaLqA54IoyXQ==", 2024-09-10T20:56:31.577 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-09-10T20:56:31.577 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-09-10T20:56:31.577 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2024-09-10T20:56:31.577 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2024-09-10T20:56:31.577 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2024-09-10T20:56:31.577 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-10T20:56:31.577 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-10T20:56:31.578 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-10T20:56:31.578 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.2", 2024-09-10T20:56:31.578 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQASsuBm3qObFhAA8pSZ6G5UlviURweMrtjNSg==", 2024-09-10T20:56:31.578 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-09-10T20:56:31.578 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-09-10T20:56:31.578 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2024-09-10T20:56:31.578 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2024-09-10T20:56:31.578 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2024-09-10T20:56:31.578 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-10T20:56:31.578 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-10T20:56:31.578 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-10T20:56:31.578 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.3", 2024-09-10T20:56:31.578 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQASsuBmt1mIIxAAA97KhPLnIBk1HBekuTdP8Q==", 2024-09-10T20:56:31.579 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-09-10T20:56:31.579 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-09-10T20:56:31.579 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2024-09-10T20:56:31.579 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2024-09-10T20:56:31.579 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2024-09-10T20:56:31.579 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-10T20:56:31.579 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-10T20:56:31.579 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-10T20:56:31.579 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.admin", 2024-09-10T20:56:31.579 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAQsuBmhGWuMBAAxz0mHszDlSemHUUylIul/Q==", 2024-09-10T20:56:31.579 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-09-10T20:56:31.579 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2024-09-10T20:56:31.579 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-09-10T20:56:31.580 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-09-10T20:56:31.580 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-09-10T20:56:31.580 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-10T20:56:31.580 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-10T20:56:31.580 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-10T20:56:31.580 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-mds", 2024-09-10T20:56:31.580 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQA1suBmcYEDOhAAtXSxa0+UL1OI3ES9xY5E3Q==", 2024-09-10T20:56:31.580 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-09-10T20:56:31.580 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-mds" 2024-09-10T20:56:31.580 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-10T20:56:31.580 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-10T20:56:31.580 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-10T20:56:31.580 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-mgr", 2024-09-10T20:56:31.580 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQA1suBmapQDOhAAumPaGpWetcUbHc/tvk5f5w==", 2024-09-10T20:56:31.581 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-09-10T20:56:31.581 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-10T20:56:31.581 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-10T20:56:31.581 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-10T20:56:31.581 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-10T20:56:31.581 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-osd", 2024-09-10T20:56:31.581 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQA1suBmu6MDOhAAA5DG83QVVanKhoPM0AD7mg==", 2024-09-10T20:56:31.581 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-09-10T20:56:31.581 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-osd" 2024-09-10T20:56:31.581 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-10T20:56:31.581 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-10T20:56:31.581 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-10T20:56:31.581 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-rbd", 2024-09-10T20:56:31.581 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQA1suBmNbMDOhAARGN6g0uzYbG+14afikfNGw==", 2024-09-10T20:56:31.582 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-09-10T20:56:31.582 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-10T20:56:31.582 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-10T20:56:31.582 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-10T20:56:31.582 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-10T20:56:31.582 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-10T20:56:31.582 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQA1suBmmMIDOhAAFDYuqR1UtbKb+VOQMNDatw==", 2024-09-10T20:56:31.582 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-09-10T20:56:31.582 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-10T20:56:31.582 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-10T20:56:31.582 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-10T20:56:31.582 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-10T20:56:31.582 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-rgw", 2024-09-10T20:56:31.582 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQA1suBmfdIDOhAAVtouqHcEBJsQxLQhLSQjcw==", 2024-09-10T20:56:31.583 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-09-10T20:56:31.583 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-10T20:56:31.583 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-10T20:56:31.583 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-10T20:56:31.583 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-10T20:56:31.583 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.x", 2024-09-10T20:56:31.583 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQARsuBmLy8rHxAAZ44xGXvE2mJvDhjRVsyzQw==", 2024-09-10T20:56:31.583 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-09-10T20:56:31.583 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2024-09-10T20:56:31.583 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2024-09-10T20:56:31.583 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-09-10T20:56:31.583 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-10T20:56:31.583 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-10T20:56:31.583 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-10T20:56:31.584 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.y", 2024-09-10T20:56:31.584 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQARsuBm64LlFhAAAVIB4dikwMdIwmY8qA9bTg==", 2024-09-10T20:56:31.584 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-09-10T20:56:31.584 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2024-09-10T20:56:31.584 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2024-09-10T20:56:31.584 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-09-10T20:56:31.584 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-10T20:56:31.584 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-10T20:56:31.584 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-10T20:56:31.584 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-10T20:56:31.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.566+0000 7fe700e00640 1 -- 172.21.15.6:0/302765786 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fe6dc077f70 msgr2=0x7fe6dc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:31.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.566+0000 7fe700e00640 1 --2- 172.21.15.6:0/302765786 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fe6dc077f70 0x7fe6dc07a430 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec009c20 tx=0x7fe6ec005f90 comp rx=0 tx=0).stop 2024-09-10T20:56:31.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.566+0000 7fe700e00640 1 -- 172.21.15.6:0/302765786 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6fc15dc90 msgr2=0x7fe6fc160820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:31.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.566+0000 7fe700e00640 1 --2- 172.21.15.6:0/302765786 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6fc15dc90 0x7fe6fc160820 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe6e800c480 tx=0x7fe6e800c940 comp rx=0 tx=0).stop 2024-09-10T20:56:31.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.566+0000 7fe700e00640 1 -- 172.21.15.6:0/302765786 shutdown_connections 2024-09-10T20:56:31.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.566+0000 7fe700e00640 1 --2- 172.21.15.6:0/302765786 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fe6dc077f70 0x7fe6dc07a430 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:31.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.566+0000 7fe700e00640 1 --2- 172.21.15.6:0/302765786 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6fc15dc90 0x7fe6fc160820 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:31.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.566+0000 7fe700e00640 1 --2- 172.21.15.6:0/302765786 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6fc161930 0x7fe6fc147ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:31.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.566+0000 7fe700e00640 1 --2- 172.21.15.6:0/302765786 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6fc0cf380 0x7fe6fc0cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:31.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.566+0000 7fe700e00640 1 -- 172.21.15.6:0/302765786 >> 172.21.15.6:0/302765786 conn(0x7fe6fc09d0a0 msgr2=0x7fe6fc0b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:31.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.566+0000 7fe700e00640 1 -- 172.21.15.6:0/302765786 shutdown_connections 2024-09-10T20:56:31.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.566+0000 7fe700e00640 1 -- 172.21.15.6:0/302765786 wait complete. 2024-09-10T20:56:31.587 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-10T20:56:31.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.746+0000 7f6085a00640 1 -- 172.21.15.6:0/3319616406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f608015e090 msgr2=0x7f60800d0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:31.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.746+0000 7f6085a00640 1 --2- 172.21.15.6:0/3319616406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f608015e090 0x7f60800d0f60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6068009830 tx=0x7f606802a5b0 comp rx=0 tx=0).stop 2024-09-10T20:56:31.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.746+0000 7f6085a00640 1 -- 172.21.15.6:0/3319616406 shutdown_connections 2024-09-10T20:56:31.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.746+0000 7f6085a00640 1 --2- 172.21.15.6:0/3319616406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f608015e090 0x7f60800d0f60 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:31.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.746+0000 7f6085a00640 1 -- 172.21.15.6:0/3319616406 >> 172.21.15.6:0/3319616406 conn(0x7f608009d100 msgr2=0x7f60800d3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:31.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.746+0000 7f6085a00640 1 -- 172.21.15.6:0/3319616406 shutdown_connections 2024-09-10T20:56:31.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.746+0000 7f6085a00640 1 -- 172.21.15.6:0/3319616406 wait complete. 2024-09-10T20:56:31.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.748+0000 7f6085a00640 1 Processor -- start 2024-09-10T20:56:31.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.748+0000 7f6085a00640 1 -- start start 2024-09-10T20:56:31.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.749+0000 7f6085a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60800cf7a0 0x7f60801522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:31.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.749+0000 7f6085a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f608015dcb0 0x7f60801527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:31.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.749+0000 7f6085a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f608015e090 0x7f60801f7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:31.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.749+0000 7f6085a00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f60800b6e50 con 0x7f60800cf7a0 2024-09-10T20:56:31.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.749+0000 7f6085a00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6080162370 con 0x7f608015dcb0 2024-09-10T20:56:31.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.749+0000 7f6085a00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f60800b6fd0 con 0x7f608015e090 2024-09-10T20:56:31.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.749+0000 7f607fe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60800cf7a0 0x7f60801522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:31.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.749+0000 7f607fe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60800cf7a0 0x7f60801522b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58922/0 (socket says 172.21.15.6:58922) 2024-09-10T20:56:31.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.749+0000 7f607fe00640 1 -- 172.21.15.6:0/3142831618 learned_addr learned my addr 172.21.15.6:0/3142831618 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:31.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.749+0000 7f607f400640 1 --2- 172.21.15.6:0/3142831618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f608015dcb0 0x7f60801527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:31.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.749+0000 7f6085000640 1 --2- 172.21.15.6:0/3142831618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f608015e090 0x7f60801f7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:31.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.749+0000 7f607fe00640 1 -- 172.21.15.6:0/3142831618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f608015e090 msgr2=0x7f60801f7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:31.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.749+0000 7f607fe00640 1 --2- 172.21.15.6:0/3142831618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f608015e090 0x7f60801f7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:31.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.749+0000 7f607fe00640 1 -- 172.21.15.6:0/3142831618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f608015dcb0 msgr2=0x7f60801527f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:31.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.749+0000 7f607fe00640 1 --2- 172.21.15.6:0/3142831618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f608015dcb0 0x7f60801527f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:31.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.749+0000 7f607fe00640 1 -- 172.21.15.6:0/3142831618 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60800c7ec0 con 0x7f60800cf7a0 2024-09-10T20:56:31.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.749+0000 7f607f400640 1 --2- 172.21.15.6:0/3142831618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f608015dcb0 0x7f60801527f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:56:31.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.749+0000 7f6085000640 1 --2- 172.21.15.6:0/3142831618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f608015e090 0x7f60801f7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:56:31.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.750+0000 7f607fe00640 1 --2- 172.21.15.6:0/3142831618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60800cf7a0 0x7f60801522b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f607000c870 tx=0x7f607000cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:31.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.750+0000 7f6077e00640 1 -- 172.21.15.6:0/3142831618 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6070003b70 con 0x7f60800cf7a0 2024-09-10T20:56:31.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.750+0000 7f6077e00640 1 -- 172.21.15.6:0/3142831618 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6070003d10 con 0x7f60800cf7a0 2024-09-10T20:56:31.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.750+0000 7f6077e00640 1 -- 172.21.15.6:0/3142831618 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607000aab0 con 0x7f60800cf7a0 2024-09-10T20:56:31.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.750+0000 7f6085a00640 1 -- 172.21.15.6:0/3142831618 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60800c81a0 con 0x7f60800cf7a0 2024-09-10T20:56:31.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.750+0000 7f6085a00640 1 -- 172.21.15.6:0/3142831618 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60800c8760 con 0x7f60800cf7a0 2024-09-10T20:56:31.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.751+0000 7f6085a00640 1 -- 172.21.15.6:0/3142831618 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60801616f0 con 0x7f60800cf7a0 2024-09-10T20:56:31.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.752+0000 7f6077e00640 1 -- 172.21.15.6:0/3142831618 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f607000ac50 con 0x7f60800cf7a0 2024-09-10T20:56:31.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.753+0000 7f6077e00640 1 --2- 172.21.15.6:0/3142831618 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f605c077f70 0x7f605c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:31.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.753+0000 7f6077e00640 1 -- 172.21.15.6:0/3142831618 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7f60700998a0 con 0x7f60800cf7a0 2024-09-10T20:56:31.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.754+0000 7f607f400640 1 --2- 172.21.15.6:0/3142831618 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f605c077f70 0x7f605c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:31.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.755+0000 7f607f400640 1 --2- 172.21.15.6:0/3142831618 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f605c077f70 0x7f605c07a430 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6068034000 tx=0x7f6068004730 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:31.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:31.757+0000 7f6077e00640 1 -- 172.21.15.6:0/3142831618 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f60801616f0 con 0x7f60800cf7a0 2024-09-10T20:56:32.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.027+0000 7f6085a00640 1 -- 172.21.15.6:0/3142831618 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f60800d4500 con 0x7f60800cf7a0 2024-09-10T20:56:32.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.030+0000 7f6077e00640 1 -- 172.21.15.6:0/3142831618 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7f60700626e0 con 0x7f60800cf7a0 2024-09-10T20:56:32.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.032+0000 7f6085a00640 1 -- 172.21.15.6:0/3142831618 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f605c077f70 msgr2=0x7f605c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:32.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.032+0000 7f6085a00640 1 --2- 172.21.15.6:0/3142831618 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f605c077f70 0x7f605c07a430 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6068034000 tx=0x7f6068004730 comp rx=0 tx=0).stop 2024-09-10T20:56:32.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.032+0000 7f6085a00640 1 -- 172.21.15.6:0/3142831618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60800cf7a0 msgr2=0x7f60801522b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:32.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.032+0000 7f6085a00640 1 --2- 172.21.15.6:0/3142831618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60800cf7a0 0x7f60801522b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f607000c870 tx=0x7f607000cd30 comp rx=0 tx=0).stop 2024-09-10T20:56:32.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.032+0000 7f6085a00640 1 -- 172.21.15.6:0/3142831618 shutdown_connections 2024-09-10T20:56:32.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.032+0000 7f6085a00640 1 --2- 172.21.15.6:0/3142831618 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f605c077f70 0x7f605c07a430 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.032+0000 7f6085a00640 1 --2- 172.21.15.6:0/3142831618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f608015e090 0x7f60801f7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.032+0000 7f6085a00640 1 --2- 172.21.15.6:0/3142831618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f608015dcb0 0x7f60801527f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.032+0000 7f6085a00640 1 --2- 172.21.15.6:0/3142831618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60800cf7a0 0x7f60801522b0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.032+0000 7f6085a00640 1 -- 172.21.15.6:0/3142831618 >> 172.21.15.6:0/3142831618 conn(0x7f608009d100 msgr2=0x7f60800b7a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:32.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.033+0000 7f6085a00640 1 -- 172.21.15.6:0/3142831618 shutdown_connections 2024-09-10T20:56:32.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.033+0000 7f6085a00640 1 -- 172.21.15.6:0/3142831618 wait complete. 2024-09-10T20:56:32.052 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-10T20:56:32.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.213+0000 7f5d39c00640 1 -- 172.21.15.6:0/1170073305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d34070450 msgr2=0x7f5d340cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:32.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.213+0000 7f5d39c00640 1 --2- 172.21.15.6:0/1170073305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d34070450 0x7f5d340cd920 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c005fd0 tx=0x7f5d2c02a910 comp rx=0 tx=0).stop 2024-09-10T20:56:32.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.213+0000 7f5d39c00640 1 -- 172.21.15.6:0/1170073305 shutdown_connections 2024-09-10T20:56:32.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.213+0000 7f5d39c00640 1 --2- 172.21.15.6:0/1170073305 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d3415c170 0x7f5d340743b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.213+0000 7f5d39c00640 1 --2- 172.21.15.6:0/1170073305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d34070450 0x7f5d340cd920 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.213+0000 7f5d39c00640 1 -- 172.21.15.6:0/1170073305 >> 172.21.15.6:0/1170073305 conn(0x7f5d340cfa20 msgr2=0x7f5d340cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:32.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.213+0000 7f5d39c00640 1 -- 172.21.15.6:0/1170073305 shutdown_connections 2024-09-10T20:56:32.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.213+0000 7f5d39c00640 1 -- 172.21.15.6:0/1170073305 wait complete. 2024-09-10T20:56:32.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.215+0000 7f5d39c00640 1 Processor -- start 2024-09-10T20:56:32.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.215+0000 7f5d39c00640 1 -- start start 2024-09-10T20:56:32.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.216+0000 7f5d39c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d34070450 0x7f5d3415ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:32.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.216+0000 7f5d39c00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d34159670 0x7f5d341f5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:32.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.216+0000 7f5d39c00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d3415c170 0x7f5d341f61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:32.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.216+0000 7f5d39c00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5d340b4ca0 con 0x7f5d3415c170 2024-09-10T20:56:32.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.216+0000 7f5d39c00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5d340b4b20 con 0x7f5d34070450 2024-09-10T20:56:32.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.216+0000 7f5d39c00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f5d340b4e20 con 0x7f5d34159670 2024-09-10T20:56:32.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.216+0000 7f5d33400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d3415c170 0x7f5d341f61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:32.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.216+0000 7f5d33400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d3415c170 0x7f5d341f61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58938/0 (socket says 172.21.15.6:58938) 2024-09-10T20:56:32.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.216+0000 7f5d33400640 1 -- 172.21.15.6:0/654282087 learned_addr learned my addr 172.21.15.6:0/654282087 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:32.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.216+0000 7f5d32000640 1 --2- 172.21.15.6:0/654282087 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d34159670 0x7f5d341f5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:32.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.216+0000 7f5d32a00640 1 --2- 172.21.15.6:0/654282087 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d34070450 0x7f5d3415ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:32.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.217+0000 7f5d33400640 1 -- 172.21.15.6:0/654282087 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d34159670 msgr2=0x7f5d341f5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:32.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.217+0000 7f5d33400640 1 --2- 172.21.15.6:0/654282087 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d34159670 0x7f5d341f5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.217+0000 7f5d33400640 1 -- 172.21.15.6:0/654282087 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d34070450 msgr2=0x7f5d3415ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:32.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.217+0000 7f5d33400640 1 --2- 172.21.15.6:0/654282087 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d34070450 0x7f5d3415ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.217+0000 7f5d33400640 1 -- 172.21.15.6:0/654282087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d340c5d00 con 0x7f5d3415c170 2024-09-10T20:56:32.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.217+0000 7f5d33400640 1 --2- 172.21.15.6:0/654282087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d3415c170 0x7f5d341f61a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c006010 tx=0x7f5d2c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:32.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.217+0000 7f5d2aa00640 1 -- 172.21.15.6:0/654282087 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c030750 con 0x7f5d3415c170 2024-09-10T20:56:32.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.217+0000 7f5d2aa00640 1 -- 172.21.15.6:0/654282087 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d2c0308f0 con 0x7f5d3415c170 2024-09-10T20:56:32.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.217+0000 7f5d2aa00640 1 -- 172.21.15.6:0/654282087 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c030d00 con 0x7f5d3415c170 2024-09-10T20:56:32.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.217+0000 7f5d39c00640 1 -- 172.21.15.6:0/654282087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d340c38f0 con 0x7f5d3415c170 2024-09-10T20:56:32.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.218+0000 7f5d39c00640 1 -- 172.21.15.6:0/654282087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d340c6280 con 0x7f5d3415c170 2024-09-10T20:56:32.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.219+0000 7f5d39c00640 1 -- 172.21.15.6:0/654282087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d340b5340 con 0x7f5d3415c170 2024-09-10T20:56:32.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.220+0000 7f5d2aa00640 1 -- 172.21.15.6:0/654282087 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5d2c032440 con 0x7f5d3415c170 2024-09-10T20:56:32.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.220+0000 7f5d2aa00640 1 --2- 172.21.15.6:0/654282087 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5d14077f70 0x7f5d1407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:32.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.221+0000 7f5d2aa00640 1 -- 172.21.15.6:0/654282087 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7f5d2c0bac10 con 0x7f5d3415c170 2024-09-10T20:56:32.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.221+0000 7f5d32a00640 1 --2- 172.21.15.6:0/654282087 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5d14077f70 0x7f5d1407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:32.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.222+0000 7f5d32a00640 1 --2- 172.21.15.6:0/654282087 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5d14077f70 0x7f5d1407a430 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5d24001950 tx=0x7f5d24009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:32.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.225+0000 7f5d2aa00640 1 -- 172.21.15.6:0/654282087 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5d2c040030 con 0x7f5d3415c170 2024-09-10T20:56:32.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.492+0000 7f5d39c00640 1 -- 172.21.15.6:0/654282087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f5d340c6450 con 0x7f5d3415c170 2024-09-10T20:56:32.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.494+0000 7f5d2aa00640 1 -- 172.21.15.6:0/654282087 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f5d2c083400 con 0x7f5d3415c170 2024-09-10T20:56:32.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.497+0000 7f5d39c00640 1 -- 172.21.15.6:0/654282087 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5d14077f70 msgr2=0x7f5d1407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:32.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.497+0000 7f5d39c00640 1 --2- 172.21.15.6:0/654282087 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5d14077f70 0x7f5d1407a430 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5d24001950 tx=0x7f5d24009040 comp rx=0 tx=0).stop 2024-09-10T20:56:32.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.497+0000 7f5d39c00640 1 -- 172.21.15.6:0/654282087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d3415c170 msgr2=0x7f5d341f61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:32.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.497+0000 7f5d39c00640 1 --2- 172.21.15.6:0/654282087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d3415c170 0x7f5d341f61a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c006010 tx=0x7f5d2c0045e0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.497+0000 7f5d39c00640 1 -- 172.21.15.6:0/654282087 shutdown_connections 2024-09-10T20:56:32.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.497+0000 7f5d39c00640 1 --2- 172.21.15.6:0/654282087 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5d14077f70 0x7f5d1407a430 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.497+0000 7f5d39c00640 1 --2- 172.21.15.6:0/654282087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d3415c170 0x7f5d341f61a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.497+0000 7f5d39c00640 1 --2- 172.21.15.6:0/654282087 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d34159670 0x7f5d341f5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.497+0000 7f5d39c00640 1 --2- 172.21.15.6:0/654282087 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d34070450 0x7f5d3415ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.497+0000 7f5d39c00640 1 -- 172.21.15.6:0/654282087 >> 172.21.15.6:0/654282087 conn(0x7f5d340cfa20 msgr2=0x7f5d34073320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:32.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.497+0000 7f5d39c00640 1 -- 172.21.15.6:0/654282087 shutdown_connections 2024-09-10T20:56:32.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.497+0000 7f5d39c00640 1 -- 172.21.15.6:0/654282087 wait complete. 2024-09-10T20:56:32.517 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-10T20:56:32.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.675+0000 7f5c59200640 1 -- 172.21.15.6:0/981289469 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c54159670 msgr2=0x7f5c540743b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:32.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.675+0000 7f5c59200640 1 --2- 172.21.15.6:0/981289469 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c54159670 0x7f5c540743b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5c44005fd0 tx=0x7f5c4402a540 comp rx=0 tx=0).stop 2024-09-10T20:56:32.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.675+0000 7f5c59200640 1 -- 172.21.15.6:0/981289469 shutdown_connections 2024-09-10T20:56:32.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.675+0000 7f5c59200640 1 --2- 172.21.15.6:0/981289469 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c54070450 0x7f5c540cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.675+0000 7f5c59200640 1 --2- 172.21.15.6:0/981289469 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c54159670 0x7f5c540743b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.675+0000 7f5c59200640 1 -- 172.21.15.6:0/981289469 >> 172.21.15.6:0/981289469 conn(0x7f5c540cfa20 msgr2=0x7f5c540cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:32.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.675+0000 7f5c59200640 1 -- 172.21.15.6:0/981289469 shutdown_connections 2024-09-10T20:56:32.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.675+0000 7f5c59200640 1 -- 172.21.15.6:0/981289469 wait complete. 2024-09-10T20:56:32.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.676+0000 7f5c59200640 1 Processor -- start 2024-09-10T20:56:32.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.676+0000 7f5c59200640 1 -- start start 2024-09-10T20:56:32.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.677+0000 7f5c59200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c54070450 0x7f5c540c9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:32.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.677+0000 7f5c59200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c54159670 0x7f5c5414ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:32.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.677+0000 7f5c59200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c5415c170 0x7f5c540c7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:32.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.677+0000 7f5c59200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5c540b4ca0 con 0x7f5c54159670 2024-09-10T20:56:32.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.677+0000 7f5c59200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5c540b4b20 con 0x7f5c54070450 2024-09-10T20:56:32.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.677+0000 7f5c59200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f5c540b4e20 con 0x7f5c5415c170 2024-09-10T20:56:32.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.678+0000 7f5c49400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c54159670 0x7f5c5414ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:32.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.678+0000 7f5c49400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c54159670 0x7f5c5414ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58950/0 (socket says 172.21.15.6:58950) 2024-09-10T20:56:32.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.678+0000 7f5c49400640 1 -- 172.21.15.6:0/1743463727 learned_addr learned my addr 172.21.15.6:0/1743463727 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:32.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.678+0000 7f5c51e00640 1 --2- 172.21.15.6:0/1743463727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c54070450 0x7f5c540c9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:32.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.678+0000 7f5c52800640 1 --2- 172.21.15.6:0/1743463727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c5415c170 0x7f5c540c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:32.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.678+0000 7f5c49400640 1 -- 172.21.15.6:0/1743463727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c5415c170 msgr2=0x7f5c540c7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:32.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.678+0000 7f5c49400640 1 --2- 172.21.15.6:0/1743463727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c5415c170 0x7f5c540c7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.678+0000 7f5c49400640 1 -- 172.21.15.6:0/1743463727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c54070450 msgr2=0x7f5c540c9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:32.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.678+0000 7f5c49400640 1 --2- 172.21.15.6:0/1743463727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c54070450 0x7f5c540c9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.678+0000 7f5c49400640 1 -- 172.21.15.6:0/1743463727 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c540afff0 con 0x7f5c54159670 2024-09-10T20:56:32.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.679+0000 7f5c49400640 1 --2- 172.21.15.6:0/1743463727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c54159670 0x7f5c5414ce20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c00c4d0 tx=0x7f5c3c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:32.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.679+0000 7f5c4aa00640 1 -- 172.21.15.6:0/1743463727 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c0052d0 con 0x7f5c54159670 2024-09-10T20:56:32.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.679+0000 7f5c4aa00640 1 -- 172.21.15.6:0/1743463727 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c3c005470 con 0x7f5c54159670 2024-09-10T20:56:32.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.679+0000 7f5c59200640 1 -- 172.21.15.6:0/1743463727 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c540b02d0 con 0x7f5c54159670 2024-09-10T20:56:32.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.679+0000 7f5c4aa00640 1 -- 172.21.15.6:0/1743463727 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c012870 con 0x7f5c54159670 2024-09-10T20:56:32.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.679+0000 7f5c59200640 1 -- 172.21.15.6:0/1743463727 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c540b0890 con 0x7f5c54159670 2024-09-10T20:56:32.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.680+0000 7f5c59200640 1 -- 172.21.15.6:0/1743463727 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c5406a150 con 0x7f5c54159670 2024-09-10T20:56:32.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.681+0000 7f5c4aa00640 1 -- 172.21.15.6:0/1743463727 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5c3c0035f0 con 0x7f5c54159670 2024-09-10T20:56:32.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.682+0000 7f5c4aa00640 1 --2- 172.21.15.6:0/1743463727 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5c30077f70 0x7f5c3007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:32.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.682+0000 7f5c4aa00640 1 -- 172.21.15.6:0/1743463727 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7f5c3c0993f0 con 0x7f5c54159670 2024-09-10T20:56:32.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.683+0000 7f5c51e00640 1 --2- 172.21.15.6:0/1743463727 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5c30077f70 0x7f5c3007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:32.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.683+0000 7f5c51e00640 1 --2- 172.21.15.6:0/1743463727 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5c30077f70 0x7f5c3007a430 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5c44033000 tx=0x7f5c44004730 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:32.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.686+0000 7f5c4aa00640 1 -- 172.21.15.6:0/1743463727 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5c5406a150 con 0x7f5c54159670 2024-09-10T20:56:32.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.952+0000 7f5c59200640 1 -- 172.21.15.6:0/1743463727 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f5c54070e70 con 0x7f5c54159670 2024-09-10T20:56:32.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.955+0000 7f5c4aa00640 1 -- 172.21.15.6:0/1743463727 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f5c54070e70 con 0x7f5c54159670 2024-09-10T20:56:32.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.957+0000 7f5c59200640 1 -- 172.21.15.6:0/1743463727 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5c30077f70 msgr2=0x7f5c3007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:32.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.957+0000 7f5c59200640 1 --2- 172.21.15.6:0/1743463727 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5c30077f70 0x7f5c3007a430 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5c44033000 tx=0x7f5c44004730 comp rx=0 tx=0).stop 2024-09-10T20:56:32.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.957+0000 7f5c59200640 1 -- 172.21.15.6:0/1743463727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c54159670 msgr2=0x7f5c5414ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:32.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.957+0000 7f5c59200640 1 --2- 172.21.15.6:0/1743463727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c54159670 0x7f5c5414ce20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c00c4d0 tx=0x7f5c3c00c990 comp rx=0 tx=0).stop 2024-09-10T20:56:32.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.957+0000 7f5c59200640 1 -- 172.21.15.6:0/1743463727 shutdown_connections 2024-09-10T20:56:32.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.957+0000 7f5c59200640 1 --2- 172.21.15.6:0/1743463727 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5c30077f70 0x7f5c3007a430 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.957+0000 7f5c59200640 1 --2- 172.21.15.6:0/1743463727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c54159670 0x7f5c5414ce20 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.957+0000 7f5c59200640 1 --2- 172.21.15.6:0/1743463727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c5415c170 0x7f5c540c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.957+0000 7f5c59200640 1 --2- 172.21.15.6:0/1743463727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c54070450 0x7f5c540c9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.957+0000 7f5c59200640 1 -- 172.21.15.6:0/1743463727 >> 172.21.15.6:0/1743463727 conn(0x7f5c540cfa20 msgr2=0x7f5c540b28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:32.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.957+0000 7f5c59200640 1 -- 172.21.15.6:0/1743463727 shutdown_connections 2024-09-10T20:56:32.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:32.957+0000 7f5c59200640 1 -- 172.21.15.6:0/1743463727 wait complete. 2024-09-10T20:56:32.978 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-10T20:56:33.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.137+0000 7f26a2800640 1 -- 172.21.15.6:0/3137233686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f269c070450 msgr2=0x7f269c0cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:33.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.137+0000 7f26a2800640 1 --2- 172.21.15.6:0/3137233686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f269c070450 0x7f269c0cd920 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2694005fd0 tx=0x7f269402aa10 comp rx=0 tx=0).stop 2024-09-10T20:56:33.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.137+0000 7f26a2800640 1 -- 172.21.15.6:0/3137233686 shutdown_connections 2024-09-10T20:56:33.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.137+0000 7f26a2800640 1 --2- 172.21.15.6:0/3137233686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f269c070450 0x7f269c0cd920 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:33.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.137+0000 7f26a2800640 1 --2- 172.21.15.6:0/3137233686 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f269c15c170 0x7f269c0743b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:33.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.137+0000 7f26a2800640 1 -- 172.21.15.6:0/3137233686 >> 172.21.15.6:0/3137233686 conn(0x7f269c0cfa20 msgr2=0x7f269c0cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:33.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.137+0000 7f26a2800640 1 -- 172.21.15.6:0/3137233686 shutdown_connections 2024-09-10T20:56:33.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.137+0000 7f26a2800640 1 -- 172.21.15.6:0/3137233686 wait complete. 2024-09-10T20:56:33.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.139+0000 7f26a2800640 1 Processor -- start 2024-09-10T20:56:33.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.139+0000 7f26a2800640 1 -- start start 2024-09-10T20:56:33.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.140+0000 7f26a2800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f269c070450 0x7f269c14a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:33.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.140+0000 7f26a2800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f269c159670 0x7f269c0c52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:33.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.140+0000 7f26a2800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f269c15c170 0x7f269c0c36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:33.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.140+0000 7f26a2800640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f269c0b4ca0 con 0x7f269c15c170 2024-09-10T20:56:33.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.140+0000 7f26a2800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f269c0b4b20 con 0x7f269c159670 2024-09-10T20:56:33.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.140+0000 7f26a2800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f269c0b4e20 con 0x7f269c070450 2024-09-10T20:56:33.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.140+0000 7f269be00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f269c15c170 0x7f269c0c36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:33.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.140+0000 7f269be00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f269c15c170 0x7f269c0c36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58972/0 (socket says 172.21.15.6:58972) 2024-09-10T20:56:33.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.140+0000 7f269be00640 1 -- 172.21.15.6:0/1716877011 learned_addr learned my addr 172.21.15.6:0/1716877011 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:33.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.140+0000 7f269b400640 1 --2- 172.21.15.6:0/1716877011 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f269c070450 0x7f269c14a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:33.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.140+0000 7f2692a00640 1 --2- 172.21.15.6:0/1716877011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f269c159670 0x7f269c0c52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:33.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.141+0000 7f269be00640 1 -- 172.21.15.6:0/1716877011 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f269c070450 msgr2=0x7f269c14a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:33.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.141+0000 7f269be00640 1 --2- 172.21.15.6:0/1716877011 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f269c070450 0x7f269c14a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:33.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.141+0000 7f269be00640 1 -- 172.21.15.6:0/1716877011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f269c159670 msgr2=0x7f269c0c52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:33.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.141+0000 7f269be00640 1 --2- 172.21.15.6:0/1716877011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f269c159670 0x7f269c0c52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:33.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.141+0000 7f269be00640 1 -- 172.21.15.6:0/1716877011 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f269c1f84c0 con 0x7f269c15c170 2024-09-10T20:56:33.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.141+0000 7f269be00640 1 --2- 172.21.15.6:0/1716877011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f269c15c170 0x7f269c0c36e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2694009d90 tx=0x7f2694003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:33.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.141+0000 7f2693e00640 1 -- 172.21.15.6:0/1716877011 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2694033050 con 0x7f269c15c170 2024-09-10T20:56:33.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.141+0000 7f2693e00640 1 -- 172.21.15.6:0/1716877011 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2694004450 con 0x7f269c15c170 2024-09-10T20:56:33.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.141+0000 7f2693e00640 1 -- 172.21.15.6:0/1716877011 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2694004860 con 0x7f269c15c170 2024-09-10T20:56:33.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.141+0000 7f26a2800640 1 -- 172.21.15.6:0/1716877011 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f269c1f87a0 con 0x7f269c15c170 2024-09-10T20:56:33.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.142+0000 7f26a2800640 1 -- 172.21.15.6:0/1716877011 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f269c1f8d60 con 0x7f269c15c170 2024-09-10T20:56:33.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.143+0000 7f26a2800640 1 -- 172.21.15.6:0/1716877011 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f269c06a150 con 0x7f269c15c170 2024-09-10T20:56:33.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.144+0000 7f2693e00640 1 -- 172.21.15.6:0/1716877011 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2694040070 con 0x7f269c15c170 2024-09-10T20:56:33.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.145+0000 7f2693e00640 1 --2- 172.21.15.6:0/1716877011 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2678077f70 0x7f267807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:33.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.145+0000 7f2693e00640 1 -- 172.21.15.6:0/1716877011 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7f26940bab20 con 0x7f269c15c170 2024-09-10T20:56:33.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.145+0000 7f269b400640 1 --2- 172.21.15.6:0/1716877011 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2678077f70 0x7f267807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:33.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.146+0000 7f269b400640 1 --2- 172.21.15.6:0/1716877011 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2678077f70 0x7f267807a430 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f268c0017c0 tx=0x7f268c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:33.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.149+0000 7f2693e00640 1 -- 172.21.15.6:0/1716877011 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f269c06a150 con 0x7f269c15c170 2024-09-10T20:56:33.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.417+0000 7f26a2800640 1 -- 172.21.15.6:0/1716877011 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f269c0b5340 con 0x7f269c15c170 2024-09-10T20:56:33.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.419+0000 7f2693e00640 1 -- 172.21.15.6:0/1716877011 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f2694083310 con 0x7f269c15c170 2024-09-10T20:56:33.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.422+0000 7f26a2800640 1 -- 172.21.15.6:0/1716877011 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2678077f70 msgr2=0x7f267807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:33.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.422+0000 7f26a2800640 1 --2- 172.21.15.6:0/1716877011 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2678077f70 0x7f267807a430 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f268c0017c0 tx=0x7f268c009040 comp rx=0 tx=0).stop 2024-09-10T20:56:33.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.422+0000 7f26a2800640 1 -- 172.21.15.6:0/1716877011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f269c15c170 msgr2=0x7f269c0c36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:33.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.422+0000 7f26a2800640 1 --2- 172.21.15.6:0/1716877011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f269c15c170 0x7f269c0c36e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2694009d90 tx=0x7f2694003f10 comp rx=0 tx=0).stop 2024-09-10T20:56:33.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.422+0000 7f26a2800640 1 -- 172.21.15.6:0/1716877011 shutdown_connections 2024-09-10T20:56:33.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.422+0000 7f26a2800640 1 --2- 172.21.15.6:0/1716877011 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2678077f70 0x7f267807a430 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:33.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.422+0000 7f26a2800640 1 --2- 172.21.15.6:0/1716877011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f269c15c170 0x7f269c0c36e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:33.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.422+0000 7f26a2800640 1 --2- 172.21.15.6:0/1716877011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f269c159670 0x7f269c0c52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:33.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.422+0000 7f26a2800640 1 --2- 172.21.15.6:0/1716877011 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f269c070450 0x7f269c14a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:33.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.422+0000 7f26a2800640 1 -- 172.21.15.6:0/1716877011 >> 172.21.15.6:0/1716877011 conn(0x7f269c0cfa20 msgr2=0x7f269c0b41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:33.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.422+0000 7f26a2800640 1 -- 172.21.15.6:0/1716877011 shutdown_connections 2024-09-10T20:56:33.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.422+0000 7f26a2800640 1 -- 172.21.15.6:0/1716877011 wait complete. 2024-09-10T20:56:33.442 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-10T20:56:33.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.599+0000 7f34f1a00640 1 -- 172.21.15.6:0/517642136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34ec159670 msgr2=0x7f34ec0743b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:33.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.599+0000 7f34f1a00640 1 --2- 172.21.15.6:0/517642136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34ec159670 0x7f34ec0743b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f34ec051860 tx=0x7f34dc02a4a0 comp rx=0 tx=0).stop 2024-09-10T20:56:33.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.599+0000 7f34f1a00640 1 -- 172.21.15.6:0/517642136 shutdown_connections 2024-09-10T20:56:33.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.599+0000 7f34f1a00640 1 --2- 172.21.15.6:0/517642136 >> v2:172.21.15.150:3300/0 conn(0x7f34ec15c170 0x7f34ec0cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:33.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.599+0000 7f34f1a00640 1 --2- 172.21.15.6:0/517642136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34ec159670 0x7f34ec0743b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:33.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.599+0000 7f34f1a00640 1 -- 172.21.15.6:0/517642136 >> 172.21.15.6:0/517642136 conn(0x7f34ec0cfa20 msgr2=0x7f34ec0cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:33.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.599+0000 7f34f1a00640 1 -- 172.21.15.6:0/517642136 shutdown_connections 2024-09-10T20:56:33.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.599+0000 7f34f1a00640 1 -- 172.21.15.6:0/517642136 wait complete. 2024-09-10T20:56:33.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.601+0000 7f34f1a00640 1 Processor -- start 2024-09-10T20:56:33.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.601+0000 7f34f1a00640 1 -- start start 2024-09-10T20:56:33.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.602+0000 7f34f1a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34ec06fd40 0x7f34ec14f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:33.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.602+0000 7f34f1a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34ec159670 0x7f34ec0b4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:33.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.602+0000 7f34f1a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34ec15c170 0x7f34ec158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:33.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.602+0000 7f34f1a00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f34ec0b4a90 con 0x7f34ec15c170 2024-09-10T20:56:33.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.602+0000 7f34f1a00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f34ec0b4910 con 0x7f34ec06fd40 2024-09-10T20:56:33.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.602+0000 7f34f1a00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f34ec0b4c10 con 0x7f34ec159670 2024-09-10T20:56:33.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.602+0000 7f34eb400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34ec15c170 0x7f34ec158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:33.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.602+0000 7f34e2000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34ec159670 0x7f34ec0b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:33.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.602+0000 7f34eb400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34ec15c170 0x7f34ec158030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58988/0 (socket says 172.21.15.6:58988) 2024-09-10T20:56:33.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.602+0000 7f34eaa00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34ec06fd40 0x7f34ec14f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:33.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.602+0000 7f34eb400640 1 -- 172.21.15.6:0/1801481735 learned_addr learned my addr 172.21.15.6:0/1801481735 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:33.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.602+0000 7f34eb400640 1 -- 172.21.15.6:0/1801481735 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34ec159670 msgr2=0x7f34ec0b4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:33.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.602+0000 7f34eb400640 1 --2- 172.21.15.6:0/1801481735 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34ec159670 0x7f34ec0b4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:33.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.603+0000 7f34eb400640 1 -- 172.21.15.6:0/1801481735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34ec06fd40 msgr2=0x7f34ec14f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:33.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.603+0000 7f34eb400640 1 --2- 172.21.15.6:0/1801481735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34ec06fd40 0x7f34ec14f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:33.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.603+0000 7f34eb400640 1 -- 172.21.15.6:0/1801481735 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34ec156f90 con 0x7f34ec15c170 2024-09-10T20:56:33.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.603+0000 7f34eb400640 1 --2- 172.21.15.6:0/1801481735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34ec15c170 0x7f34ec158030 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f34e400b970 tx=0x7f34e400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:33.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.603+0000 7f34e3400640 1 -- 172.21.15.6:0/1801481735 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34e4019070 con 0x7f34ec15c170 2024-09-10T20:56:33.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.603+0000 7f34e3400640 1 -- 172.21.15.6:0/1801481735 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f34e400cc30 con 0x7f34ec15c170 2024-09-10T20:56:33.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.603+0000 7f34e3400640 1 -- 172.21.15.6:0/1801481735 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34e400ce60 con 0x7f34ec15c170 2024-09-10T20:56:33.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.603+0000 7f34f1a00640 1 -- 172.21.15.6:0/1801481735 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34ec157270 con 0x7f34ec15c170 2024-09-10T20:56:33.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.603+0000 7f34f1a00640 1 -- 172.21.15.6:0/1801481735 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34ec157830 con 0x7f34ec15c170 2024-09-10T20:56:33.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.604+0000 7f34f1a00640 1 -- 172.21.15.6:0/1801481735 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34ec0b5100 con 0x7f34ec15c170 2024-09-10T20:56:33.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.605+0000 7f34e3400640 1 -- 172.21.15.6:0/1801481735 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f34e401e440 con 0x7f34ec15c170 2024-09-10T20:56:33.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.606+0000 7f34e3400640 1 --2- 172.21.15.6:0/1801481735 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f34c8077f70 0x7f34c807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:33.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.606+0000 7f34e3400640 1 -- 172.21.15.6:0/1801481735 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7f34e4099920 con 0x7f34ec15c170 2024-09-10T20:56:33.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.607+0000 7f34eaa00640 1 --2- 172.21.15.6:0/1801481735 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f34c8077f70 0x7f34c807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:33.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.608+0000 7f34eaa00640 1 --2- 172.21.15.6:0/1801481735 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f34c8077f70 0x7f34c807a430 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f34dc033000 tx=0x7f34dc004730 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:33.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.611+0000 7f34e3400640 1 -- 172.21.15.6:0/1801481735 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f34e4062080 con 0x7f34ec15c170 2024-09-10T20:56:33.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.876+0000 7f34f1a00640 1 -- 172.21.15.6:0/1801481735 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f34ec069d20 con 0x7f34ec15c170 2024-09-10T20:56:33.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.878+0000 7f34e3400640 1 -- 172.21.15.6:0/1801481735 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) ==== 97+0+0 (secure 0 0 0) 0x7f34e4066ab0 con 0x7f34ec15c170 2024-09-10T20:56:33.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.881+0000 7f34f1a00640 1 -- 172.21.15.6:0/1801481735 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f34c8077f70 msgr2=0x7f34c807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:33.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.881+0000 7f34f1a00640 1 --2- 172.21.15.6:0/1801481735 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f34c8077f70 0x7f34c807a430 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f34dc033000 tx=0x7f34dc004730 comp rx=0 tx=0).stop 2024-09-10T20:56:33.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.881+0000 7f34f1a00640 1 -- 172.21.15.6:0/1801481735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34ec15c170 msgr2=0x7f34ec158030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:33.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.881+0000 7f34f1a00640 1 --2- 172.21.15.6:0/1801481735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34ec15c170 0x7f34ec158030 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f34e400b970 tx=0x7f34e400be30 comp rx=0 tx=0).stop 2024-09-10T20:56:33.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.881+0000 7f34f1a00640 1 -- 172.21.15.6:0/1801481735 shutdown_connections 2024-09-10T20:56:33.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.881+0000 7f34f1a00640 1 --2- 172.21.15.6:0/1801481735 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f34c8077f70 0x7f34c807a430 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:33.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.881+0000 7f34f1a00640 1 --2- 172.21.15.6:0/1801481735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34ec15c170 0x7f34ec158030 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:33.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.881+0000 7f34f1a00640 1 --2- 172.21.15.6:0/1801481735 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34ec159670 0x7f34ec0b4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:33.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.881+0000 7f34f1a00640 1 --2- 172.21.15.6:0/1801481735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34ec06fd40 0x7f34ec14f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:33.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.881+0000 7f34f1a00640 1 -- 172.21.15.6:0/1801481735 >> 172.21.15.6:0/1801481735 conn(0x7f34ec0cfa20 msgr2=0x7f34ec15ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:33.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.881+0000 7f34f1a00640 1 -- 172.21.15.6:0/1801481735 shutdown_connections 2024-09-10T20:56:33.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:33.881+0000 7f34f1a00640 1 -- 172.21.15.6:0/1801481735 wait complete. 2024-09-10T20:56:33.900 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-10T20:56:34.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.058+0000 7f3ef0e00640 1 -- 172.21.15.6:0/2247749632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3eec0cf7a0 msgr2=0x7f3eec1619c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:34.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.058+0000 7f3ef0e00640 1 --2- 172.21.15.6:0/2247749632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3eec0cf7a0 0x7f3eec1619c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3eec08e200 tx=0x7f3ee402a560 comp rx=0 tx=0).stop 2024-09-10T20:56:34.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.058+0000 7f3ef0e00640 1 -- 172.21.15.6:0/2247749632 shutdown_connections 2024-09-10T20:56:34.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.058+0000 7f3ef0e00640 1 --2- 172.21.15.6:0/2247749632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3eec0cf7a0 0x7f3eec1619c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:34.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.058+0000 7f3ef0e00640 1 --2- 172.21.15.6:0/2247749632 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3eec15e090 0x7f3eec0d4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:34.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.058+0000 7f3ef0e00640 1 --2- 172.21.15.6:0/2247749632 >> v2:172.21.15.150:3300/0 conn(0x7f3eec15dcb0 0x7f3eec0d0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:34.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.058+0000 7f3ef0e00640 1 -- 172.21.15.6:0/2247749632 >> 172.21.15.6:0/2247749632 conn(0x7f3eec09d100 msgr2=0x7f3eec0d3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:34.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.058+0000 7f3ef0e00640 1 -- 172.21.15.6:0/2247749632 shutdown_connections 2024-09-10T20:56:34.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.058+0000 7f3ef0e00640 1 -- 172.21.15.6:0/2247749632 wait complete. 2024-09-10T20:56:34.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.059+0000 7f3ef0e00640 1 Processor -- start 2024-09-10T20:56:34.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.060+0000 7f3ef0e00640 1 -- start start 2024-09-10T20:56:34.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.061+0000 7f3ef0e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3eec0cf7a0 0x7f3eec0c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:34.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.061+0000 7f3ef0e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3eec15dcb0 0x7f3eec15e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:34.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.061+0000 7f3ef0e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3eec15e090 0x7f3eec15eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:34.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.061+0000 7f3ef0e00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3eec162290 con 0x7f3eec0cf7a0 2024-09-10T20:56:34.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.061+0000 7f3ef0e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3eec162110 con 0x7f3eec15dcb0 2024-09-10T20:56:34.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.061+0000 7f3ef0e00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3eec0b6c40 con 0x7f3eec15e090 2024-09-10T20:56:34.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.061+0000 7f3eeb400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3eec0cf7a0 0x7f3eec0c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:34.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.061+0000 7f3eeb400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3eec0cf7a0 0x7f3eec0c8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58998/0 (socket says 172.21.15.6:58998) 2024-09-10T20:56:34.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.061+0000 7f3eeb400640 1 -- 172.21.15.6:0/1314024026 learned_addr learned my addr 172.21.15.6:0/1314024026 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:34.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.061+0000 7f3eebe00640 1 --2- 172.21.15.6:0/1314024026 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3eec15e090 0x7f3eec15eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:34.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.061+0000 7f3ee2a00640 1 --2- 172.21.15.6:0/1314024026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3eec15dcb0 0x7f3eec15e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:34.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.061+0000 7f3eeb400640 1 -- 172.21.15.6:0/1314024026 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3eec15e090 msgr2=0x7f3eec15eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:34.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.061+0000 7f3eeb400640 1 --2- 172.21.15.6:0/1314024026 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3eec15e090 0x7f3eec15eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:34.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.061+0000 7f3eeb400640 1 -- 172.21.15.6:0/1314024026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3eec15dcb0 msgr2=0x7f3eec15e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:34.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.061+0000 7f3eeb400640 1 --2- 172.21.15.6:0/1314024026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3eec15dcb0 0x7f3eec15e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:34.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.061+0000 7f3eeb400640 1 -- 172.21.15.6:0/1314024026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eec0ca740 con 0x7f3eec0cf7a0 2024-09-10T20:56:34.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.062+0000 7f3eeb400640 1 --2- 172.21.15.6:0/1314024026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3eec0cf7a0 0x7f3eec0c8ee0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3edc00dbb0 tx=0x7f3edc00b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:34.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.062+0000 7f3ee3e00640 1 -- 172.21.15.6:0/1314024026 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3edc017070 con 0x7f3eec0cf7a0 2024-09-10T20:56:34.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.062+0000 7f3ee3e00640 1 -- 172.21.15.6:0/1314024026 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3edc003c60 con 0x7f3eec0cf7a0 2024-09-10T20:56:34.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.062+0000 7f3ee3e00640 1 -- 172.21.15.6:0/1314024026 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3edc00be60 con 0x7f3eec0cf7a0 2024-09-10T20:56:34.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.062+0000 7f3ef0e00640 1 -- 172.21.15.6:0/1314024026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3eec0c8440 con 0x7f3eec0cf7a0 2024-09-10T20:56:34.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.062+0000 7f3ef0e00640 1 -- 172.21.15.6:0/1314024026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3eec0c86e0 con 0x7f3eec0cf7a0 2024-09-10T20:56:34.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.063+0000 7f3ef0e00640 1 -- 172.21.15.6:0/1314024026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3eec0d0f60 con 0x7f3eec0cf7a0 2024-09-10T20:56:34.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.064+0000 7f3ee3e00640 1 -- 172.21.15.6:0/1314024026 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3edc004280 con 0x7f3eec0cf7a0 2024-09-10T20:56:34.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.065+0000 7f3ee3e00640 1 --2- 172.21.15.6:0/1314024026 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3ec8077f70 0x7f3ec807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:34.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.065+0000 7f3ee3e00640 1 -- 172.21.15.6:0/1314024026 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7f3edc09a1e0 con 0x7f3eec0cf7a0 2024-09-10T20:56:34.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.066+0000 7f3ee2a00640 1 --2- 172.21.15.6:0/1314024026 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3ec8077f70 0x7f3ec807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:34.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.066+0000 7f3ee2a00640 1 --2- 172.21.15.6:0/1314024026 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3ec8077f70 0x7f3ec807a430 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4005fd0 tx=0x7f3ed400d490 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:34.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.069+0000 7f3ee3e00640 1 -- 172.21.15.6:0/1314024026 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f3edc020030 con 0x7f3eec0cf7a0 2024-09-10T20:56:34.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.336+0000 7f3ef0e00640 1 -- 172.21.15.6:0/1314024026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f3eec15e770 con 0x7f3eec0cf7a0 2024-09-10T20:56:34.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.340+0000 7f3ee3e00640 1 -- 172.21.15.6:0/1314024026 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f3edc063020 con 0x7f3eec0cf7a0 2024-09-10T20:56:34.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.343+0000 7f3ef0e00640 1 -- 172.21.15.6:0/1314024026 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3ec8077f70 msgr2=0x7f3ec807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:34.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.343+0000 7f3ef0e00640 1 --2- 172.21.15.6:0/1314024026 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3ec8077f70 0x7f3ec807a430 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4005fd0 tx=0x7f3ed400d490 comp rx=0 tx=0).stop 2024-09-10T20:56:34.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.343+0000 7f3ef0e00640 1 -- 172.21.15.6:0/1314024026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3eec0cf7a0 msgr2=0x7f3eec0c8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:34.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.343+0000 7f3ef0e00640 1 --2- 172.21.15.6:0/1314024026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3eec0cf7a0 0x7f3eec0c8ee0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3edc00dbb0 tx=0x7f3edc00b630 comp rx=0 tx=0).stop 2024-09-10T20:56:34.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.343+0000 7f3ef0e00640 1 -- 172.21.15.6:0/1314024026 shutdown_connections 2024-09-10T20:56:34.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.343+0000 7f3ef0e00640 1 --2- 172.21.15.6:0/1314024026 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3ec8077f70 0x7f3ec807a430 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:34.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.343+0000 7f3ef0e00640 1 --2- 172.21.15.6:0/1314024026 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3eec15e090 0x7f3eec15eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:34.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.343+0000 7f3ef0e00640 1 --2- 172.21.15.6:0/1314024026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3eec15dcb0 0x7f3eec15e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:34.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.343+0000 7f3ef0e00640 1 --2- 172.21.15.6:0/1314024026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3eec0cf7a0 0x7f3eec0c8ee0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:34.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.343+0000 7f3ef0e00640 1 -- 172.21.15.6:0/1314024026 >> 172.21.15.6:0/1314024026 conn(0x7f3eec09d100 msgr2=0x7f3eec153aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:34.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.343+0000 7f3ef0e00640 1 -- 172.21.15.6:0/1314024026 shutdown_connections 2024-09-10T20:56:34.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.343+0000 7f3ef0e00640 1 -- 172.21.15.6:0/1314024026 wait complete. 2024-09-10T20:56:34.364 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T20:56:34.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.520+0000 7fd8edc00640 1 -- 172.21.15.6:0/1537247674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8e815bb30 msgr2=0x7fd8e80cf340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:34.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.520+0000 7fd8edc00640 1 --2- 172.21.15.6:0/1537247674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8e815bb30 0x7fd8e80cf340 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8005fd0 tx=0x7fd8d802a5d0 comp rx=0 tx=0).stop 2024-09-10T20:56:34.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.520+0000 7fd8edc00640 1 -- 172.21.15.6:0/1537247674 shutdown_connections 2024-09-10T20:56:34.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.520+0000 7fd8edc00640 1 --2- 172.21.15.6:0/1537247674 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8e80caa40 0x7fd8e8161a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:34.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.520+0000 7fd8edc00640 1 --2- 172.21.15.6:0/1537247674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8e815bb30 0x7fd8e80cf340 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:34.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.520+0000 7fd8edc00640 1 -- 172.21.15.6:0/1537247674 >> 172.21.15.6:0/1537247674 conn(0x7fd8e80cfa20 msgr2=0x7fd8e80cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:34.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.520+0000 7fd8edc00640 1 -- 172.21.15.6:0/1537247674 shutdown_connections 2024-09-10T20:56:34.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.520+0000 7fd8edc00640 1 -- 172.21.15.6:0/1537247674 wait complete. 2024-09-10T20:56:34.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.522+0000 7fd8edc00640 1 Processor -- start 2024-09-10T20:56:34.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.522+0000 7fd8edc00640 1 -- start start 2024-09-10T20:56:34.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.523+0000 7fd8edc00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8e80caa40 0x7fd8e81f48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:34.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.523+0000 7fd8edc00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8e815bb30 0x7fd8e80b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:34.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.523+0000 7fd8edc00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8e8161f60 0x7fd8e8160870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:34.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.523+0000 7fd8edc00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e80cb000 con 0x7fd8e815bb30 2024-09-10T20:56:34.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.523+0000 7fd8edc00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e80aeaa0 con 0x7fd8e8161f60 2024-09-10T20:56:34.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.523+0000 7fd8edc00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd8e815eb40 con 0x7fd8e80caa40 2024-09-10T20:56:34.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.523+0000 7fd8de000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8e815bb30 0x7fd8e80b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:34.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.523+0000 7fd8de000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8e815bb30 0x7fd8e80b34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59014/0 (socket says 172.21.15.6:59014) 2024-09-10T20:56:34.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.523+0000 7fd8de000640 1 -- 172.21.15.6:0/1222538462 learned_addr learned my addr 172.21.15.6:0/1222538462 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:34.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.523+0000 7fd8e6a00640 1 --2- 172.21.15.6:0/1222538462 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8e80caa40 0x7fd8e81f48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:34.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.523+0000 7fd8e7400640 1 --2- 172.21.15.6:0/1222538462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8e8161f60 0x7fd8e8160870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:34.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.524+0000 7fd8de000640 1 -- 172.21.15.6:0/1222538462 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8e80caa40 msgr2=0x7fd8e81f48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:34.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.524+0000 7fd8de000640 1 --2- 172.21.15.6:0/1222538462 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8e80caa40 0x7fd8e81f48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:34.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.524+0000 7fd8de000640 1 -- 172.21.15.6:0/1222538462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8e8161f60 msgr2=0x7fd8e8160870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:34.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.524+0000 7fd8de000640 1 --2- 172.21.15.6:0/1222538462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8e8161f60 0x7fd8e8160870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:34.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.524+0000 7fd8de000640 1 -- 172.21.15.6:0/1222538462 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8e8159000 con 0x7fd8e815bb30 2024-09-10T20:56:34.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.524+0000 7fd8e7400640 1 --2- 172.21.15.6:0/1222538462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8e8161f60 0x7fd8e8160870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:56:34.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.524+0000 7fd8e6a00640 1 --2- 172.21.15.6:0/1222538462 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8e80caa40 0x7fd8e81f48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:56:34.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.524+0000 7fd8de000640 1 --2- 172.21.15.6:0/1222538462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8e815bb30 0x7fd8e80b34c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd8d000e9f0 tx=0x7fd8d000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:34.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.524+0000 7fd8df400640 1 -- 172.21.15.6:0/1222538462 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d000cd80 con 0x7fd8e815bb30 2024-09-10T20:56:34.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.524+0000 7fd8df400640 1 -- 172.21.15.6:0/1222538462 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd8d0004030 con 0x7fd8e815bb30 2024-09-10T20:56:34.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.524+0000 7fd8df400640 1 -- 172.21.15.6:0/1222538462 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d0004480 con 0x7fd8e815bb30 2024-09-10T20:56:34.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.524+0000 7fd8edc00640 1 -- 172.21.15.6:0/1222538462 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8e81592e0 con 0x7fd8e815bb30 2024-09-10T20:56:34.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.524+0000 7fd8edc00640 1 -- 172.21.15.6:0/1222538462 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8e8159b80 con 0x7fd8e815bb30 2024-09-10T20:56:34.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.525+0000 7fd8edc00640 1 -- 172.21.15.6:0/1222538462 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8e8069d20 con 0x7fd8e815bb30 2024-09-10T20:56:34.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.527+0000 7fd8df400640 1 -- 172.21.15.6:0/1222538462 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd8d00035f0 con 0x7fd8e815bb30 2024-09-10T20:56:34.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.528+0000 7fd8df400640 1 --2- 172.21.15.6:0/1222538462 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd8c4077f70 0x7fd8c407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:34.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.528+0000 7fd8df400640 1 -- 172.21.15.6:0/1222538462 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7fd8d009a610 con 0x7fd8e815bb30 2024-09-10T20:56:34.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.529+0000 7fd8e6a00640 1 --2- 172.21.15.6:0/1222538462 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd8c4077f70 0x7fd8c407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:34.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.529+0000 7fd8e6a00640 1 --2- 172.21.15.6:0/1222538462 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd8c4077f70 0x7fd8c407a430 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8033000 tx=0x7fd8d8004730 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:34.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.532+0000 7fd8df400640 1 -- 172.21.15.6:0/1222538462 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fd8d00633c0 con 0x7fd8e815bb30 2024-09-10T20:56:34.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.728+0000 7fd8edc00640 1 -- 172.21.15.6:0/1222538462 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fd8e80d0850 con 0x7fd8e815bb30 2024-09-10T20:56:34.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.729+0000 7fd8df400640 1 -- 172.21.15.6:0/1222538462 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v31) ==== 84+0+65 (secure 0 0 0) 0x7fd8d0062cc0 con 0x7fd8e815bb30 2024-09-10T20:56:34.733 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:56:34.733 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2024-09-10T20:56:34.733 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-10T20:56:34.733 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2024-09-10T20:56:34.733 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2024-09-10T20:56:34.733 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-10T20:56:34.734 INFO:teuthology.orchestra.run.smithi006.stdout:] 2024-09-10T20:56:34.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.731+0000 7fd8edc00640 1 -- 172.21.15.6:0/1222538462 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd8c4077f70 msgr2=0x7fd8c407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:34.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.731+0000 7fd8edc00640 1 --2- 172.21.15.6:0/1222538462 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd8c4077f70 0x7fd8c407a430 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8033000 tx=0x7fd8d8004730 comp rx=0 tx=0).stop 2024-09-10T20:56:34.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.731+0000 7fd8edc00640 1 -- 172.21.15.6:0/1222538462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8e815bb30 msgr2=0x7fd8e80b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:34.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.731+0000 7fd8edc00640 1 --2- 172.21.15.6:0/1222538462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8e815bb30 0x7fd8e80b34c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd8d000e9f0 tx=0x7fd8d000eeb0 comp rx=0 tx=0).stop 2024-09-10T20:56:34.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.731+0000 7fd8edc00640 1 -- 172.21.15.6:0/1222538462 shutdown_connections 2024-09-10T20:56:34.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.731+0000 7fd8edc00640 1 --2- 172.21.15.6:0/1222538462 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd8c4077f70 0x7fd8c407a430 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:34.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.731+0000 7fd8edc00640 1 --2- 172.21.15.6:0/1222538462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8e815bb30 0x7fd8e80b34c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:34.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.731+0000 7fd8edc00640 1 --2- 172.21.15.6:0/1222538462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8e8161f60 0x7fd8e8160870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:34.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.731+0000 7fd8edc00640 1 --2- 172.21.15.6:0/1222538462 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8e80caa40 0x7fd8e81f48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:34.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.731+0000 7fd8edc00640 1 -- 172.21.15.6:0/1222538462 >> 172.21.15.6:0/1222538462 conn(0x7fd8e80cfa20 msgr2=0x7fd8e8073440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:34.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.731+0000 7fd8edc00640 1 -- 172.21.15.6:0/1222538462 shutdown_connections 2024-09-10T20:56:34.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.731+0000 7fd8edc00640 1 -- 172.21.15.6:0/1222538462 wait complete. 2024-09-10T20:56:34.750 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T20:56:34.750 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T20:56:34.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.911+0000 7fbd3b200640 1 -- 172.21.15.6:0/2452547779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd3c1612f0 msgr2=0x7fbd3c0b6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:34.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.911+0000 7fbd3b200640 1 --2- 172.21.15.6:0/2452547779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd3c1612f0 0x7fbd3c0b6b40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c009830 tx=0x7fbd2c02a5a0 comp rx=0 tx=0).stop 2024-09-10T20:56:34.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.911+0000 7fbd3b200640 1 -- 172.21.15.6:0/2452547779 shutdown_connections 2024-09-10T20:56:34.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.911+0000 7fbd3b200640 1 --2- 172.21.15.6:0/2452547779 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd3c0b5270 0x7fbd3c0d21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:34.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.911+0000 7fbd3b200640 1 --2- 172.21.15.6:0/2452547779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd3c1612f0 0x7fbd3c0b6b40 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:34.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.911+0000 7fbd3b200640 1 -- 172.21.15.6:0/2452547779 >> 172.21.15.6:0/2452547779 conn(0x7fbd3c09cee0 msgr2=0x7fbd3c0d3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:34.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.911+0000 7fbd3b200640 1 -- 172.21.15.6:0/2452547779 shutdown_connections 2024-09-10T20:56:34.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.911+0000 7fbd3b200640 1 -- 172.21.15.6:0/2452547779 wait complete. 2024-09-10T20:56:34.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.913+0000 7fbd3b200640 1 Processor -- start 2024-09-10T20:56:34.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.913+0000 7fbd3b200640 1 -- start start 2024-09-10T20:56:34.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.914+0000 7fbd3b200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd3c0b5270 0x7fbd3c0ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:34.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.914+0000 7fbd3b200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd3c0d2710 0x7fbd3c0cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:34.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.914+0000 7fbd3b200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd3c1612f0 0x7fbd3c14d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:34.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.914+0000 7fbd3b200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3c0d2b80 con 0x7fbd3c1612f0 2024-09-10T20:56:34.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.914+0000 7fbd3b200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3c0b7190 con 0x7fbd3c0b5270 2024-09-10T20:56:34.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.914+0000 7fbd3b200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fbd3c0d2d00 con 0x7fbd3c0d2710 2024-09-10T20:56:34.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.914+0000 7fbd3a800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd3c1612f0 0x7fbd3c14d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:34.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.914+0000 7fbd3a800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd3c1612f0 0x7fbd3c14d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59032/0 (socket says 172.21.15.6:59032) 2024-09-10T20:56:34.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.914+0000 7fbd3a800640 1 -- 172.21.15.6:0/1379925553 learned_addr learned my addr 172.21.15.6:0/1379925553 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:34.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.915+0000 7fbd31400640 1 --2- 172.21.15.6:0/1379925553 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd3c0d2710 0x7fbd3c0cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:34.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.915+0000 7fbd39e00640 1 --2- 172.21.15.6:0/1379925553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd3c0b5270 0x7fbd3c0ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:34.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.915+0000 7fbd3a800640 1 -- 172.21.15.6:0/1379925553 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd3c0d2710 msgr2=0x7fbd3c0cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:34.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.915+0000 7fbd3a800640 1 --2- 172.21.15.6:0/1379925553 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd3c0d2710 0x7fbd3c0cc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:34.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.915+0000 7fbd3a800640 1 -- 172.21.15.6:0/1379925553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd3c0b5270 msgr2=0x7fbd3c0ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:34.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.915+0000 7fbd3a800640 1 --2- 172.21.15.6:0/1379925553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd3c0b5270 0x7fbd3c0ccb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:34.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.915+0000 7fbd3a800640 1 -- 172.21.15.6:0/1379925553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd3c14d660 con 0x7fbd3c1612f0 2024-09-10T20:56:34.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.915+0000 7fbd31400640 1 --2- 172.21.15.6:0/1379925553 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd3c0d2710 0x7fbd3c0cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:56:34.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.915+0000 7fbd3a800640 1 --2- 172.21.15.6:0/1379925553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd3c1612f0 0x7fbd3c14d120 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbd3400cbc0 tx=0x7fbd3400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:34.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.915+0000 7fbd32a00640 1 -- 172.21.15.6:0/1379925553 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd34016020 con 0x7fbd3c1612f0 2024-09-10T20:56:34.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.915+0000 7fbd32a00640 1 -- 172.21.15.6:0/1379925553 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd3400ad90 con 0x7fbd3c1612f0 2024-09-10T20:56:34.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.915+0000 7fbd32a00640 1 -- 172.21.15.6:0/1379925553 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd34012680 con 0x7fbd3c1612f0 2024-09-10T20:56:34.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.915+0000 7fbd3b200640 1 -- 172.21.15.6:0/1379925553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd3c15b7a0 con 0x7fbd3c1612f0 2024-09-10T20:56:34.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.916+0000 7fbd3b200640 1 -- 172.21.15.6:0/1379925553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd3c15bd60 con 0x7fbd3c1612f0 2024-09-10T20:56:34.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.917+0000 7fbd3b200640 1 -- 172.21.15.6:0/1379925553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd3c0b9c70 con 0x7fbd3c1612f0 2024-09-10T20:56:34.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.918+0000 7fbd32a00640 1 -- 172.21.15.6:0/1379925553 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fbd34012820 con 0x7fbd3c1612f0 2024-09-10T20:56:34.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.919+0000 7fbd32a00640 1 --2- 172.21.15.6:0/1379925553 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbd18077fa0 0x7fbd1807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:34.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.919+0000 7fbd32a00640 1 -- 172.21.15.6:0/1379925553 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7fbd3409a310 con 0x7fbd3c1612f0 2024-09-10T20:56:34.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.919+0000 7fbd39e00640 1 --2- 172.21.15.6:0/1379925553 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbd18077fa0 0x7fbd1807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:34.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.920+0000 7fbd39e00640 1 --2- 172.21.15.6:0/1379925553 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbd18077fa0 0x7fbd1807a460 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c034000 tx=0x7fbd2c004730 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:34.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:34.923+0000 7fbd32a00640 1 -- 172.21.15.6:0/1379925553 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fbd34020020 con 0x7fbd3c1612f0 2024-09-10T20:56:35.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:35.118+0000 7fbd3b200640 1 -- 172.21.15.6:0/1379925553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fbd3c06e290 con 0x7fbd3c1612f0 2024-09-10T20:56:36.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.115+0000 7fbd32a00640 1 -- 172.21.15.6:0/1379925553 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v32) ==== 138+0+0 (secure 0 0 0) 0x7fbd3c14d660 con 0x7fbd3c1612f0 2024-09-10T20:56:36.119 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2024-09-10T20:56:36.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.118+0000 7fbd3b200640 1 -- 172.21.15.6:0/1379925553 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbd18077fa0 msgr2=0x7fbd1807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:36.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.118+0000 7fbd3b200640 1 --2- 172.21.15.6:0/1379925553 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbd18077fa0 0x7fbd1807a460 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c034000 tx=0x7fbd2c004730 comp rx=0 tx=0).stop 2024-09-10T20:56:36.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.118+0000 7fbd3b200640 1 -- 172.21.15.6:0/1379925553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd3c1612f0 msgr2=0x7fbd3c14d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:36.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.118+0000 7fbd3b200640 1 --2- 172.21.15.6:0/1379925553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd3c1612f0 0x7fbd3c14d120 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbd3400cbc0 tx=0x7fbd3400a060 comp rx=0 tx=0).stop 2024-09-10T20:56:36.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.118+0000 7fbd3b200640 1 -- 172.21.15.6:0/1379925553 shutdown_connections 2024-09-10T20:56:36.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.118+0000 7fbd3b200640 1 --2- 172.21.15.6:0/1379925553 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbd18077fa0 0x7fbd1807a460 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:36.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.118+0000 7fbd3b200640 1 --2- 172.21.15.6:0/1379925553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd3c1612f0 0x7fbd3c14d120 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:36.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.118+0000 7fbd3b200640 1 --2- 172.21.15.6:0/1379925553 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd3c0d2710 0x7fbd3c0cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:36.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.118+0000 7fbd3b200640 1 --2- 172.21.15.6:0/1379925553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd3c0b5270 0x7fbd3c0ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:36.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.118+0000 7fbd3b200640 1 -- 172.21.15.6:0/1379925553 >> 172.21.15.6:0/1379925553 conn(0x7fbd3c09cee0 msgr2=0x7fbd3c161980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:36.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.119+0000 7fbd3b200640 1 -- 172.21.15.6:0/1379925553 shutdown_connections 2024-09-10T20:56:36.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.119+0000 7fbd3b200640 1 -- 172.21.15.6:0/1379925553 wait complete. 2024-09-10T20:56:36.148 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T20:56:36.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.317+0000 7fc42de00640 1 -- 172.21.15.6:0/269068373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc40c004800 msgr2=0x7fc40c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:36.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.317+0000 7fc42de00640 1 --2- 172.21.15.6:0/269068373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc40c004800 0x7fc40c004c80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc414009b20 tx=0x7fc40c005830 comp rx=0 tx=0).stop 2024-09-10T20:56:36.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.318+0000 7fc42de00640 1 -- 172.21.15.6:0/269068373 shutdown_connections 2024-09-10T20:56:36.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.318+0000 7fc42de00640 1 --2- 172.21.15.6:0/269068373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc40c004800 0x7fc40c004c80 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:36.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.318+0000 7fc42de00640 1 -- 172.21.15.6:0/269068373 >> 172.21.15.6:0/269068373 conn(0x7fc4280d0250 msgr2=0x7fc4280d0660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:36.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.318+0000 7fc42de00640 1 -- 172.21.15.6:0/269068373 shutdown_connections 2024-09-10T20:56:36.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.318+0000 7fc42de00640 1 -- 172.21.15.6:0/269068373 wait complete. 2024-09-10T20:56:36.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.319+0000 7fc42de00640 1 Processor -- start 2024-09-10T20:56:36.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.319+0000 7fc42de00640 1 -- start start 2024-09-10T20:56:36.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.320+0000 7fc42de00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc40c004800 0x7fc4280c6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:36.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.320+0000 7fc42de00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc4280c3d80 0x7fc4281f8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:36.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.320+0000 7fc42de00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4281f8570 0x7fc42815aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:36.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.320+0000 7fc42de00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc4280afcd0 con 0x7fc40c004800 2024-09-10T20:56:36.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.320+0000 7fc42de00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc4280afb50 con 0x7fc4281f8570 2024-09-10T20:56:36.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.320+0000 7fc42de00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fc4280afe50 con 0x7fc4280c3d80 2024-09-10T20:56:36.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.320+0000 7fc426a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc40c004800 0x7fc4280c6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:36.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.321+0000 7fc426a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc40c004800 0x7fc4280c6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59060/0 (socket says 172.21.15.6:59060) 2024-09-10T20:56:36.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.321+0000 7fc426a00640 1 -- 172.21.15.6:0/251481419 learned_addr learned my addr 172.21.15.6:0/251481419 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:36.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.321+0000 7fc426000640 1 --2- 172.21.15.6:0/251481419 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc4280c3d80 0x7fc4281f8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:36.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.321+0000 7fc427400640 1 --2- 172.21.15.6:0/251481419 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4281f8570 0x7fc42815aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:36.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.321+0000 7fc426a00640 1 -- 172.21.15.6:0/251481419 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc4280c3d80 msgr2=0x7fc4281f8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:36.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.321+0000 7fc426a00640 1 --2- 172.21.15.6:0/251481419 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc4280c3d80 0x7fc4281f8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:36.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.321+0000 7fc426a00640 1 -- 172.21.15.6:0/251481419 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4281f8570 msgr2=0x7fc42815aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:36.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.321+0000 7fc426a00640 1 --2- 172.21.15.6:0/251481419 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4281f8570 0x7fc42815aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:36.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.321+0000 7fc426a00640 1 -- 172.21.15.6:0/251481419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4281f8ad0 con 0x7fc40c004800 2024-09-10T20:56:36.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.321+0000 7fc426a00640 1 --2- 172.21.15.6:0/251481419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc40c004800 0x7fc4280c6750 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc41800e6d0 tx=0x7fc41800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:36.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.322+0000 7fc41f400640 1 -- 172.21.15.6:0/251481419 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc41800eea0 con 0x7fc40c004800 2024-09-10T20:56:36.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.322+0000 7fc41f400640 1 -- 172.21.15.6:0/251481419 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc418016070 con 0x7fc40c004800 2024-09-10T20:56:36.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.322+0000 7fc41f400640 1 -- 172.21.15.6:0/251481419 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc41800caa0 con 0x7fc40c004800 2024-09-10T20:56:36.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.322+0000 7fc42de00640 1 -- 172.21.15.6:0/251481419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4281f8db0 con 0x7fc40c004800 2024-09-10T20:56:36.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.322+0000 7fc42de00640 1 -- 172.21.15.6:0/251481419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc42815a510 con 0x7fc40c004800 2024-09-10T20:56:36.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.323+0000 7fc42de00640 1 -- 172.21.15.6:0/251481419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc42815a020 con 0x7fc40c004800 2024-09-10T20:56:36.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.324+0000 7fc41f400640 1 -- 172.21.15.6:0/251481419 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc41800cc40 con 0x7fc40c004800 2024-09-10T20:56:36.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.325+0000 7fc41f400640 1 --2- 172.21.15.6:0/251481419 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fc408077fa0 0x7fc40807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:36.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.325+0000 7fc41f400640 1 -- 172.21.15.6:0/251481419 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5227+0+0 (secure 0 0 0) 0x7fc41809a0b0 con 0x7fc40c004800 2024-09-10T20:56:36.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.325+0000 7fc426000640 1 --2- 172.21.15.6:0/251481419 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fc408077fa0 0x7fc40807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:36.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.326+0000 7fc426000640 1 --2- 172.21.15.6:0/251481419 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fc408077fa0 0x7fc40807a460 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc414035000 tx=0x7fc41402d040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:36.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.330+0000 7fc41f400640 1 -- 172.21.15.6:0/251481419 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc418062cf0 con 0x7fc40c004800 2024-09-10T20:56:36.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:36.524+0000 7fc42de00640 1 -- 172.21.15.6:0/251481419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fc4280b03b0 con 0x7fc40c004800 2024-09-10T20:56:37.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.118+0000 7fc41f400640 1 -- 172.21.15.6:0/251481419 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v33) ==== 170+0+0 (secure 0 0 0) 0x7fc41806b410 con 0x7fc40c004800 2024-09-10T20:56:37.122 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2024-09-10T20:56:37.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.122+0000 7fc42de00640 1 -- 172.21.15.6:0/251481419 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fc408077fa0 msgr2=0x7fc40807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:37.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.122+0000 7fc42de00640 1 --2- 172.21.15.6:0/251481419 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fc408077fa0 0x7fc40807a460 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc414035000 tx=0x7fc41402d040 comp rx=0 tx=0).stop 2024-09-10T20:56:37.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.122+0000 7fc42de00640 1 -- 172.21.15.6:0/251481419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc40c004800 msgr2=0x7fc4280c6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:37.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.122+0000 7fc42de00640 1 --2- 172.21.15.6:0/251481419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc40c004800 0x7fc4280c6750 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc41800e6d0 tx=0x7fc41800eb90 comp rx=0 tx=0).stop 2024-09-10T20:56:37.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.122+0000 7fc42de00640 1 -- 172.21.15.6:0/251481419 shutdown_connections 2024-09-10T20:56:37.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.122+0000 7fc42de00640 1 --2- 172.21.15.6:0/251481419 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fc408077fa0 0x7fc40807a460 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:37.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.122+0000 7fc42de00640 1 --2- 172.21.15.6:0/251481419 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4281f8570 0x7fc42815aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:37.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.122+0000 7fc42de00640 1 --2- 172.21.15.6:0/251481419 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc4280c3d80 0x7fc4281f8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:37.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.122+0000 7fc42de00640 1 --2- 172.21.15.6:0/251481419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc40c004800 0x7fc4280c6750 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:37.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.122+0000 7fc42de00640 1 -- 172.21.15.6:0/251481419 >> 172.21.15.6:0/251481419 conn(0x7fc4280d0250 msgr2=0x7fc4280ae4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:37.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.122+0000 7fc42de00640 1 -- 172.21.15.6:0/251481419 shutdown_connections 2024-09-10T20:56:37.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.122+0000 7fc42de00640 1 -- 172.21.15.6:0/251481419 wait complete. 2024-09-10T20:56:37.157 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T20:56:37.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.319+0000 7f0d91200640 1 -- 172.21.15.6:0/3835661451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d8c0ae890 msgr2=0x7f0d8c168db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:37.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.319+0000 7f0d91200640 1 --2- 172.21.15.6:0/3835661451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d8c0ae890 0x7f0d8c168db0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0d84005fd0 tx=0x7f0d8402a940 comp rx=0 tx=0).stop 2024-09-10T20:56:37.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.320+0000 7f0d91200640 1 -- 172.21.15.6:0/3835661451 shutdown_connections 2024-09-10T20:56:37.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.320+0000 7f0d91200640 1 --2- 172.21.15.6:0/3835661451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d8c0ae890 0x7f0d8c168db0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:37.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.320+0000 7f0d91200640 1 -- 172.21.15.6:0/3835661451 >> 172.21.15.6:0/3835661451 conn(0x7f0d8c0cfa20 msgr2=0x7f0d8c0cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:37.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.320+0000 7f0d91200640 1 -- 172.21.15.6:0/3835661451 shutdown_connections 2024-09-10T20:56:37.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.320+0000 7f0d91200640 1 -- 172.21.15.6:0/3835661451 wait complete. 2024-09-10T20:56:37.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.321+0000 7f0d91200640 1 Processor -- start 2024-09-10T20:56:37.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.321+0000 7f0d91200640 1 -- start start 2024-09-10T20:56:37.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.322+0000 7f0d91200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d8c0ae890 0x7f0d8c0b0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:37.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.322+0000 7f0d91200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0d8c0cf340 0x7f0d8c1f4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:37.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.322+0000 7f0d91200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d8c15bb30 0x7f0d8c1f5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:37.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.322+0000 7f0d91200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8c169470 con 0x7f0d8c15bb30 2024-09-10T20:56:37.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.322+0000 7f0d91200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8c1692f0 con 0x7f0d8c0ae890 2024-09-10T20:56:37.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.322+0000 7f0d91200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f0d8c1695f0 con 0x7f0d8c0cf340 2024-09-10T20:56:37.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.322+0000 7f0d8a800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d8c15bb30 0x7f0d8c1f5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:37.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.322+0000 7f0d8a800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d8c15bb30 0x7f0d8c1f5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59084/0 (socket says 172.21.15.6:59084) 2024-09-10T20:56:37.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.322+0000 7f0d8a800640 1 -- 172.21.15.6:0/911045246 learned_addr learned my addr 172.21.15.6:0/911045246 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:37.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.323+0000 7f0d89e00640 1 --2- 172.21.15.6:0/911045246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d8c0ae890 0x7f0d8c0b0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:37.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.323+0000 7f0d81400640 1 --2- 172.21.15.6:0/911045246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0d8c0cf340 0x7f0d8c1f4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:37.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.323+0000 7f0d8a800640 1 -- 172.21.15.6:0/911045246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0d8c0cf340 msgr2=0x7f0d8c1f4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:37.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.323+0000 7f0d8a800640 1 --2- 172.21.15.6:0/911045246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0d8c0cf340 0x7f0d8c1f4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:37.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.323+0000 7f0d8a800640 1 -- 172.21.15.6:0/911045246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d8c0ae890 msgr2=0x7f0d8c0b0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:37.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.323+0000 7f0d8a800640 1 --2- 172.21.15.6:0/911045246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d8c0ae890 0x7f0d8c0b0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:37.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.323+0000 7f0d8a800640 1 -- 172.21.15.6:0/911045246 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d8c0b09b0 con 0x7f0d8c15bb30 2024-09-10T20:56:37.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.323+0000 7f0d89e00640 1 --2- 172.21.15.6:0/911045246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d8c0ae890 0x7f0d8c0b0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:56:37.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.323+0000 7f0d81400640 1 --2- 172.21.15.6:0/911045246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0d8c0cf340 0x7f0d8c1f4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:56:37.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.323+0000 7f0d8a800640 1 --2- 172.21.15.6:0/911045246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d8c15bb30 0x7f0d8c1f5090 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0d84006010 tx=0x7f0d84031e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:37.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.323+0000 7f0d82a00640 1 -- 172.21.15.6:0/911045246 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d84030430 con 0x7f0d8c15bb30 2024-09-10T20:56:37.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.324+0000 7f0d82a00640 1 -- 172.21.15.6:0/911045246 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0d84004240 con 0x7f0d8c15bb30 2024-09-10T20:56:37.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.324+0000 7f0d82a00640 1 -- 172.21.15.6:0/911045246 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d84004650 con 0x7f0d8c15bb30 2024-09-10T20:56:37.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.324+0000 7f0d91200640 1 -- 172.21.15.6:0/911045246 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d8c15b270 con 0x7f0d8c15bb30 2024-09-10T20:56:37.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.324+0000 7f0d91200640 1 -- 172.21.15.6:0/911045246 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d8c158a60 con 0x7f0d8c15bb30 2024-09-10T20:56:37.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.325+0000 7f0d91200640 1 -- 172.21.15.6:0/911045246 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d8c161a20 con 0x7f0d8c15bb30 2024-09-10T20:56:37.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.326+0000 7f0d82a00640 1 -- 172.21.15.6:0/911045246 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f0d8402f070 con 0x7f0d8c15bb30 2024-09-10T20:56:37.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.327+0000 7f0d82a00640 1 --2- 172.21.15.6:0/911045246 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f0d68077f70 0x7f0d6807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:37.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.327+0000 7f0d82a00640 1 -- 172.21.15.6:0/911045246 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5609+0+0 (secure 0 0 0) 0x7f0d840bb320 con 0x7f0d8c15bb30 2024-09-10T20:56:37.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.327+0000 7f0d89e00640 1 --2- 172.21.15.6:0/911045246 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f0d68077f70 0x7f0d6807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:37.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.328+0000 7f0d89e00640 1 --2- 172.21.15.6:0/911045246 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f0d68077f70 0x7f0d6807a430 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c007fd0 tx=0x7f0d7c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:37.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.332+0000 7f0d82a00640 1 -- 172.21.15.6:0/911045246 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f0d84083e70 con 0x7f0d8c15bb30 2024-09-10T20:56:37.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:37.564+0000 7f0d91200640 1 -- 172.21.15.6:0/911045246 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f0d8c0d0850 con 0x7f0d8c15bb30 2024-09-10T20:56:38.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.134+0000 7f0d82a00640 1 -- 172.21.15.6:0/911045246 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) ==== 172+0+0 (secure 0 0 0) 0x7f0d84083770 con 0x7f0d8c15bb30 2024-09-10T20:56:38.139 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 4 and data pool 5 2024-09-10T20:56:38.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.140+0000 7f0d91200640 1 -- 172.21.15.6:0/911045246 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f0d68077f70 msgr2=0x7f0d6807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:38.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.140+0000 7f0d91200640 1 --2- 172.21.15.6:0/911045246 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f0d68077f70 0x7f0d6807a430 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c007fd0 tx=0x7f0d7c009040 comp rx=0 tx=0).stop 2024-09-10T20:56:38.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.140+0000 7f0d91200640 1 -- 172.21.15.6:0/911045246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d8c15bb30 msgr2=0x7f0d8c1f5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:38.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.140+0000 7f0d91200640 1 --2- 172.21.15.6:0/911045246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d8c15bb30 0x7f0d8c1f5090 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0d84006010 tx=0x7f0d84031e20 comp rx=0 tx=0).stop 2024-09-10T20:56:38.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.140+0000 7f0d91200640 1 -- 172.21.15.6:0/911045246 shutdown_connections 2024-09-10T20:56:38.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.140+0000 7f0d91200640 1 --2- 172.21.15.6:0/911045246 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f0d68077f70 0x7f0d6807a430 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.140+0000 7f0d91200640 1 --2- 172.21.15.6:0/911045246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d8c15bb30 0x7f0d8c1f5090 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.140+0000 7f0d91200640 1 --2- 172.21.15.6:0/911045246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0d8c0cf340 0x7f0d8c1f4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.140+0000 7f0d91200640 1 --2- 172.21.15.6:0/911045246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d8c0ae890 0x7f0d8c0b0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.140+0000 7f0d91200640 1 -- 172.21.15.6:0/911045246 >> 172.21.15.6:0/911045246 conn(0x7f0d8c0cfa20 msgr2=0x7f0d8c0ad880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:38.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.141+0000 7f0d91200640 1 -- 172.21.15.6:0/911045246 shutdown_connections 2024-09-10T20:56:38.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.141+0000 7f0d91200640 1 -- 172.21.15.6:0/911045246 wait complete. 2024-09-10T20:56:38.187 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T20:56:38.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.345+0000 7f22aba00640 1 -- 172.21.15.6:0/3176524864 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a415c170 msgr2=0x7f22a40743b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:38.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.345+0000 7f22aba00640 1 --2- 172.21.15.6:0/3176524864 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a415c170 0x7f22a40743b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f22a40cf5a0 tx=0x7f228c02a560 comp rx=0 tx=0).stop 2024-09-10T20:56:38.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.345+0000 7f22aba00640 1 -- 172.21.15.6:0/3176524864 shutdown_connections 2024-09-10T20:56:38.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.345+0000 7f22aba00640 1 --2- 172.21.15.6:0/3176524864 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a415c170 0x7f22a40743b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.345+0000 7f22aba00640 1 --2- 172.21.15.6:0/3176524864 >> v2:172.21.15.150:3300/0 conn(0x7f22a4070450 0x7f22a40cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.345+0000 7f22aba00640 1 -- 172.21.15.6:0/3176524864 >> 172.21.15.6:0/3176524864 conn(0x7f22a40cfa20 msgr2=0x7f22a40cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:38.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.345+0000 7f22aba00640 1 -- 172.21.15.6:0/3176524864 shutdown_connections 2024-09-10T20:56:38.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.345+0000 7f22aba00640 1 -- 172.21.15.6:0/3176524864 wait complete. 2024-09-10T20:56:38.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.347+0000 7f22aba00640 1 Processor -- start 2024-09-10T20:56:38.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.347+0000 7f22aba00640 1 -- start start 2024-09-10T20:56:38.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.348+0000 7f22aba00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a4070450 0x7f22a415b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:38.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.348+0000 7f22aba00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22a4159670 0x7f22a40c7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:38.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.348+0000 7f22aba00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22a415c170 0x7f22a41f5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:38.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.348+0000 7f22aba00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f22a40b4a90 con 0x7f22a4070450 2024-09-10T20:56:38.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.348+0000 7f22aba00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f22a40b4910 con 0x7f22a415c170 2024-09-10T20:56:38.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.348+0000 7f22aba00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f22a40b4c10 con 0x7f22a4159670 2024-09-10T20:56:38.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.348+0000 7f22a9000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a4070450 0x7f22a415b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:38.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.348+0000 7f22a9000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a4070450 0x7f22a415b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37780/0 (socket says 172.21.15.6:37780) 2024-09-10T20:56:38.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.348+0000 7f22a9000640 1 -- 172.21.15.6:0/2124235573 learned_addr learned my addr 172.21.15.6:0/2124235573 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:38.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.348+0000 7f229be00640 1 --2- 172.21.15.6:0/2124235573 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22a4159670 0x7f22a40c7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:38.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.348+0000 7f22a9a00640 1 --2- 172.21.15.6:0/2124235573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22a415c170 0x7f22a41f5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:38.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.348+0000 7f22a9000640 1 -- 172.21.15.6:0/2124235573 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22a4159670 msgr2=0x7f22a40c7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:38.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.348+0000 7f22a9000640 1 --2- 172.21.15.6:0/2124235573 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22a4159670 0x7f22a40c7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.348+0000 7f22a9000640 1 -- 172.21.15.6:0/2124235573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22a415c170 msgr2=0x7f22a41f5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:38.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.348+0000 7f22a9000640 1 --2- 172.21.15.6:0/2124235573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22a415c170 0x7f22a41f5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.348+0000 7f22a9000640 1 -- 172.21.15.6:0/2124235573 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22a40c4aa0 con 0x7f22a4070450 2024-09-10T20:56:38.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.349+0000 7f229be00640 1 --2- 172.21.15.6:0/2124235573 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22a4159670 0x7f22a40c7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:56:38.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.349+0000 7f22a9a00640 1 --2- 172.21.15.6:0/2124235573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22a415c170 0x7f22a41f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:56:38.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.349+0000 7f22a9000640 1 --2- 172.21.15.6:0/2124235573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a4070450 0x7f22a415b7b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f229400c420 tx=0x7f229400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:38.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.349+0000 7f22a1600640 1 -- 172.21.15.6:0/2124235573 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22940052d0 con 0x7f22a4070450 2024-09-10T20:56:38.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.349+0000 7f22a1600640 1 -- 172.21.15.6:0/2124235573 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2294007020 con 0x7f22a4070450 2024-09-10T20:56:38.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.349+0000 7f22a1600640 1 -- 172.21.15.6:0/2124235573 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2294007470 con 0x7f22a4070450 2024-09-10T20:56:38.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.349+0000 7f22aba00640 1 -- 172.21.15.6:0/2124235573 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22a40c4d80 con 0x7f22a4070450 2024-09-10T20:56:38.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.349+0000 7f22aba00640 1 -- 172.21.15.6:0/2124235573 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22a40c5340 con 0x7f22a4070450 2024-09-10T20:56:38.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.350+0000 7f22aba00640 1 -- 172.21.15.6:0/2124235573 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22a40b50c0 con 0x7f22a4070450 2024-09-10T20:56:38.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.351+0000 7f22a1600640 1 -- 172.21.15.6:0/2124235573 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f22940067d0 con 0x7f22a4070450 2024-09-10T20:56:38.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.352+0000 7f22a1600640 1 --2- 172.21.15.6:0/2124235573 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2280077fa0 0x7f228007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:38.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.352+0000 7f22a1600640 1 -- 172.21.15.6:0/2124235573 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f2294099160 con 0x7f22a4070450 2024-09-10T20:56:38.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.353+0000 7f229be00640 1 --2- 172.21.15.6:0/2124235573 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2280077fa0 0x7f228007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:38.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.354+0000 7f229be00640 1 --2- 172.21.15.6:0/2124235573 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2280077fa0 0x7f228007a460 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f228c033000 tx=0x7f228c004730 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:38.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.357+0000 7f22a1600640 1 -- 172.21.15.6:0/2124235573 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2294061cf0 con 0x7f22a4070450 2024-09-10T20:56:38.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.556+0000 7f22aba00640 1 -- 172.21.15.6:0/2124235573 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f22a4069d20 con 0x7f22a4070450 2024-09-10T20:56:38.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.557+0000 7f22a1600640 1 -- 172.21.15.6:0/2124235573 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16682 (secure 0 0 0) 0x7f22940615f0 con 0x7f22a4070450 2024-09-10T20:56:38.561 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:56:38.562 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":34,"fsid":"9e04309e-61c3-4c78-82db-9576e465d98a","created":"2024-09-10T20:55:17.972466+0000","modified":"2024-09-10T20:56:37.566106+0000","last_up_change":"2024-09-10T20:55:32.392769+0000","last_in_change":"2024-09-10T20:55:22.232252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:55:33.196464+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:56:35.128358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-10T20:56:36.534250+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0918c5c8-a028-4987-bad2-406c412ec3f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6801","nonce":895515615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6803","nonce":895515615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6807","nonce":895515615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6805","nonce":895515615}]},"public_addr":"172.21.15.6:6801/895515615","cluster_addr":"172.21.15.6:6803/895515615","heartbeat_back_addr":"172.21.15.6:6807/895515615","heartbeat_front_addr":"172.21.15.6:6805/895515615","state":["exists","up"]},{"osd":1,"uuid":"415e9c78-c3d9-46d6-b277-348453f42155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6809","nonce":1129113250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6811","nonce":1129113250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6815","nonce":1129113250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6813","nonce":1129113250}]},"public_addr":"172.21.15.6:6809/1129113250","cluster_addr":"172.21.15.6:6811/1129113250","heartbeat_back_addr":"172.21.15.6:6815/1129113250","heartbeat_front_addr":"172.21.15.6:6813/1129113250","state":["exists","up"]},{"osd":2,"uuid":"763c1cf2-a43d-4c10-815d-eaf4a32afc1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6825","nonce":3847470051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6827","nonce":3847470051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6831","nonce":3847470051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6829","nonce":3847470051}]},"public_addr":"172.21.15.6:6825/3847470051","cluster_addr":"172.21.15.6:6827/3847470051","heartbeat_back_addr":"172.21.15.6:6831/3847470051","heartbeat_front_addr":"172.21.15.6:6829/3847470051","state":["exists","up"]},{"osd":3,"uuid":"877b1cc1-2434-4b32-af66-9c2485eac9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6817","nonce":3911674247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6819","nonce":3911674247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6823","nonce":3911674247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6821","nonce":3911674247}]},"public_addr":"172.21.15.6:6817/3911674247","cluster_addr":"172.21.15.6:6819/3911674247","heartbeat_back_addr":"172.21.15.6:6823/3911674247","heartbeat_front_addr":"172.21.15.6:6821/3911674247","state":["exists","up"]},{"osd":4,"uuid":"e0b27501-dfdc-4e7f-b73a-9573c869267a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6827","nonce":2568527750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6829","nonce":2568527750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6833","nonce":2568527750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6831","nonce":2568527750}]},"public_addr":"172.21.15.150:6827/2568527750","cluster_addr":"172.21.15.150:6829/2568527750","heartbeat_back_addr":"172.21.15.150:6833/2568527750","heartbeat_front_addr":"172.21.15.150:6831/2568527750","state":["exists","up"]},{"osd":5,"uuid":"67e48053-4f15-44fd-a30c-c9522f86d169","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6811","nonce":371417736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6813","nonce":371417736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6817","nonce":371417736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6815","nonce":371417736}]},"public_addr":"172.21.15.150:6811/371417736","cluster_addr":"172.21.15.150:6813/371417736","heartbeat_back_addr":"172.21.15.150:6817/371417736","heartbeat_front_addr":"172.21.15.150:6815/371417736","state":["exists","up"]},{"osd":6,"uuid":"1456df2e-ae91-45a4-bc3a-a06c753092af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6819","nonce":2329248366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6821","nonce":2329248366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6825","nonce":2329248366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6823","nonce":2329248366}]},"public_addr":"172.21.15.150:6819/2329248366","cluster_addr":"172.21.15.150:6821/2329248366","heartbeat_back_addr":"172.21.15.150:6825/2329248366","heartbeat_front_addr":"172.21.15.150:6823/2329248366","state":["exists","up"]},{"osd":7,"uuid":"a9daafcb-5ecd-43bd-ab0a-dc4b480cfc2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6803","nonce":527018351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6805","nonce":527018351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6809","nonce":527018351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6807","nonce":527018351}]},"public_addr":"172.21.15.150:6803/527018351","cluster_addr":"172.21.15.150:6805/527018351","heartbeat_back_addr":"172.21.15.150:6809/527018351","heartbeat_front_addr":"172.21.15.150:6807/527018351","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.710061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.024506+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.824320+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.431608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.637032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.054828+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.333290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.358875+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:56:38.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.559+0000 7f22aba00640 1 -- 172.21.15.6:0/2124235573 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2280077fa0 msgr2=0x7f228007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:38.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.559+0000 7f22aba00640 1 --2- 172.21.15.6:0/2124235573 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2280077fa0 0x7f228007a460 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f228c033000 tx=0x7f228c004730 comp rx=0 tx=0).stop 2024-09-10T20:56:38.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.559+0000 7f22aba00640 1 -- 172.21.15.6:0/2124235573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a4070450 msgr2=0x7f22a415b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:38.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.559+0000 7f22aba00640 1 --2- 172.21.15.6:0/2124235573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a4070450 0x7f22a415b7b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f229400c420 tx=0x7f229400c8e0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.559+0000 7f22aba00640 1 -- 172.21.15.6:0/2124235573 shutdown_connections 2024-09-10T20:56:38.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.559+0000 7f22aba00640 1 --2- 172.21.15.6:0/2124235573 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2280077fa0 0x7f228007a460 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.559+0000 7f22aba00640 1 --2- 172.21.15.6:0/2124235573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22a415c170 0x7f22a41f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.559+0000 7f22aba00640 1 --2- 172.21.15.6:0/2124235573 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22a4159670 0x7f22a40c7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.559+0000 7f22aba00640 1 --2- 172.21.15.6:0/2124235573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a4070450 0x7f22a415b7b0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.559+0000 7f22aba00640 1 -- 172.21.15.6:0/2124235573 >> 172.21.15.6:0/2124235573 conn(0x7f22a40cfa20 msgr2=0x7f22a415d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:38.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.559+0000 7f22aba00640 1 -- 172.21.15.6:0/2124235573 shutdown_connections 2024-09-10T20:56:38.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.559+0000 7f22aba00640 1 -- 172.21.15.6:0/2124235573 wait complete. 2024-09-10T20:56:38.565 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T20:56:38.570 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T20:56:38.579 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T20:56:38.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.778+0000 7fce5d000640 1 -- 172.21.15.6:0/2242793589 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce58161610 msgr2=0x7fce580d4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:38.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.778+0000 7fce5d000640 1 --2- 172.21.15.6:0/2242793589 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce58161610 0x7fce580d4500 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fce48009860 tx=0x7fce4802a530 comp rx=0 tx=0).stop 2024-09-10T20:56:38.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.778+0000 7fce5d000640 1 -- 172.21.15.6:0/2242793589 shutdown_connections 2024-09-10T20:56:38.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.778+0000 7fce5d000640 1 --2- 172.21.15.6:0/2242793589 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce58161610 0x7fce580d4500 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.778+0000 7fce5d000640 1 -- 172.21.15.6:0/2242793589 >> 172.21.15.6:0/2242793589 conn(0x7fce5809d0f0 msgr2=0x7fce580d3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:38.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.778+0000 7fce5d000640 1 -- 172.21.15.6:0/2242793589 shutdown_connections 2024-09-10T20:56:38.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.778+0000 7fce5d000640 1 -- 172.21.15.6:0/2242793589 wait complete. 2024-09-10T20:56:38.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.780+0000 7fce5d000640 1 Processor -- start 2024-09-10T20:56:38.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.780+0000 7fce5d000640 1 -- start start 2024-09-10T20:56:38.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.781+0000 7fce5d000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce580b53e0 0x7fce5815d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:38.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.781+0000 7fce5d000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce580d0f10 0x7fce5815eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:38.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.781+0000 7fce5d000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce58161610 0x7fce5815f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:38.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.781+0000 7fce5d000640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fce580b45c0 con 0x7fce580b53e0 2024-09-10T20:56:38.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.781+0000 7fce5d000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fce580b4440 con 0x7fce580d0f10 2024-09-10T20:56:38.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.781+0000 7fce5d000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fce580b4740 con 0x7fce58161610 2024-09-10T20:56:38.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.781+0000 7fce57400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce580b53e0 0x7fce5815d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:38.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.781+0000 7fce57400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce580b53e0 0x7fce5815d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37792/0 (socket says 172.21.15.6:37792) 2024-09-10T20:56:38.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.781+0000 7fce57400640 1 -- 172.21.15.6:0/2360557184 learned_addr learned my addr 172.21.15.6:0/2360557184 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:38.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.781+0000 7fce56a00640 1 --2- 172.21.15.6:0/2360557184 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce580d0f10 0x7fce5815eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:38.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.781+0000 7fce57e00640 1 --2- 172.21.15.6:0/2360557184 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce58161610 0x7fce5815f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:38.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.782+0000 7fce57400640 1 -- 172.21.15.6:0/2360557184 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce58161610 msgr2=0x7fce5815f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:38.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.782+0000 7fce57400640 1 --2- 172.21.15.6:0/2360557184 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce58161610 0x7fce5815f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.782+0000 7fce57400640 1 -- 172.21.15.6:0/2360557184 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce580d0f10 msgr2=0x7fce5815eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:38.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.782+0000 7fce57400640 1 --2- 172.21.15.6:0/2360557184 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce580d0f10 0x7fce5815eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.782+0000 7fce57400640 1 -- 172.21.15.6:0/2360557184 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce580cb350 con 0x7fce580b53e0 2024-09-10T20:56:38.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.782+0000 7fce57e00640 1 --2- 172.21.15.6:0/2360557184 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce58161610 0x7fce5815f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:56:38.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.782+0000 7fce57400640 1 --2- 172.21.15.6:0/2360557184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce580b53e0 0x7fce5815d320 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fce4802ab20 tx=0x7fce48030650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:38.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.782+0000 7fce4f400640 1 -- 172.21.15.6:0/2360557184 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce4803f070 con 0x7fce580b53e0 2024-09-10T20:56:38.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.782+0000 7fce4f400640 1 -- 172.21.15.6:0/2360557184 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce48030d60 con 0x7fce580b53e0 2024-09-10T20:56:38.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.782+0000 7fce4f400640 1 -- 172.21.15.6:0/2360557184 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce48004280 con 0x7fce580b53e0 2024-09-10T20:56:38.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.782+0000 7fce5d000640 1 -- 172.21.15.6:0/2360557184 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce581f4d30 con 0x7fce580b53e0 2024-09-10T20:56:38.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.782+0000 7fce5d000640 1 -- 172.21.15.6:0/2360557184 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce5815d860 con 0x7fce580b53e0 2024-09-10T20:56:38.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.784+0000 7fce5d000640 1 -- 172.21.15.6:0/2360557184 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce580d4500 con 0x7fce580b53e0 2024-09-10T20:56:38.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.784+0000 7fce4f400640 1 -- 172.21.15.6:0/2360557184 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fce480035f0 con 0x7fce580b53e0 2024-09-10T20:56:38.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.785+0000 7fce4f400640 1 --2- 172.21.15.6:0/2360557184 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fce38077f70 0x7fce3807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:38.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.785+0000 7fce4f400640 1 -- 172.21.15.6:0/2360557184 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fce480baca0 con 0x7fce580b53e0 2024-09-10T20:56:38.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.786+0000 7fce56a00640 1 --2- 172.21.15.6:0/2360557184 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fce38077f70 0x7fce3807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:38.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.786+0000 7fce56a00640 1 --2- 172.21.15.6:0/2360557184 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fce38077f70 0x7fce3807a430 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fce44007fd0 tx=0x7fce44009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:38.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.790+0000 7fce4f400640 1 -- 172.21.15.6:0/2360557184 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fce48083700 con 0x7fce580b53e0 2024-09-10T20:56:38.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.987+0000 7fce5d000640 1 -- 172.21.15.6:0/2360557184 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fce580d05e0 con 0x7fce580b53e0 2024-09-10T20:56:38.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.988+0000 7fce4f400640 1 -- 172.21.15.6:0/2360557184 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16682 (secure 0 0 0) 0x7fce48083000 con 0x7fce580b53e0 2024-09-10T20:56:38.994 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:56:38.994 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":34,"fsid":"9e04309e-61c3-4c78-82db-9576e465d98a","created":"2024-09-10T20:55:17.972466+0000","modified":"2024-09-10T20:56:37.566106+0000","last_up_change":"2024-09-10T20:55:32.392769+0000","last_in_change":"2024-09-10T20:55:22.232252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:55:33.196464+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:56:35.128358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-10T20:56:36.534250+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0918c5c8-a028-4987-bad2-406c412ec3f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6801","nonce":895515615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6803","nonce":895515615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6807","nonce":895515615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6805","nonce":895515615}]},"public_addr":"172.21.15.6:6801/895515615","cluster_addr":"172.21.15.6:6803/895515615","heartbeat_back_addr":"172.21.15.6:6807/895515615","heartbeat_front_addr":"172.21.15.6:6805/895515615","state":["exists","up"]},{"osd":1,"uuid":"415e9c78-c3d9-46d6-b277-348453f42155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6809","nonce":1129113250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6811","nonce":1129113250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6815","nonce":1129113250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6813","nonce":1129113250}]},"public_addr":"172.21.15.6:6809/1129113250","cluster_addr":"172.21.15.6:6811/1129113250","heartbeat_back_addr":"172.21.15.6:6815/1129113250","heartbeat_front_addr":"172.21.15.6:6813/1129113250","state":["exists","up"]},{"osd":2,"uuid":"763c1cf2-a43d-4c10-815d-eaf4a32afc1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6825","nonce":3847470051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6827","nonce":3847470051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6831","nonce":3847470051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6829","nonce":3847470051}]},"public_addr":"172.21.15.6:6825/3847470051","cluster_addr":"172.21.15.6:6827/3847470051","heartbeat_back_addr":"172.21.15.6:6831/3847470051","heartbeat_front_addr":"172.21.15.6:6829/3847470051","state":["exists","up"]},{"osd":3,"uuid":"877b1cc1-2434-4b32-af66-9c2485eac9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6817","nonce":3911674247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6819","nonce":3911674247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6823","nonce":3911674247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6821","nonce":3911674247}]},"public_addr":"172.21.15.6:6817/3911674247","cluster_addr":"172.21.15.6:6819/3911674247","heartbeat_back_addr":"172.21.15.6:6823/3911674247","heartbeat_front_addr":"172.21.15.6:6821/3911674247","state":["exists","up"]},{"osd":4,"uuid":"e0b27501-dfdc-4e7f-b73a-9573c869267a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6827","nonce":2568527750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6829","nonce":2568527750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6833","nonce":2568527750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6831","nonce":2568527750}]},"public_addr":"172.21.15.150:6827/2568527750","cluster_addr":"172.21.15.150:6829/2568527750","heartbeat_back_addr":"172.21.15.150:6833/2568527750","heartbeat_front_addr":"172.21.15.150:6831/2568527750","state":["exists","up"]},{"osd":5,"uuid":"67e48053-4f15-44fd-a30c-c9522f86d169","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6811","nonce":371417736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6813","nonce":371417736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6817","nonce":371417736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6815","nonce":371417736}]},"public_addr":"172.21.15.150:6811/371417736","cluster_addr":"172.21.15.150:6813/371417736","heartbeat_back_addr":"172.21.15.150:6817/371417736","heartbeat_front_addr":"172.21.15.150:6815/371417736","state":["exists","up"]},{"osd":6,"uuid":"1456df2e-ae91-45a4-bc3a-a06c753092af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6819","nonce":2329248366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6821","nonce":2329248366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6825","nonce":2329248366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6823","nonce":2329248366}]},"public_addr":"172.21.15.150:6819/2329248366","cluster_addr":"172.21.15.150:6821/2329248366","heartbeat_back_addr":"172.21.15.150:6825/2329248366","heartbeat_front_addr":"172.21.15.150:6823/2329248366","state":["exists","up"]},{"osd":7,"uuid":"a9daafcb-5ecd-43bd-ab0a-dc4b480cfc2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6803","nonce":527018351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6805","nonce":527018351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6809","nonce":527018351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6807","nonce":527018351}]},"public_addr":"172.21.15.150:6803/527018351","cluster_addr":"172.21.15.150:6805/527018351","heartbeat_back_addr":"172.21.15.150:6809/527018351","heartbeat_front_addr":"172.21.15.150:6807/527018351","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.710061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.024506+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.824320+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.431608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.637032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.054828+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.333290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.358875+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:56:38.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.990+0000 7fce5d000640 1 -- 172.21.15.6:0/2360557184 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fce38077f70 msgr2=0x7fce3807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:38.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.990+0000 7fce5d000640 1 --2- 172.21.15.6:0/2360557184 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fce38077f70 0x7fce3807a430 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fce44007fd0 tx=0x7fce44009040 comp rx=0 tx=0).stop 2024-09-10T20:56:38.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.990+0000 7fce5d000640 1 -- 172.21.15.6:0/2360557184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce580b53e0 msgr2=0x7fce5815d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:38.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.990+0000 7fce5d000640 1 --2- 172.21.15.6:0/2360557184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce580b53e0 0x7fce5815d320 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fce4802ab20 tx=0x7fce48030650 comp rx=0 tx=0).stop 2024-09-10T20:56:38.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.990+0000 7fce5d000640 1 -- 172.21.15.6:0/2360557184 shutdown_connections 2024-09-10T20:56:38.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.990+0000 7fce5d000640 1 --2- 172.21.15.6:0/2360557184 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fce38077f70 0x7fce3807a430 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.990+0000 7fce5d000640 1 --2- 172.21.15.6:0/2360557184 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce58161610 0x7fce5815f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.990+0000 7fce5d000640 1 --2- 172.21.15.6:0/2360557184 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce580d0f10 0x7fce5815eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.990+0000 7fce5d000640 1 --2- 172.21.15.6:0/2360557184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce580b53e0 0x7fce5815d320 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.990+0000 7fce5d000640 1 -- 172.21.15.6:0/2360557184 >> 172.21.15.6:0/2360557184 conn(0x7fce5809d0f0 msgr2=0x7fce580b3900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:38.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.990+0000 7fce5d000640 1 -- 172.21.15.6:0/2360557184 shutdown_connections 2024-09-10T20:56:38.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:38.990+0000 7fce5d000640 1 -- 172.21.15.6:0/2360557184 wait complete. 2024-09-10T20:56:39.011 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T20:56:39.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:39.172+0000 7f6ce0200640 1 -- 172.21.15.6:0/1717958073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cd80aef00 msgr2=0x7f6cd815de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:39.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:39.172+0000 7f6ce0200640 1 --2- 172.21.15.6:0/1717958073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cd80aef00 0x7f6cd815de90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4005fd0 tx=0x7f6cc402a6c0 comp rx=0 tx=0).stop 2024-09-10T20:56:39.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:39.172+0000 7f6ce0200640 1 -- 172.21.15.6:0/1717958073 shutdown_connections 2024-09-10T20:56:39.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:39.172+0000 7f6ce0200640 1 --2- 172.21.15.6:0/1717958073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cd80aef00 0x7f6cd815de90 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:39.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:39.172+0000 7f6ce0200640 1 --2- 172.21.15.6:0/1717958073 >> v2:172.21.15.150:3300/0 conn(0x7f6cd815dab0 0x7f6cd80d0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:39.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:39.172+0000 7f6ce0200640 1 -- 172.21.15.6:0/1717958073 >> 172.21.15.6:0/1717958073 conn(0x7f6cd80cfa20 msgr2=0x7f6cd80cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:39.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:39.172+0000 7f6ce0200640 1 -- 172.21.15.6:0/1717958073 shutdown_connections 2024-09-10T20:56:39.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:39.172+0000 7f6ce0200640 1 -- 172.21.15.6:0/1717958073 wait complete. 2024-09-10T20:56:39.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:39.174+0000 7f6ce0200640 1 Processor -- start 2024-09-10T20:56:39.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:39.174+0000 7f6ce0200640 1 -- start start 2024-09-10T20:56:39.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:39.175+0000 7f6ce0200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6cd8072560 0x7f6cd80b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:39.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:39.175+0000 7f6ce0200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6cd80aef00 0x7f6cd81553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:39.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:39.175+0000 7f6ce0200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cd815dab0 0x7f6cd815a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:39.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:39.175+0000 7f6ce0200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd80cef50 con 0x7f6cd815dab0 2024-09-10T20:56:39.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:39.175+0000 7f6ce0200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd8070860 con 0x7f6cd80aef00 2024-09-10T20:56:39.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:39.175+0000 7f6ce0200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f6cd80cf0d0 con 0x7f6cd8072560 2024-09-10T20:56:39.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:39.175+0000 7f6cde200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cd815dab0 0x7f6cd815a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:39.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:39.175+0000 7f6cdd800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6cd8072560 0x7f6cd80b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:39.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:39.175+0000 7f6cde200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cd815dab0 0x7f6cd815a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37808/0 (socket says 172.21.15.6:37808) 2024-09-10T20:56:39.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:39.175+0000 7f6cde200640 1 -- 172.21.15.6:0/3625486918 learned_addr learned my addr 172.21.15.6:0/3625486918 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:39.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:39.175+0000 7f6cdce00640 1 --2- 172.21.15.6:0/3625486918 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6cd80aef00 0x7f6cd81553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:39.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:39.176+0000 7f6cde200640 1 -- 172.21.15.6:0/3625486918 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6cd8072560 msgr2=0x7f6cd80b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:39.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:39.176+0000 7f6cde200640 1 --2- 172.21.15.6:0/3625486918 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6cd8072560 0x7f6cd80b42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:39.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:39.176+0000 7f6cde200640 1 -- 172.21.15.6:0/3625486918 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6cd80aef00 msgr2=0x7f6cd81553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:39.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:39.176+0000 7f6cde200640 1 --2- 172.21.15.6:0/3625486918 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6cd80aef00 0x7f6cd81553b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:39.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:39.176+0000 7f6cde200640 1 -- 172.21.15.6:0/3625486918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cd814f4c0 con 0x7f6cd815dab0 2024-09-10T20:56:39.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:39.176+0000 7f6cde200640 1 --2- 172.21.15.6:0/3625486918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cd815dab0 0x7f6cd815a4a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6cd000c760 tx=0x7f6cd000cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:39.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:39.176+0000 7f6cd5600640 1 -- 172.21.15.6:0/3625486918 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd0016020 con 0x7f6cd815dab0 2024-09-10T20:56:39.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:39.176+0000 7f6cd5600640 1 -- 172.21.15.6:0/3625486918 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6cd0003990 con 0x7f6cd815dab0 2024-09-10T20:56:39.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:39.176+0000 7f6ce0200640 1 -- 172.21.15.6:0/3625486918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cd814f7a0 con 0x7f6cd815dab0 2024-09-10T20:56:39.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:39.176+0000 7f6cd5600640 1 -- 172.21.15.6:0/3625486918 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd0006e60 con 0x7f6cd815dab0 2024-09-10T20:56:39.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:39.176+0000 7f6ce0200640 1 -- 172.21.15.6:0/3625486918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cd814fd60 con 0x7f6cd815dab0 2024-09-10T20:56:39.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:39.177+0000 7f6ce0200640 1 -- 172.21.15.6:0/3625486918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cd815b270 con 0x7f6cd815dab0 2024-09-10T20:56:39.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:39.178+0000 7f6cd5600640 1 -- 172.21.15.6:0/3625486918 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6cd00050d0 con 0x7f6cd815dab0 2024-09-10T20:56:39.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:39.179+0000 7f6cd5600640 1 --2- 172.21.15.6:0/3625486918 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6cb8077f70 0x7f6cb807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:39.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:39.179+0000 7f6cd5600640 1 -- 172.21.15.6:0/3625486918 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f6cd00997e0 con 0x7f6cd815dab0 2024-09-10T20:56:39.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:39.180+0000 7f6cdd800640 1 --2- 172.21.15.6:0/3625486918 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6cb8077f70 0x7f6cb807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:39.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:39.181+0000 7f6cdd800640 1 --2- 172.21.15.6:0/3625486918 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6cb8077f70 0x7f6cb807a430 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc009bd0 tx=0x7f6ccc005f90 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:39.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:39.184+0000 7f6cd5600640 1 -- 172.21.15.6:0/3625486918 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f6cd815b270 con 0x7f6cd815dab0 2024-09-10T20:56:39.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:39.413+0000 7f6ce0200640 1 -- 172.21.15.6:0/3625486918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f6cd815de90 con 0x7f6cd815dab0 2024-09-10T20:56:40.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.161+0000 7f6cd5600640 1 -- 172.21.15.6:0/3625486918 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f6cd0020020 con 0x7f6cd815dab0 2024-09-10T20:56:40.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.164+0000 7f6ce0200640 1 -- 172.21.15.6:0/3625486918 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6cb8077f70 msgr2=0x7f6cb807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:40.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.164+0000 7f6ce0200640 1 --2- 172.21.15.6:0/3625486918 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6cb8077f70 0x7f6cb807a430 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc009bd0 tx=0x7f6ccc005f90 comp rx=0 tx=0).stop 2024-09-10T20:56:40.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.164+0000 7f6ce0200640 1 -- 172.21.15.6:0/3625486918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cd815dab0 msgr2=0x7f6cd815a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:40.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.164+0000 7f6ce0200640 1 --2- 172.21.15.6:0/3625486918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cd815dab0 0x7f6cd815a4a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6cd000c760 tx=0x7f6cd000cb60 comp rx=0 tx=0).stop 2024-09-10T20:56:40.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.164+0000 7f6ce0200640 1 -- 172.21.15.6:0/3625486918 shutdown_connections 2024-09-10T20:56:40.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.164+0000 7f6ce0200640 1 --2- 172.21.15.6:0/3625486918 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6cb8077f70 0x7f6cb807a430 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:40.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.164+0000 7f6ce0200640 1 --2- 172.21.15.6:0/3625486918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cd815dab0 0x7f6cd815a4a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:40.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.164+0000 7f6ce0200640 1 --2- 172.21.15.6:0/3625486918 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6cd80aef00 0x7f6cd81553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:40.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.164+0000 7f6ce0200640 1 --2- 172.21.15.6:0/3625486918 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6cd8072560 0x7f6cd80b42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:40.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.164+0000 7f6ce0200640 1 -- 172.21.15.6:0/3625486918 >> 172.21.15.6:0/3625486918 conn(0x7f6cd80cfa20 msgr2=0x7f6cd80b0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:40.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.164+0000 7f6ce0200640 1 -- 172.21.15.6:0/3625486918 shutdown_connections 2024-09-10T20:56:40.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.164+0000 7f6ce0200640 1 -- 172.21.15.6:0/3625486918 wait complete. 2024-09-10T20:56:40.187 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T20:56:40.187 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T20:56:40.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.352+0000 7fd769e00640 1 -- 172.21.15.6:0/2775997731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd76406e960 msgr2=0x7fd764073a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:40.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.352+0000 7fd769e00640 1 --2- 172.21.15.6:0/2775997731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd76406e960 0x7fd764073a50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd7500098e0 tx=0x7fd75002a5c0 comp rx=0 tx=0).stop 2024-09-10T20:56:40.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.352+0000 7fd769e00640 1 -- 172.21.15.6:0/2775997731 shutdown_connections 2024-09-10T20:56:40.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.352+0000 7fd769e00640 1 --2- 172.21.15.6:0/2775997731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd76406e960 0x7fd764073a50 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:40.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.352+0000 7fd769e00640 1 --2- 172.21.15.6:0/2775997731 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7641592f0 0x7fd76406e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:40.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.352+0000 7fd769e00640 1 -- 172.21.15.6:0/2775997731 >> 172.21.15.6:0/2775997731 conn(0x7fd76406d660 msgr2=0x7fd7640b1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:40.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.352+0000 7fd769e00640 1 -- 172.21.15.6:0/2775997731 shutdown_connections 2024-09-10T20:56:40.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.352+0000 7fd769e00640 1 -- 172.21.15.6:0/2775997731 wait complete. 2024-09-10T20:56:40.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.354+0000 7fd769e00640 1 Processor -- start 2024-09-10T20:56:40.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.354+0000 7fd769e00640 1 -- start start 2024-09-10T20:56:40.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.355+0000 7fd769e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd76406e960 0x7fd76414a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:40.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.355+0000 7fd769e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd764073f90 0x7fd7641f50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:40.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.355+0000 7fd769e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7641592f0 0x7fd7640b4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:40.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.355+0000 7fd769e00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd764159850 con 0x7fd76406e960 2024-09-10T20:56:40.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.355+0000 7fd769e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd7641596d0 con 0x7fd764073f90 2024-09-10T20:56:40.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.355+0000 7fd769e00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd76415fb60 con 0x7fd7641592f0 2024-09-10T20:56:40.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.355+0000 7fd768a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd76406e960 0x7fd76414a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:40.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.355+0000 7fd763e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd764073f90 0x7fd7641f50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:40.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.355+0000 7fd763e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd764073f90 0x7fd7641f50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.6:48096/0 (socket says 172.21.15.6:48096) 2024-09-10T20:56:40.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.355+0000 7fd763e00640 1 -- 172.21.15.6:0/3984121237 learned_addr learned my addr 172.21.15.6:0/3984121237 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:40.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.355+0000 7fd769400640 1 --2- 172.21.15.6:0/3984121237 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7641592f0 0x7fd7640b4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:40.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.356+0000 7fd763e00640 1 -- 172.21.15.6:0/3984121237 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7641592f0 msgr2=0x7fd7640b4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:40.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.356+0000 7fd763e00640 1 --2- 172.21.15.6:0/3984121237 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7641592f0 0x7fd7640b4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:40.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.356+0000 7fd763e00640 1 -- 172.21.15.6:0/3984121237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd76406e960 msgr2=0x7fd76414a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:40.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.356+0000 7fd763e00640 1 --2- 172.21.15.6:0/3984121237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd76406e960 0x7fd76414a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:40.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.356+0000 7fd763e00640 1 -- 172.21.15.6:0/3984121237 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7641f55f0 con 0x7fd764073f90 2024-09-10T20:56:40.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.356+0000 7fd768a00640 1 --2- 172.21.15.6:0/3984121237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd76406e960 0x7fd76414a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:56:40.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.356+0000 7fd763e00640 1 --2- 172.21.15.6:0/3984121237 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd764073f90 0x7fd7641f50b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd750009a00 tx=0x7fd7500052f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:40.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.356+0000 7fd760c00640 1 -- 172.21.15.6:0/3984121237 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd750005cf0 con 0x7fd764073f90 2024-09-10T20:56:40.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.356+0000 7fd760c00640 1 -- 172.21.15.6:0/3984121237 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd750004320 con 0x7fd764073f90 2024-09-10T20:56:40.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.356+0000 7fd760c00640 1 -- 172.21.15.6:0/3984121237 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd750004a00 con 0x7fd764073f90 2024-09-10T20:56:40.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.356+0000 7fd769e00640 1 -- 172.21.15.6:0/3984121237 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7640b3dd0 con 0x7fd764073f90 2024-09-10T20:56:40.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.357+0000 7fd769e00640 1 -- 172.21.15.6:0/3984121237 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7640b4390 con 0x7fd764073f90 2024-09-10T20:56:40.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.357+0000 7fd769e00640 1 -- 172.21.15.6:0/3984121237 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7641600b0 con 0x7fd764073f90 2024-09-10T20:56:40.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.358+0000 7fd760c00640 1 -- 172.21.15.6:0/3984121237 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd75004c030 con 0x7fd764073f90 2024-09-10T20:56:40.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.359+0000 7fd760c00640 1 --2- 172.21.15.6:0/3984121237 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd744077f70 0x7fd74407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:40.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.360+0000 7fd760c00640 1 -- 172.21.15.6:0/3984121237 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fd7500baf30 con 0x7fd764073f90 2024-09-10T20:56:40.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.360+0000 7fd768a00640 1 --2- 172.21.15.6:0/3984121237 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd744077f70 0x7fd74407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:40.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.360+0000 7fd768a00640 1 --2- 172.21.15.6:0/3984121237 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd744077f70 0x7fd74407a430 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd758009f20 tx=0x7fd758005f90 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:40.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.365+0000 7fd760c00640 1 -- 172.21.15.6:0/3984121237 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fd7641f55f0 con 0x7fd764073f90 2024-09-10T20:56:40.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:40.595+0000 7fd769e00640 1 -- 172.21.15.6:0/3984121237 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fd76415a840 con 0x7fd764073f90 2024-09-10T20:56:41.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.166+0000 7fd760c00640 1 -- 172.21.15.6:0/3984121237 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) ==== 122+0+0 (secure 0 0 0) 0x7fd750040030 con 0x7fd764073f90 2024-09-10T20:56:41.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.168+0000 7fd769e00640 1 -- 172.21.15.6:0/3984121237 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd744077f70 msgr2=0x7fd74407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:41.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.168+0000 7fd769e00640 1 --2- 172.21.15.6:0/3984121237 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd744077f70 0x7fd74407a430 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd758009f20 tx=0x7fd758005f90 comp rx=0 tx=0).stop 2024-09-10T20:56:41.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.168+0000 7fd769e00640 1 -- 172.21.15.6:0/3984121237 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd764073f90 msgr2=0x7fd7641f50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:41.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.169+0000 7fd769e00640 1 --2- 172.21.15.6:0/3984121237 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd764073f90 0x7fd7641f50b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd750009a00 tx=0x7fd7500052f0 comp rx=0 tx=0).stop 2024-09-10T20:56:41.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.169+0000 7fd769e00640 1 -- 172.21.15.6:0/3984121237 shutdown_connections 2024-09-10T20:56:41.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.169+0000 7fd769e00640 1 --2- 172.21.15.6:0/3984121237 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd744077f70 0x7fd74407a430 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:41.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.169+0000 7fd769e00640 1 --2- 172.21.15.6:0/3984121237 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7641592f0 0x7fd7640b4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:41.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.169+0000 7fd769e00640 1 --2- 172.21.15.6:0/3984121237 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd764073f90 0x7fd7641f50b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:41.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.169+0000 7fd769e00640 1 --2- 172.21.15.6:0/3984121237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd76406e960 0x7fd76414a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:41.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.169+0000 7fd769e00640 1 -- 172.21.15.6:0/3984121237 >> 172.21.15.6:0/3984121237 conn(0x7fd76406d660 msgr2=0x7fd7640b1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:41.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.169+0000 7fd769e00640 1 -- 172.21.15.6:0/3984121237 shutdown_connections 2024-09-10T20:56:41.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.169+0000 7fd769e00640 1 -- 172.21.15.6:0/3984121237 wait complete. 2024-09-10T20:56:41.191 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T20:56:41.191 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:56:41.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.351+0000 7f4671000640 1 -- 172.21.15.6:0/1657274202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f466c0d07f0 msgr2=0x7f466c1618e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:41.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.351+0000 7f4671000640 1 --2- 172.21.15.6:0/1657274202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f466c0d07f0 0x7f466c1618e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f466c06ff50 tx=0x7f465402a4d0 comp rx=0 tx=0).stop 2024-09-10T20:56:41.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.351+0000 7f4671000640 1 -- 172.21.15.6:0/1657274202 shutdown_connections 2024-09-10T20:56:41.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.351+0000 7f4671000640 1 --2- 172.21.15.6:0/1657274202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f466c0d07f0 0x7f466c1618e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:41.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.351+0000 7f4671000640 1 --2- 172.21.15.6:0/1657274202 >> v2:172.21.15.150:3300/0 conn(0x7f466c161e20 0x7f466c0b13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:41.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.351+0000 7f4671000640 1 -- 172.21.15.6:0/1657274202 >> 172.21.15.6:0/1657274202 conn(0x7f466c0d1ae0 msgr2=0x7f466c0d1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:41.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.351+0000 7f4671000640 1 -- 172.21.15.6:0/1657274202 shutdown_connections 2024-09-10T20:56:41.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.351+0000 7f4671000640 1 -- 172.21.15.6:0/1657274202 wait complete. 2024-09-10T20:56:41.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.353+0000 7f4671000640 1 Processor -- start 2024-09-10T20:56:41.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.353+0000 7f4671000640 1 -- start start 2024-09-10T20:56:41.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.354+0000 7f4671000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f466c0d07f0 0x7f466c14cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:41.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.354+0000 7f4671000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f466c15dc80 0x7f466c0c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:41.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.354+0000 7f4671000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f466c161e20 0x7f466c0c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:41.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.354+0000 7f4671000640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f466c0cda90 con 0x7f466c0d07f0 2024-09-10T20:56:41.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.354+0000 7f4671000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f466c0cd910 con 0x7f466c15dc80 2024-09-10T20:56:41.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.354+0000 7f4671000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f466c0b1900 con 0x7f466c161e20 2024-09-10T20:56:41.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.354+0000 7f466b400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f466c0d07f0 0x7f466c14cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:41.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.354+0000 7f466b400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f466c0d07f0 0x7f466c14cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37850/0 (socket says 172.21.15.6:37850) 2024-09-10T20:56:41.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.354+0000 7f466b400640 1 -- 172.21.15.6:0/2364187542 learned_addr learned my addr 172.21.15.6:0/2364187542 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:41.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.354+0000 7f4662a00640 1 --2- 172.21.15.6:0/2364187542 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f466c15dc80 0x7f466c0c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:41.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.354+0000 7f466be00640 1 --2- 172.21.15.6:0/2364187542 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f466c161e20 0x7f466c0c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:41.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.354+0000 7f466b400640 1 -- 172.21.15.6:0/2364187542 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f466c161e20 msgr2=0x7f466c0c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:41.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.354+0000 7f466b400640 1 --2- 172.21.15.6:0/2364187542 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f466c161e20 0x7f466c0c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:41.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.354+0000 7f466b400640 1 -- 172.21.15.6:0/2364187542 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f466c15dc80 msgr2=0x7f466c0c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:41.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.354+0000 7f466b400640 1 --2- 172.21.15.6:0/2364187542 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f466c15dc80 0x7f466c0c8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:41.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.354+0000 7f466b400640 1 -- 172.21.15.6:0/2364187542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f466c1f5610 con 0x7f466c0d07f0 2024-09-10T20:56:41.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.354+0000 7f4662a00640 1 --2- 172.21.15.6:0/2364187542 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f466c15dc80 0x7f466c0c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:56:41.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.355+0000 7f466b400640 1 --2- 172.21.15.6:0/2364187542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f466c0d07f0 0x7f466c14cb70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f465c00c430 tx=0x7f465c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:41.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.355+0000 7f4663e00640 1 -- 172.21.15.6:0/2364187542 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c011790 con 0x7f466c0d07f0 2024-09-10T20:56:41.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.355+0000 7f4663e00640 1 -- 172.21.15.6:0/2364187542 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f465c017070 con 0x7f466c0d07f0 2024-09-10T20:56:41.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.355+0000 7f4663e00640 1 -- 172.21.15.6:0/2364187542 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c011d00 con 0x7f466c0d07f0 2024-09-10T20:56:41.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.355+0000 7f4671000640 1 -- 172.21.15.6:0/2364187542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f466c0cae60 con 0x7f466c0d07f0 2024-09-10T20:56:41.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.355+0000 7f4671000640 1 -- 172.21.15.6:0/2364187542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f466c0cb420 con 0x7f466c0d07f0 2024-09-10T20:56:41.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.356+0000 7f4671000640 1 -- 172.21.15.6:0/2364187542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f466c1618e0 con 0x7f466c0d07f0 2024-09-10T20:56:41.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.357+0000 7f4663e00640 1 -- 172.21.15.6:0/2364187542 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f465c01c460 con 0x7f466c0d07f0 2024-09-10T20:56:41.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.358+0000 7f4663e00640 1 --2- 172.21.15.6:0/2364187542 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4648077f70 0x7f464807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:41.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.358+0000 7f4663e00640 1 -- 172.21.15.6:0/2364187542 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f465c099cb0 con 0x7f466c0d07f0 2024-09-10T20:56:41.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.359+0000 7f4662a00640 1 --2- 172.21.15.6:0/2364187542 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4648077f70 0x7f464807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:41.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.360+0000 7f4662a00640 1 --2- 172.21.15.6:0/2364187542 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4648077f70 0x7f464807a430 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4654033000 tx=0x7f4654004730 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:41.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.362+0000 7f4663e00640 1 -- 172.21.15.6:0/2364187542 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f465c062710 con 0x7f466c0d07f0 2024-09-10T20:56:41.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.595+0000 7f4671000640 1 -- 172.21.15.6:0/2364187542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f466c070770 con 0x7f466c0d07f0 2024-09-10T20:56:41.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.595+0000 7f4663e00640 1 -- 172.21.15.6:0/2364187542 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5220 (secure 0 0 0) 0x7f465c062010 con 0x7f466c0d07f0 2024-09-10T20:56:41.599 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:56:41.600 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":17,"btime":"2024-09-10T20:56:41:162013+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1675451102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1675451102},{"type":"v1","addr":"172.21.15.6:6834","nonce":1675451102}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4924,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/676153174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":676153174},{"type":"v1","addr":"172.21.15.150:6836","nonce":676153174}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4950,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4072260905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":4072260905},{"type":"v1","addr":"172.21.15.150:6837","nonce":4072260905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:56:37.566072+0000","modified":"2024-09-10T20:56:40.597848+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4956":{"gid":4956,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/1598644433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1598644433},{"type":"v1","addr":"172.21.15.6:6835","nonce":1598644433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4956,"qdb_cluster":[4956]},"id":2}]} 2024-09-10T20:56:41.600 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 17 2024-09-10T20:56:41.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.598+0000 7f4671000640 1 -- 172.21.15.6:0/2364187542 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4648077f70 msgr2=0x7f464807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:41.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.598+0000 7f4671000640 1 --2- 172.21.15.6:0/2364187542 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4648077f70 0x7f464807a430 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4654033000 tx=0x7f4654004730 comp rx=0 tx=0).stop 2024-09-10T20:56:41.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.598+0000 7f4671000640 1 -- 172.21.15.6:0/2364187542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f466c0d07f0 msgr2=0x7f466c14cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:41.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.598+0000 7f4671000640 1 --2- 172.21.15.6:0/2364187542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f466c0d07f0 0x7f466c14cb70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f465c00c430 tx=0x7f465c00c8f0 comp rx=0 tx=0).stop 2024-09-10T20:56:41.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.598+0000 7f4671000640 1 -- 172.21.15.6:0/2364187542 shutdown_connections 2024-09-10T20:56:41.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.598+0000 7f4671000640 1 --2- 172.21.15.6:0/2364187542 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4648077f70 0x7f464807a430 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:41.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.598+0000 7f4671000640 1 --2- 172.21.15.6:0/2364187542 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f466c161e20 0x7f466c0c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:41.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.598+0000 7f4671000640 1 --2- 172.21.15.6:0/2364187542 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f466c15dc80 0x7f466c0c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:41.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.598+0000 7f4671000640 1 --2- 172.21.15.6:0/2364187542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f466c0d07f0 0x7f466c14cb70 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:41.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.598+0000 7f4671000640 1 -- 172.21.15.6:0/2364187542 >> 172.21.15.6:0/2364187542 conn(0x7f466c0d1ae0 msgr2=0x7f466c06f380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:41.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.598+0000 7f4671000640 1 -- 172.21.15.6:0/2364187542 shutdown_connections 2024-09-10T20:56:41.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.598+0000 7f4671000640 1 -- 172.21.15.6:0/2364187542 wait complete. 2024-09-10T20:56:41.618 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T20:56:41.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.773+0000 7fa3a6000640 1 -- 172.21.15.6:0/2038755674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3a0070450 msgr2=0x7fa3a00cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:41.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.773+0000 7fa3a6000640 1 --2- 172.21.15.6:0/2038755674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3a0070450 0x7fa3a00cd920 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa3a00cf5a0 tx=0x7fa39802a950 comp rx=0 tx=0).stop 2024-09-10T20:56:41.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.773+0000 7fa3a6000640 1 -- 172.21.15.6:0/2038755674 shutdown_connections 2024-09-10T20:56:41.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.773+0000 7fa3a6000640 1 --2- 172.21.15.6:0/2038755674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3a0070450 0x7fa3a00cd920 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:41.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.773+0000 7fa3a6000640 1 --2- 172.21.15.6:0/2038755674 >> v2:172.21.15.150:3300/0 conn(0x7fa3a015c170 0x7fa3a00743b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:41.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.773+0000 7fa3a6000640 1 -- 172.21.15.6:0/2038755674 >> 172.21.15.6:0/2038755674 conn(0x7fa3a00cfa20 msgr2=0x7fa3a00cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:41.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.773+0000 7fa3a6000640 1 -- 172.21.15.6:0/2038755674 shutdown_connections 2024-09-10T20:56:41.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.773+0000 7fa3a6000640 1 -- 172.21.15.6:0/2038755674 wait complete. 2024-09-10T20:56:41.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.775+0000 7fa3a6000640 1 Processor -- start 2024-09-10T20:56:41.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.775+0000 7fa3a6000640 1 -- start start 2024-09-10T20:56:41.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.776+0000 7fa3a6000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3a0070450 0x7fa3a014f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:41.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.776+0000 7fa3a6000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3a0159670 0x7fa3a015e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:41.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.776+0000 7fa3a6000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3a015c170 0x7fa3a00ad880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:41.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.776+0000 7fa3a6000640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a00b4a90 con 0x7fa3a0070450 2024-09-10T20:56:41.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.776+0000 7fa3a6000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a00b4910 con 0x7fa3a0159670 2024-09-10T20:56:41.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.776+0000 7fa3a6000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa3a00b4c10 con 0x7fa3a015c170 2024-09-10T20:56:41.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.776+0000 7fa39f400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3a0070450 0x7fa3a014f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:41.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.776+0000 7fa39f400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3a0070450 0x7fa3a014f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37878/0 (socket says 172.21.15.6:37878) 2024-09-10T20:56:41.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.776+0000 7fa39f400640 1 -- 172.21.15.6:0/898746570 learned_addr learned my addr 172.21.15.6:0/898746570 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:41.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.776+0000 7fa396a00640 1 --2- 172.21.15.6:0/898746570 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3a0159670 0x7fa3a015e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:41.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.776+0000 7fa39fe00640 1 --2- 172.21.15.6:0/898746570 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3a015c170 0x7fa3a00ad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:41.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.777+0000 7fa39f400640 1 -- 172.21.15.6:0/898746570 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3a015c170 msgr2=0x7fa3a00ad880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:41.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.777+0000 7fa39f400640 1 --2- 172.21.15.6:0/898746570 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3a015c170 0x7fa3a00ad880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:41.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.777+0000 7fa39f400640 1 -- 172.21.15.6:0/898746570 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3a0159670 msgr2=0x7fa3a015e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:41.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.777+0000 7fa39f400640 1 --2- 172.21.15.6:0/898746570 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3a0159670 0x7fa3a015e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:41.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.777+0000 7fa39f400640 1 -- 172.21.15.6:0/898746570 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3a01f8510 con 0x7fa3a0070450 2024-09-10T20:56:41.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.777+0000 7fa396a00640 1 --2- 172.21.15.6:0/898746570 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3a0159670 0x7fa3a015e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:56:41.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.777+0000 7fa39f400640 1 --2- 172.21.15.6:0/898746570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3a0070450 0x7fa3a014f140 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa39000c460 tx=0x7fa39000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:41.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.777+0000 7fa397e00640 1 -- 172.21.15.6:0/898746570 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa390016020 con 0x7fa3a0070450 2024-09-10T20:56:41.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.777+0000 7fa397e00640 1 -- 172.21.15.6:0/898746570 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa390012960 con 0x7fa3a0070450 2024-09-10T20:56:41.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.777+0000 7fa397e00640 1 -- 172.21.15.6:0/898746570 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa390012db0 con 0x7fa3a0070450 2024-09-10T20:56:41.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.777+0000 7fa3a6000640 1 -- 172.21.15.6:0/898746570 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3a01f87f0 con 0x7fa3a0070450 2024-09-10T20:56:41.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.777+0000 7fa3a6000640 1 -- 172.21.15.6:0/898746570 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3a01f8db0 con 0x7fa3a0070450 2024-09-10T20:56:41.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.778+0000 7fa3a6000640 1 -- 172.21.15.6:0/898746570 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3a00cd380 con 0x7fa3a0070450 2024-09-10T20:56:41.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.780+0000 7fa397e00640 1 -- 172.21.15.6:0/898746570 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa39001b400 con 0x7fa3a0070450 2024-09-10T20:56:41.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.780+0000 7fa397e00640 1 --2- 172.21.15.6:0/898746570 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa37c077f70 0x7fa37c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:41.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.781+0000 7fa397e00640 1 -- 172.21.15.6:0/898746570 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fa39009a0b0 con 0x7fa3a0070450 2024-09-10T20:56:41.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.781+0000 7fa396a00640 1 --2- 172.21.15.6:0/898746570 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa37c077f70 0x7fa37c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:41.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.782+0000 7fa396a00640 1 --2- 172.21.15.6:0/898746570 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa37c077f70 0x7fa37c07a430 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa3880058c0 tx=0x7fa388005850 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:41.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.784+0000 7fa397e00640 1 -- 172.21.15.6:0/898746570 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fa3a00cd380 con 0x7fa3a0070450 2024-09-10T20:56:41.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.981+0000 7fa3a6000640 1 -- 172.21.15.6:0/898746570 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa3a00b5100 con 0x7fa3a0070450 2024-09-10T20:56:41.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.982+0000 7fa397e00640 1 -- 172.21.15.6:0/898746570 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+16669 (secure 0 0 0) 0x7fa390020020 con 0x7fa3a0070450 2024-09-10T20:56:41.987 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:56:41.987 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":35,"fsid":"9e04309e-61c3-4c78-82db-9576e465d98a","created":"2024-09-10T20:55:17.972466+0000","modified":"2024-09-10T20:56:39.151749+0000","last_up_change":"2024-09-10T20:55:32.392769+0000","last_in_change":"2024-09-10T20:55:22.232252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:55:33.196464+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:56:35.128358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-10T20:56:36.534250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0918c5c8-a028-4987-bad2-406c412ec3f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6801","nonce":895515615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6803","nonce":895515615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6807","nonce":895515615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6805","nonce":895515615}]},"public_addr":"172.21.15.6:6801/895515615","cluster_addr":"172.21.15.6:6803/895515615","heartbeat_back_addr":"172.21.15.6:6807/895515615","heartbeat_front_addr":"172.21.15.6:6805/895515615","state":["exists","up"]},{"osd":1,"uuid":"415e9c78-c3d9-46d6-b277-348453f42155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6809","nonce":1129113250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6811","nonce":1129113250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6815","nonce":1129113250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6813","nonce":1129113250}]},"public_addr":"172.21.15.6:6809/1129113250","cluster_addr":"172.21.15.6:6811/1129113250","heartbeat_back_addr":"172.21.15.6:6815/1129113250","heartbeat_front_addr":"172.21.15.6:6813/1129113250","state":["exists","up"]},{"osd":2,"uuid":"763c1cf2-a43d-4c10-815d-eaf4a32afc1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6825","nonce":3847470051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6827","nonce":3847470051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6831","nonce":3847470051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6829","nonce":3847470051}]},"public_addr":"172.21.15.6:6825/3847470051","cluster_addr":"172.21.15.6:6827/3847470051","heartbeat_back_addr":"172.21.15.6:6831/3847470051","heartbeat_front_addr":"172.21.15.6:6829/3847470051","state":["exists","up"]},{"osd":3,"uuid":"877b1cc1-2434-4b32-af66-9c2485eac9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6817","nonce":3911674247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6819","nonce":3911674247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6823","nonce":3911674247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6821","nonce":3911674247}]},"public_addr":"172.21.15.6:6817/3911674247","cluster_addr":"172.21.15.6:6819/3911674247","heartbeat_back_addr":"172.21.15.6:6823/3911674247","heartbeat_front_addr":"172.21.15.6:6821/3911674247","state":["exists","up"]},{"osd":4,"uuid":"e0b27501-dfdc-4e7f-b73a-9573c869267a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6827","nonce":2568527750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6829","nonce":2568527750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6833","nonce":2568527750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6831","nonce":2568527750}]},"public_addr":"172.21.15.150:6827/2568527750","cluster_addr":"172.21.15.150:6829/2568527750","heartbeat_back_addr":"172.21.15.150:6833/2568527750","heartbeat_front_addr":"172.21.15.150:6831/2568527750","state":["exists","up"]},{"osd":5,"uuid":"67e48053-4f15-44fd-a30c-c9522f86d169","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6811","nonce":371417736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6813","nonce":371417736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6817","nonce":371417736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6815","nonce":371417736}]},"public_addr":"172.21.15.150:6811/371417736","cluster_addr":"172.21.15.150:6813/371417736","heartbeat_back_addr":"172.21.15.150:6817/371417736","heartbeat_front_addr":"172.21.15.150:6815/371417736","state":["exists","up"]},{"osd":6,"uuid":"1456df2e-ae91-45a4-bc3a-a06c753092af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6819","nonce":2329248366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6821","nonce":2329248366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6825","nonce":2329248366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6823","nonce":2329248366}]},"public_addr":"172.21.15.150:6819/2329248366","cluster_addr":"172.21.15.150:6821/2329248366","heartbeat_back_addr":"172.21.15.150:6825/2329248366","heartbeat_front_addr":"172.21.15.150:6823/2329248366","state":["exists","up"]},{"osd":7,"uuid":"a9daafcb-5ecd-43bd-ab0a-dc4b480cfc2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6803","nonce":527018351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6805","nonce":527018351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6809","nonce":527018351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6807","nonce":527018351}]},"public_addr":"172.21.15.150:6803/527018351","cluster_addr":"172.21.15.150:6805/527018351","heartbeat_back_addr":"172.21.15.150:6809/527018351","heartbeat_front_addr":"172.21.15.150:6807/527018351","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.710061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.024506+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.824320+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.431608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.637032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.054828+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.333290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.358875+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:56:41.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.985+0000 7fa3a6000640 1 -- 172.21.15.6:0/898746570 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa37c077f70 msgr2=0x7fa37c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:41.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.985+0000 7fa3a6000640 1 --2- 172.21.15.6:0/898746570 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa37c077f70 0x7fa37c07a430 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa3880058c0 tx=0x7fa388005850 comp rx=0 tx=0).stop 2024-09-10T20:56:41.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.985+0000 7fa3a6000640 1 -- 172.21.15.6:0/898746570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3a0070450 msgr2=0x7fa3a014f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:41.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.985+0000 7fa3a6000640 1 --2- 172.21.15.6:0/898746570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3a0070450 0x7fa3a014f140 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa39000c460 tx=0x7fa39000c920 comp rx=0 tx=0).stop 2024-09-10T20:56:41.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.985+0000 7fa3a6000640 1 -- 172.21.15.6:0/898746570 shutdown_connections 2024-09-10T20:56:41.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.985+0000 7fa3a6000640 1 --2- 172.21.15.6:0/898746570 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa37c077f70 0x7fa37c07a430 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:41.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.985+0000 7fa3a6000640 1 --2- 172.21.15.6:0/898746570 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3a015c170 0x7fa3a00ad880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:41.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.985+0000 7fa3a6000640 1 --2- 172.21.15.6:0/898746570 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3a0159670 0x7fa3a015e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:41.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.985+0000 7fa3a6000640 1 --2- 172.21.15.6:0/898746570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3a0070450 0x7fa3a014f140 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:41.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.985+0000 7fa3a6000640 1 -- 172.21.15.6:0/898746570 >> 172.21.15.6:0/898746570 conn(0x7fa3a00cfa20 msgr2=0x7fa3a015f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:41.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.985+0000 7fa3a6000640 1 -- 172.21.15.6:0/898746570 shutdown_connections 2024-09-10T20:56:41.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:41.985+0000 7fa3a6000640 1 -- 172.21.15.6:0/898746570 wait complete. 2024-09-10T20:56:42.005 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T20:56:42.005 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T20:56:42.104 INFO:tasks.ceph.mds.c.smithi006.stderr:2024-09-10T20:56:42.100+0000 7ff701200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T20:56:42.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.162+0000 7f91df000640 1 -- 172.21.15.6:0/520209904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91c00041c0 msgr2=0x7f91c0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:42.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.162+0000 7f91df000640 1 --2- 172.21.15.6:0/520209904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91c00041c0 0x7f91c0004800 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f91c4009b50 tx=0x7f91c0005830 comp rx=0 tx=0).stop 2024-09-10T20:56:42.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.162+0000 7f91de600640 1 -- 172.21.15.6:0/520209904 reap_dead start 2024-09-10T20:56:42.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.162+0000 7f91df000640 1 -- 172.21.15.6:0/520209904 shutdown_connections 2024-09-10T20:56:42.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.162+0000 7f91df000640 1 -- 172.21.15.6:0/520209904 >> 172.21.15.6:0/520209904 conn(0x7f91d806cf90 msgr2=0x7f91d806d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:42.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.162+0000 7f91df000640 1 -- 172.21.15.6:0/520209904 shutdown_connections 2024-09-10T20:56:42.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.162+0000 7f91df000640 1 -- 172.21.15.6:0/520209904 wait complete. 2024-09-10T20:56:42.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.164+0000 7f91df000640 1 Processor -- start 2024-09-10T20:56:42.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.164+0000 7f91df000640 1 -- start start 2024-09-10T20:56:42.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.165+0000 7f91df000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91c00041c0 0x7f91d8141270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:42.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.165+0000 7f91df000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91d81417b0 0x7f91d81441c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:42.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.165+0000 7f91df000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91d8144700 0x7f91d81f5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:42.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.165+0000 7f91df000640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f91d806e5c0 con 0x7f91d8144700 2024-09-10T20:56:42.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.165+0000 7f91df000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f91d8073490 con 0x7f91d81417b0 2024-09-10T20:56:42.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.165+0000 7f91df000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f91d806e740 con 0x7f91c00041c0 2024-09-10T20:56:42.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.165+0000 7f91de600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91d8144700 0x7f91d81f5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:42.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.165+0000 7f91de600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91d8144700 0x7f91d81f5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37898/0 (socket says 172.21.15.6:37898) 2024-09-10T20:56:42.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.165+0000 7f91de600640 1 -- 172.21.15.6:0/2883943189 learned_addr learned my addr 172.21.15.6:0/2883943189 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:42.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.166+0000 7f91de600640 1 -- 172.21.15.6:0/2883943189 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91c00041c0 msgr2=0x7f91d8141270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:42.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.166+0000 7f91de600640 1 --2- 172.21.15.6:0/2883943189 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91c00041c0 0x7f91d8141270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:42.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.166+0000 7f91de600640 1 -- 172.21.15.6:0/2883943189 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91d81417b0 msgr2=0x7f91d81441c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:42.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.166+0000 7f91de600640 1 --2- 172.21.15.6:0/2883943189 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91d81417b0 0x7f91d81441c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:42.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.166+0000 7f91de600640 1 -- 172.21.15.6:0/2883943189 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91d8153100 con 0x7f91d8144700 2024-09-10T20:56:42.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.166+0000 7f91de600640 1 --2- 172.21.15.6:0/2883943189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91d8144700 0x7f91d81f5b10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f91d8069400 tx=0x7f91d000ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:42.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.166+0000 7f91d5600640 1 -- 172.21.15.6:0/2883943189 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d0010890 con 0x7f91d8144700 2024-09-10T20:56:42.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.166+0000 7f91d5600640 1 -- 172.21.15.6:0/2883943189 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f91d0017070 con 0x7f91d8144700 2024-09-10T20:56:42.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.166+0000 7f91d5600640 1 -- 172.21.15.6:0/2883943189 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d0010e20 con 0x7f91d8144700 2024-09-10T20:56:42.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.166+0000 7f91df000640 1 -- 172.21.15.6:0/2883943189 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91d81533e0 con 0x7f91d8144700 2024-09-10T20:56:42.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.166+0000 7f91df000640 1 -- 172.21.15.6:0/2883943189 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91d81539a0 con 0x7f91d8144700 2024-09-10T20:56:42.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.168+0000 7f91df000640 1 -- 172.21.15.6:0/2883943189 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91d8141bf0 con 0x7f91d8144700 2024-09-10T20:56:42.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.170+0000 7f91d5600640 1 -- 172.21.15.6:0/2883943189 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f91d001c460 con 0x7f91d8144700 2024-09-10T20:56:42.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.171+0000 7f91d5600640 1 --2- 172.21.15.6:0/2883943189 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f91b8077fa0 0x7f91b807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:42.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.171+0000 7f91d5600640 1 -- 172.21.15.6:0/2883943189 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f91d009a0f0 con 0x7f91d8144700 2024-09-10T20:56:42.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.171+0000 7f91ddc00640 1 --2- 172.21.15.6:0/2883943189 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f91b8077fa0 0x7f91b807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:42.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.172+0000 7f91ddc00640 1 --2- 172.21.15.6:0/2883943189 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f91b8077fa0 0x7f91b807a460 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f91cc006fd0 tx=0x7f91cc0068c0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:42.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.176+0000 7f91d5600640 1 -- 172.21.15.6:0/2883943189 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f91d0062b50 con 0x7f91d8144700 2024-09-10T20:56:42.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.364+0000 7f91df000640 1 -- 172.21.15.6:0/2883943189 --> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f91d806fe20 con 0x7f91b8077fa0 2024-09-10T20:56:42.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.369+0000 7f91d5600640 1 -- 172.21.15.6:0/2883943189 <== mgr.4120 v2:172.21.15.150:6800/1238179351 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245514 (secure 0 0 0) 0x7f91d806fe20 con 0x7f91b8077fa0 2024-09-10T20:56:42.376 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:56:42.377 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-10T20:56:42.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.374+0000 7f91df000640 1 -- 172.21.15.6:0/2883943189 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f91b8077fa0 msgr2=0x7f91b807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:42.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.374+0000 7f91df000640 1 --2- 172.21.15.6:0/2883943189 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f91b8077fa0 0x7f91b807a460 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f91cc006fd0 tx=0x7f91cc0068c0 comp rx=0 tx=0).stop 2024-09-10T20:56:42.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.374+0000 7f91df000640 1 -- 172.21.15.6:0/2883943189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91d8144700 msgr2=0x7f91d81f5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:42.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.374+0000 7f91df000640 1 --2- 172.21.15.6:0/2883943189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91d8144700 0x7f91d81f5b10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f91d8069400 tx=0x7f91d000ea10 comp rx=0 tx=0).stop 2024-09-10T20:56:42.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.374+0000 7f91df000640 1 -- 172.21.15.6:0/2883943189 shutdown_connections 2024-09-10T20:56:42.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.374+0000 7f91df000640 1 --2- 172.21.15.6:0/2883943189 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f91b8077fa0 0x7f91b807a460 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:42.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.374+0000 7f91df000640 1 --2- 172.21.15.6:0/2883943189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91d8144700 0x7f91d81f5b10 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:42.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.374+0000 7f91df000640 1 --2- 172.21.15.6:0/2883943189 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91d81417b0 0x7f91d81441c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:42.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.374+0000 7f91df000640 1 --2- 172.21.15.6:0/2883943189 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91c00041c0 0x7f91d8141270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:42.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.374+0000 7f91df000640 1 -- 172.21.15.6:0/2883943189 >> 172.21.15.6:0/2883943189 conn(0x7f91d806cf90 msgr2=0x7f91d815e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:42.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.374+0000 7f91df000640 1 -- 172.21.15.6:0/2883943189 shutdown_connections 2024-09-10T20:56:42.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.374+0000 7f91df000640 1 -- 172.21.15.6:0/2883943189 wait complete. 2024-09-10T20:56:42.394 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2024-09-10T20:56:41.186051+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220172,"kb_used_data":3948,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754548,"statfs":{"total":773094113280,"available":772868657152,"internally_reserved":0,"allocated":4042752,"data_stored":2267505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.065505"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.132643+0000","last_change":"2024-09-10T20:56:37.132643+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.132643+0000","last_undegraded":"2024-09-10T20:56:37.132643+0000","last_fullsized":"2024-09-10T20:56:37.132643+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:56:37.116004+0000","last_change":"2024-09-10T20:56:37.116004+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.116004+0000","last_undegraded":"2024-09-10T20:56:37.116004+0000","last_fullsized":"2024-09-10T20:56:37.116004+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.124027+0000","last_change":"2024-09-10T20:56:37.124027+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.124027+0000","last_undegraded":"2024-09-10T20:56:37.124027+0000","last_fullsized":"2024-09-10T20:56:37.124027+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.139563+0000","last_change":"2024-09-10T20:56:37.139563+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.139563+0000","last_undegraded":"2024-09-10T20:56:37.139563+0000","last_fullsized":"2024-09-10T20:56:37.139563+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.132015+0000","last_change":"2024-09-10T20:56:37.132015+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.132015+0000","last_undegraded":"2024-09-10T20:56:37.132015+0000","last_fullsized":"2024-09-10T20:56:37.132015+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:56:37.116004+0000","last_change":"2024-09-10T20:56:37.116004+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.116004+0000","last_undegraded":"2024-09-10T20:56:37.116004+0000","last_fullsized":"2024-09-10T20:56:37.116004+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.130878+0000","last_change":"2024-09-10T20:56:37.130878+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.130878+0000","last_undegraded":"2024-09-10T20:56:37.130878+0000","last_fullsized":"2024-09-10T20:56:37.130878+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.134783+0000","last_change":"2024-09-10T20:56:37.134783+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.134783+0000","last_undegraded":"2024-09-10T20:56:37.134783+0000","last_fullsized":"2024-09-10T20:56:37.134783+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.128169+0000","last_change":"2024-09-10T20:56:37.128169+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.128169+0000","last_undegraded":"2024-09-10T20:56:37.128169+0000","last_fullsized":"2024-09-10T20:56:37.128169+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.132785+0000","last_change":"2024-09-10T20:56:37.132785+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.132785+0000","last_undegraded":"2024-09-10T20:56:37.132785+0000","last_fullsized":"2024-09-10T20:56:37.132785+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.130617+0000","last_change":"2024-09-10T20:56:37.130617+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.130617+0000","last_undegraded":"2024-09-10T20:56:37.130617+0000","last_fullsized":"2024-09-10T20:56:37.130617+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.124302+0000","last_change":"2024-09-10T20:56:37.124302+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.124302+0000","last_undegraded":"2024-09-10T20:56:37.124302+0000","last_fullsized":"2024-09-10T20:56:37.124302+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.128743+0000","last_change":"2024-09-10T20:56:37.128743+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.128743+0000","last_undegraded":"2024-09-10T20:56:37.128743+0000","last_fullsized":"2024-09-10T20:56:37.128743+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:56:37.116004+0000","last_change":"2024-09-10T20:56:37.116004+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.116004+0000","last_undegraded":"2024-09-10T20:56:37.116004+0000","last_fullsized":"2024-09-10T20:56:37.116004+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.123640+0000","last_change":"2024-09-10T20:56:37.123640+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.123640+0000","last_undegraded":"2024-09-10T20:56:37.123640+0000","last_fullsized":"2024-09-10T20:56:37.123640+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.131656+0000","last_change":"2024-09-10T20:56:37.131656+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.131656+0000","last_undegraded":"2024-09-10T20:56:37.131656+0000","last_fullsized":"2024-09-10T20:56:37.131656+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.134245+0000","last_change":"2024-09-10T20:56:37.134245+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.134245+0000","last_undegraded":"2024-09-10T20:56:37.134245+0000","last_fullsized":"2024-09-10T20:56:37.134245+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:56:37.116004+0000","last_change":"2024-09-10T20:56:37.116004+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.116004+0000","last_undegraded":"2024-09-10T20:56:37.116004+0000","last_fullsized":"2024-09-10T20:56:37.116004+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:56:37.116004+0000","last_change":"2024-09-10T20:56:37.116004+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.116004+0000","last_undegraded":"2024-09-10T20:56:37.116004+0000","last_fullsized":"2024-09-10T20:56:37.116004+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.128028+0000","last_change":"2024-09-10T20:56:37.128028+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.128028+0000","last_undegraded":"2024-09-10T20:56:37.128028+0000","last_fullsized":"2024-09-10T20:56:37.128028+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.127664+0000","last_change":"2024-09-10T20:56:37.127664+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.127664+0000","last_undegraded":"2024-09-10T20:56:37.127664+0000","last_fullsized":"2024-09-10T20:56:37.127664+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.128361+0000","last_change":"2024-09-10T20:56:37.128361+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.128361+0000","last_undegraded":"2024-09-10T20:56:37.128361+0000","last_fullsized":"2024-09-10T20:56:37.128361+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.129163+0000","last_change":"2024-09-10T20:56:37.129163+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.129163+0000","last_undegraded":"2024-09-10T20:56:37.129163+0000","last_fullsized":"2024-09-10T20:56:37.129163+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.124824+0000","last_change":"2024-09-10T20:56:37.124824+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.124824+0000","last_undegraded":"2024-09-10T20:56:37.124824+0000","last_fullsized":"2024-09-10T20:56:37.124824+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.133617+0000","last_change":"2024-09-10T20:56:37.133617+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.133617+0000","last_undegraded":"2024-09-10T20:56:37.133617+0000","last_fullsized":"2024-09-10T20:56:37.133617+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:56:37.116004+0000","last_change":"2024-09-10T20:56:37.116004+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.116004+0000","last_undegraded":"2024-09-10T20:56:37.116004+0000","last_fullsized":"2024-09-10T20:56:37.116004+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.137922+0000","last_change":"2024-09-10T20:56:37.137922+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.137922+0000","last_undegraded":"2024-09-10T20:56:37.137922+0000","last_fullsized":"2024-09-10T20:56:37.137922+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.123595+0000","last_change":"2024-09-10T20:56:37.123595+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.123595+0000","last_undegraded":"2024-09-10T20:56:37.123595+0000","last_fullsized":"2024-09-10T20:56:37.123595+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.127201+0000","last_change":"2024-09-10T20:56:37.127201+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.127201+0000","last_undegraded":"2024-09-10T20:56:37.127201+0000","last_fullsized":"2024-09-10T20:56:37.127201+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.134131+0000","last_change":"2024-09-10T20:56:37.134131+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.134131+0000","last_undegraded":"2024-09-10T20:56:37.134131+0000","last_fullsized":"2024-09-10T20:56:37.134131+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.132776+0000","last_change":"2024-09-10T20:56:37.132776+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.132776+0000","last_undegraded":"2024-09-10T20:56:37.132776+0000","last_fullsized":"2024-09-10T20:56:37.132776+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.133871+0000","last_change":"2024-09-10T20:56:37.133871+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.133871+0000","last_undegraded":"2024-09-10T20:56:37.133871+0000","last_fullsized":"2024-09-10T20:56:37.133871+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.130856+0000","last_change":"2024-09-10T20:56:37.130856+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.130856+0000","last_undegraded":"2024-09-10T20:56:37.130856+0000","last_fullsized":"2024-09-10T20:56:37.130856+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.151482+0000","last_change":"2024-09-10T20:56:37.146191+0000","last_active":"2024-09-10T20:56:37.151482+0000","last_peered":"2024-09-10T20:56:37.151482+0000","last_clean":"2024-09-10T20:56:37.151482+0000","last_became_active":"2024-09-10T20:56:37.145878+0000","last_became_peered":"2024-09-10T20:56:37.145878+0000","last_unstale":"2024-09-10T20:56:37.151482+0000","last_undegraded":"2024-09-10T20:56:37.151482+0000","last_fullsized":"2024-09-10T20:56:37.151482+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:16:52.517767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.132148+0000","last_change":"2024-09-10T20:56:37.132148+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.132148+0000","last_undegraded":"2024-09-10T20:56:37.132148+0000","last_fullsized":"2024-09-10T20:56:37.132148+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.142378+0000","last_change":"2024-09-10T20:56:37.140973+0000","last_active":"2024-09-10T20:56:37.142378+0000","last_peered":"2024-09-10T20:56:37.142378+0000","last_clean":"2024-09-10T20:56:37.142378+0000","last_became_active":"2024-09-10T20:56:37.140621+0000","last_became_peered":"2024-09-10T20:56:37.140621+0000","last_unstale":"2024-09-10T20:56:37.142378+0000","last_undegraded":"2024-09-10T20:56:37.142378+0000","last_fullsized":"2024-09-10T20:56:37.142378+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:24:50.372283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.126671+0000","last_change":"2024-09-10T20:56:37.126671+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.126671+0000","last_undegraded":"2024-09-10T20:56:37.126671+0000","last_fullsized":"2024-09-10T20:56:37.126671+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-10T20:56:36.125256+0000","last_change":"2024-09-10T20:56:36.125256+0000","last_active":"2024-09-10T20:56:36.107458+0000","last_peered":"2024-09-10T20:56:36.107458+0000","last_clean":"2024-09-10T20:56:36.107458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:36.125256+0000","last_undegraded":"2024-09-10T20:56:36.125256+0000","last_fullsized":"2024-09-10T20:56:36.125256+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.136333+0000","last_change":"2024-09-10T20:56:37.136333+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.136333+0000","last_undegraded":"2024-09-10T20:56:37.136333+0000","last_fullsized":"2024-09-10T20:56:37.136333+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.143448+0000","last_change":"2024-09-10T20:56:37.141690+0000","last_active":"2024-09-10T20:56:37.143448+0000","last_peered":"2024-09-10T20:56:37.143448+0000","last_clean":"2024-09-10T20:56:37.143448+0000","last_became_active":"2024-09-10T20:56:37.141098+0000","last_became_peered":"2024-09-10T20:56:37.141098+0000","last_unstale":"2024-09-10T20:56:37.143448+0000","last_undegraded":"2024-09-10T20:56:37.143448+0000","last_fullsized":"2024-09-10T20:56:37.143448+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:01:02.644529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.130010+0000","last_change":"2024-09-10T20:56:37.130010+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.130010+0000","last_undegraded":"2024-09-10T20:56:37.130010+0000","last_fullsized":"2024-09-10T20:56:37.130010+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.145227+0000","last_change":"2024-09-10T20:56:37.142809+0000","last_active":"2024-09-10T20:56:37.145227+0000","last_peered":"2024-09-10T20:56:37.145227+0000","last_clean":"2024-09-10T20:56:37.145227+0000","last_became_active":"2024-09-10T20:56:37.142502+0000","last_became_peered":"2024-09-10T20:56:37.142502+0000","last_unstale":"2024-09-10T20:56:37.145227+0000","last_undegraded":"2024-09-10T20:56:37.145227+0000","last_fullsized":"2024-09-10T20:56:37.145227+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:55:50.305233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.124133+0000","last_change":"2024-09-10T20:56:37.124133+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.124133+0000","last_undegraded":"2024-09-10T20:56:37.124133+0000","last_fullsized":"2024-09-10T20:56:37.124133+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.141477+0000","last_change":"2024-09-10T20:56:37.138322+0000","last_active":"2024-09-10T20:56:37.141477+0000","last_peered":"2024-09-10T20:56:37.141477+0000","last_clean":"2024-09-10T20:56:37.141477+0000","last_became_active":"2024-09-10T20:56:37.138056+0000","last_became_peered":"2024-09-10T20:56:37.138056+0000","last_unstale":"2024-09-10T20:56:37.141477+0000","last_undegraded":"2024-09-10T20:56:37.141477+0000","last_fullsized":"2024-09-10T20:56:37.141477+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:05.932753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.125628+0000","last_change":"2024-09-10T20:56:37.125628+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.125628+0000","last_undegraded":"2024-09-10T20:56:37.125628+0000","last_fullsized":"2024-09-10T20:56:37.125628+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-10T20:56:36.125367+0000","last_change":"2024-09-10T20:56:36.125367+0000","last_active":"2024-09-10T20:56:36.107458+0000","last_peered":"2024-09-10T20:56:36.107458+0000","last_clean":"2024-09-10T20:56:36.107458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:36.125367+0000","last_undegraded":"2024-09-10T20:56:36.125367+0000","last_fullsized":"2024-09-10T20:56:36.125367+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.138442+0000","last_change":"2024-09-10T20:56:37.138442+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.138442+0000","last_undegraded":"2024-09-10T20:56:37.138442+0000","last_fullsized":"2024-09-10T20:56:37.138442+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.139776+0000","last_change":"2024-09-10T20:56:37.137604+0000","last_active":"2024-09-10T20:56:37.139776+0000","last_peered":"2024-09-10T20:56:37.139776+0000","last_clean":"2024-09-10T20:56:37.139776+0000","last_became_active":"2024-09-10T20:56:37.136277+0000","last_became_peered":"2024-09-10T20:56:37.136277+0000","last_unstale":"2024-09-10T20:56:37.139776+0000","last_undegraded":"2024-09-10T20:56:37.139776+0000","last_fullsized":"2024-09-10T20:56:37.139776+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:19:42.035866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.125416+0000","last_change":"2024-09-10T20:56:37.125416+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.125416+0000","last_undegraded":"2024-09-10T20:56:37.125416+0000","last_fullsized":"2024-09-10T20:56:37.125416+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-10T20:56:36.126515+0000","last_change":"2024-09-10T20:56:36.126515+0000","last_active":"2024-09-10T20:56:36.107458+0000","last_peered":"2024-09-10T20:56:36.107458+0000","last_clean":"2024-09-10T20:56:36.107458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:36.126515+0000","last_undegraded":"2024-09-10T20:56:36.126515+0000","last_fullsized":"2024-09-10T20:56:36.126515+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:56:37.116004+0000","last_change":"2024-09-10T20:56:37.116004+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.116004+0000","last_undegraded":"2024-09-10T20:56:37.116004+0000","last_fullsized":"2024-09-10T20:56:37.116004+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.155002+0000","last_change":"2024-09-10T20:56:37.151835+0000","last_active":"2024-09-10T20:56:37.155002+0000","last_peered":"2024-09-10T20:56:37.155002+0000","last_clean":"2024-09-10T20:56:37.155002+0000","last_became_active":"2024-09-10T20:56:37.151520+0000","last_became_peered":"2024-09-10T20:56:37.151520+0000","last_unstale":"2024-09-10T20:56:37.155002+0000","last_undegraded":"2024-09-10T20:56:37.155002+0000","last_fullsized":"2024-09-10T20:56:37.155002+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:44:03.145368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:56:37.116004+0000","last_change":"2024-09-10T20:56:37.116004+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.116004+0000","last_undegraded":"2024-09-10T20:56:37.116004+0000","last_fullsized":"2024-09-10T20:56:37.116004+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.145150+0000","last_change":"2024-09-10T20:56:37.137553+0000","last_active":"2024-09-10T20:56:37.145150+0000","last_peered":"2024-09-10T20:56:37.145150+0000","last_clean":"2024-09-10T20:56:37.145150+0000","last_became_active":"2024-09-10T20:56:37.137268+0000","last_became_peered":"2024-09-10T20:56:37.137268+0000","last_unstale":"2024-09-10T20:56:37.145150+0000","last_undegraded":"2024-09-10T20:56:37.145150+0000","last_fullsized":"2024-09-10T20:56:37.145150+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:09:21.218563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.124714+0000","last_change":"2024-09-10T20:56:37.124714+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.124714+0000","last_undegraded":"2024-09-10T20:56:37.124714+0000","last_fullsized":"2024-09-10T20:56:37.124714+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-10T20:56:36.126193+0000","last_change":"2024-09-10T20:56:36.126193+0000","last_active":"2024-09-10T20:56:36.107458+0000","last_peered":"2024-09-10T20:56:36.107458+0000","last_clean":"2024-09-10T20:56:36.107458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:36.126193+0000","last_undegraded":"2024-09-10T20:56:36.126193+0000","last_fullsized":"2024-09-10T20:56:36.126193+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.133717+0000","last_change":"2024-09-10T20:56:37.133717+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.133717+0000","last_undegraded":"2024-09-10T20:56:37.133717+0000","last_fullsized":"2024-09-10T20:56:37.133717+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.141918+0000","last_change":"2024-09-10T20:56:37.137520+0000","last_active":"2024-09-10T20:56:37.141918+0000","last_peered":"2024-09-10T20:56:37.141918+0000","last_clean":"2024-09-10T20:56:37.141918+0000","last_became_active":"2024-09-10T20:56:37.136605+0000","last_became_peered":"2024-09-10T20:56:37.136605+0000","last_unstale":"2024-09-10T20:56:37.141918+0000","last_undegraded":"2024-09-10T20:56:37.141918+0000","last_fullsized":"2024-09-10T20:56:37.141918+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:55:46.867274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:56:37.116004+0000","last_change":"2024-09-10T20:56:37.116004+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.116004+0000","last_undegraded":"2024-09-10T20:56:37.116004+0000","last_fullsized":"2024-09-10T20:56:37.116004+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.146794+0000","last_change":"2024-09-10T20:56:37.143926+0000","last_active":"2024-09-10T20:56:37.146794+0000","last_peered":"2024-09-10T20:56:37.146794+0000","last_clean":"2024-09-10T20:56:37.146794+0000","last_became_active":"2024-09-10T20:56:37.143615+0000","last_became_peered":"2024-09-10T20:56:37.143615+0000","last_unstale":"2024-09-10T20:56:37.146794+0000","last_undegraded":"2024-09-10T20:56:37.146794+0000","last_fullsized":"2024-09-10T20:56:37.146794+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:32:50.958886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.133467+0000","last_change":"2024-09-10T20:56:37.133467+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.133467+0000","last_undegraded":"2024-09-10T20:56:37.133467+0000","last_fullsized":"2024-09-10T20:56:37.133467+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-10T20:56:36.124665+0000","last_change":"2024-09-10T20:56:36.124665+0000","last_active":"2024-09-10T20:56:36.107458+0000","last_peered":"2024-09-10T20:56:36.107458+0000","last_clean":"2024-09-10T20:56:36.107458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:36.124665+0000","last_undegraded":"2024-09-10T20:56:36.124665+0000","last_fullsized":"2024-09-10T20:56:36.124665+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.129239+0000","last_change":"2024-09-10T20:56:37.129239+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.129239+0000","last_undegraded":"2024-09-10T20:56:37.129239+0000","last_fullsized":"2024-09-10T20:56:37.129239+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-10T20:56:36.125393+0000","last_change":"2024-09-10T20:56:36.125393+0000","last_active":"2024-09-10T20:56:36.107458+0000","last_peered":"2024-09-10T20:56:36.107458+0000","last_clean":"2024-09-10T20:56:36.107458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:36.125393+0000","last_undegraded":"2024-09-10T20:56:36.125393+0000","last_fullsized":"2024-09-10T20:56:36.125393+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.126205+0000","last_change":"2024-09-10T20:56:37.126205+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.126205+0000","last_undegraded":"2024-09-10T20:56:37.126205+0000","last_fullsized":"2024-09-10T20:56:37.126205+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.147170+0000","last_change":"2024-09-10T20:56:37.144780+0000","last_active":"2024-09-10T20:56:37.147170+0000","last_peered":"2024-09-10T20:56:37.147170+0000","last_clean":"2024-09-10T20:56:37.147170+0000","last_became_active":"2024-09-10T20:56:37.144525+0000","last_became_peered":"2024-09-10T20:56:37.144525+0000","last_unstale":"2024-09-10T20:56:37.147170+0000","last_undegraded":"2024-09-10T20:56:37.147170+0000","last_fullsized":"2024-09-10T20:56:37.147170+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:56.606141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.124883+0000","last_change":"2024-09-10T20:56:37.124883+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.124883+0000","last_undegraded":"2024-09-10T20:56:37.124883+0000","last_fullsized":"2024-09-10T20:56:37.124883+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.142245+0000","last_change":"2024-09-10T20:56:37.140328+0000","last_active":"2024-09-10T20:56:37.142245+0000","last_peered":"2024-09-10T20:56:37.142245+0000","last_clean":"2024-09-10T20:56:37.142245+0000","last_became_active":"2024-09-10T20:56:37.139983+0000","last_became_peered":"2024-09-10T20:56:37.139983+0000","last_unstale":"2024-09-10T20:56:37.142245+0000","last_undegraded":"2024-09-10T20:56:37.142245+0000","last_fullsized":"2024-09-10T20:56:37.142245+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:49.886280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.135063+0000","last_change":"2024-09-10T20:56:37.135063+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.135063+0000","last_undegraded":"2024-09-10T20:56:37.135063+0000","last_fullsized":"2024-09-10T20:56:37.135063+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.142364+0000","last_change":"2024-09-10T20:56:37.140465+0000","last_active":"2024-09-10T20:56:37.142364+0000","last_peered":"2024-09-10T20:56:37.142364+0000","last_clean":"2024-09-10T20:56:37.142364+0000","last_became_active":"2024-09-10T20:56:37.139201+0000","last_became_peered":"2024-09-10T20:56:37.139201+0000","last_unstale":"2024-09-10T20:56:37.142364+0000","last_undegraded":"2024-09-10T20:56:37.142364+0000","last_fullsized":"2024-09-10T20:56:37.142364+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:27:18.667139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.130430+0000","last_change":"2024-09-10T20:56:37.130430+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.130430+0000","last_undegraded":"2024-09-10T20:56:37.130430+0000","last_fullsized":"2024-09-10T20:56:37.130430+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.145049+0000","last_change":"2024-09-10T20:56:37.142632+0000","last_active":"2024-09-10T20:56:37.145049+0000","last_peered":"2024-09-10T20:56:37.145049+0000","last_clean":"2024-09-10T20:56:37.145049+0000","last_became_active":"2024-09-10T20:56:37.141122+0000","last_became_peered":"2024-09-10T20:56:37.141122+0000","last_unstale":"2024-09-10T20:56:37.145049+0000","last_undegraded":"2024-09-10T20:56:37.145049+0000","last_fullsized":"2024-09-10T20:56:37.145049+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:39:25.053576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.127959+0000","last_change":"2024-09-10T20:56:37.127959+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.127959+0000","last_undegraded":"2024-09-10T20:56:37.127959+0000","last_fullsized":"2024-09-10T20:56:37.127959+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.151581+0000","last_change":"2024-09-10T20:56:37.149392+0000","last_active":"2024-09-10T20:56:37.151581+0000","last_peered":"2024-09-10T20:56:37.151581+0000","last_clean":"2024-09-10T20:56:37.151581+0000","last_became_active":"2024-09-10T20:56:37.148872+0000","last_became_peered":"2024-09-10T20:56:37.148872+0000","last_unstale":"2024-09-10T20:56:37.151581+0000","last_undegraded":"2024-09-10T20:56:37.151581+0000","last_fullsized":"2024-09-10T20:56:37.151581+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:32:47.911940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.128300+0000","last_change":"2024-09-10T20:56:37.128300+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.128300+0000","last_undegraded":"2024-09-10T20:56:37.128300+0000","last_fullsized":"2024-09-10T20:56:37.128300+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.151513+0000","last_change":"2024-09-10T20:56:37.147505+0000","last_active":"2024-09-10T20:56:37.151513+0000","last_peered":"2024-09-10T20:56:37.151513+0000","last_clean":"2024-09-10T20:56:37.151513+0000","last_became_active":"2024-09-10T20:56:37.147242+0000","last_became_peered":"2024-09-10T20:56:37.147242+0000","last_unstale":"2024-09-10T20:56:37.151513+0000","last_undegraded":"2024-09-10T20:56:37.151513+0000","last_fullsized":"2024-09-10T20:56:37.151513+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:22:03.323752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.127971+0000","last_change":"2024-09-10T20:56:37.127971+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.127971+0000","last_undegraded":"2024-09-10T20:56:37.127971+0000","last_fullsized":"2024-09-10T20:56:37.127971+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.144987+0000","last_change":"2024-09-10T20:56:37.142604+0000","last_active":"2024-09-10T20:56:37.144987+0000","last_peered":"2024-09-10T20:56:37.144987+0000","last_clean":"2024-09-10T20:56:37.144987+0000","last_became_active":"2024-09-10T20:56:37.142340+0000","last_became_peered":"2024-09-10T20:56:37.142340+0000","last_unstale":"2024-09-10T20:56:37.144987+0000","last_undegraded":"2024-09-10T20:56:37.144987+0000","last_fullsized":"2024-09-10T20:56:37.144987+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:00:29.173140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.132037+0000","last_change":"2024-09-10T20:56:37.132037+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.132037+0000","last_undegraded":"2024-09-10T20:56:37.132037+0000","last_fullsized":"2024-09-10T20:56:37.132037+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.145228+0000","last_change":"2024-09-10T20:56:37.141051+0000","last_active":"2024-09-10T20:56:37.145228+0000","last_peered":"2024-09-10T20:56:37.145228+0000","last_clean":"2024-09-10T20:56:37.145228+0000","last_became_active":"2024-09-10T20:56:37.140705+0000","last_became_peered":"2024-09-10T20:56:37.140705+0000","last_unstale":"2024-09-10T20:56:37.145228+0000","last_undegraded":"2024-09-10T20:56:37.145228+0000","last_fullsized":"2024-09-10T20:56:37.145228+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:46:12.680205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.129290+0000","last_change":"2024-09-10T20:56:37.129290+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.129290+0000","last_undegraded":"2024-09-10T20:56:37.129290+0000","last_fullsized":"2024-09-10T20:56:37.129290+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.152216+0000","last_change":"2024-09-10T20:56:37.150166+0000","last_active":"2024-09-10T20:56:37.152216+0000","last_peered":"2024-09-10T20:56:37.152216+0000","last_clean":"2024-09-10T20:56:37.152216+0000","last_became_active":"2024-09-10T20:56:37.149784+0000","last_became_peered":"2024-09-10T20:56:37.149784+0000","last_unstale":"2024-09-10T20:56:37.152216+0000","last_undegraded":"2024-09-10T20:56:37.152216+0000","last_fullsized":"2024-09-10T20:56:37.152216+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:12.264819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.124378+0000","last_change":"2024-09-10T20:56:37.124378+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.124378+0000","last_undegraded":"2024-09-10T20:56:37.124378+0000","last_fullsized":"2024-09-10T20:56:37.124378+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.149331+0000","last_change":"2024-09-10T20:56:37.144142+0000","last_active":"2024-09-10T20:56:37.149331+0000","last_peered":"2024-09-10T20:56:37.149331+0000","last_clean":"2024-09-10T20:56:37.149331+0000","last_became_active":"2024-09-10T20:56:37.143835+0000","last_became_peered":"2024-09-10T20:56:37.143835+0000","last_unstale":"2024-09-10T20:56:37.149331+0000","last_undegraded":"2024-09-10T20:56:37.149331+0000","last_fullsized":"2024-09-10T20:56:37.149331+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:16:52.517767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.131275+0000","last_change":"2024-09-10T20:56:37.131275+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.131275+0000","last_undegraded":"2024-09-10T20:56:37.131275+0000","last_fullsized":"2024-09-10T20:56:37.131275+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.146937+0000","last_change":"2024-09-10T20:56:37.141713+0000","last_active":"2024-09-10T20:56:37.146937+0000","last_peered":"2024-09-10T20:56:37.146937+0000","last_clean":"2024-09-10T20:56:37.146937+0000","last_became_active":"2024-09-10T20:56:37.141385+0000","last_became_peered":"2024-09-10T20:56:37.141385+0000","last_unstale":"2024-09-10T20:56:37.146937+0000","last_undegraded":"2024-09-10T20:56:37.146937+0000","last_fullsized":"2024-09-10T20:56:37.146937+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:56:35.375133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.131721+0000","last_change":"2024-09-10T20:56:37.131721+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.131721+0000","last_undegraded":"2024-09-10T20:56:37.131721+0000","last_fullsized":"2024-09-10T20:56:37.131721+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.148239+0000","last_change":"2024-09-10T20:56:37.147085+0000","last_active":"2024-09-10T20:56:37.148239+0000","last_peered":"2024-09-10T20:56:37.148239+0000","last_clean":"2024-09-10T20:56:37.148239+0000","last_became_active":"2024-09-10T20:56:37.146431+0000","last_became_peered":"2024-09-10T20:56:37.146431+0000","last_unstale":"2024-09-10T20:56:37.148239+0000","last_undegraded":"2024-09-10T20:56:37.148239+0000","last_fullsized":"2024-09-10T20:56:37.148239+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:22:03.323752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.130861+0000","last_change":"2024-09-10T20:56:37.130861+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.130861+0000","last_undegraded":"2024-09-10T20:56:37.130861+0000","last_fullsized":"2024-09-10T20:56:37.130861+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.152379+0000","last_change":"2024-09-10T20:56:37.150585+0000","last_active":"2024-09-10T20:56:37.152379+0000","last_peered":"2024-09-10T20:56:37.152379+0000","last_clean":"2024-09-10T20:56:37.152379+0000","last_became_active":"2024-09-10T20:56:37.149813+0000","last_became_peered":"2024-09-10T20:56:37.149813+0000","last_unstale":"2024-09-10T20:56:37.152379+0000","last_undegraded":"2024-09-10T20:56:37.152379+0000","last_fullsized":"2024-09-10T20:56:37.152379+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:37:14.449011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:56:37.116004+0000","last_change":"2024-09-10T20:56:37.116004+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.116004+0000","last_undegraded":"2024-09-10T20:56:37.116004+0000","last_fullsized":"2024-09-10T20:56:37.116004+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.134678+0000","last_change":"2024-09-10T20:56:37.132028+0000","last_active":"2024-09-10T20:56:37.134678+0000","last_peered":"2024-09-10T20:56:37.134678+0000","last_clean":"2024-09-10T20:56:37.134678+0000","last_became_active":"2024-09-10T20:56:37.131705+0000","last_became_peered":"2024-09-10T20:56:37.131705+0000","last_unstale":"2024-09-10T20:56:37.134678+0000","last_undegraded":"2024-09-10T20:56:37.134678+0000","last_fullsized":"2024-09-10T20:56:37.134678+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:41:34.738091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.126679+0000","last_change":"2024-09-10T20:56:37.126679+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.126679+0000","last_undegraded":"2024-09-10T20:56:37.126679+0000","last_fullsized":"2024-09-10T20:56:37.126679+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-10T20:56:36.124748+0000","last_change":"2024-09-10T20:56:36.124748+0000","last_active":"2024-09-10T20:56:36.107458+0000","last_peered":"2024-09-10T20:56:36.107458+0000","last_clean":"2024-09-10T20:56:36.107458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:36.124748+0000","last_undegraded":"2024-09-10T20:56:36.124748+0000","last_fullsized":"2024-09-10T20:56:36.124748+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.129944+0000","last_change":"2024-09-10T20:56:37.129944+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.129944+0000","last_undegraded":"2024-09-10T20:56:37.129944+0000","last_fullsized":"2024-09-10T20:56:37.129944+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.141767+0000","last_change":"2024-09-10T20:56:37.139551+0000","last_active":"2024-09-10T20:56:37.141767+0000","last_peered":"2024-09-10T20:56:37.141767+0000","last_clean":"2024-09-10T20:56:37.141767+0000","last_became_active":"2024-09-10T20:56:37.139252+0000","last_became_peered":"2024-09-10T20:56:37.139252+0000","last_unstale":"2024-09-10T20:56:37.141767+0000","last_undegraded":"2024-09-10T20:56:37.141767+0000","last_fullsized":"2024-09-10T20:56:37.141767+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:24:50.372283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":130,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.135291+0000","last_change":"2024-09-10T20:55:34.718784+0000","last_active":"2024-09-10T20:56:37.135291+0000","last_peered":"2024-09-10T20:56:37.135291+0000","last_clean":"2024-09-10T20:56:37.135291+0000","last_became_active":"2024-09-10T20:55:34.717616+0000","last_became_peered":"2024-09-10T20:55:34.717616+0000","last_unstale":"2024-09-10T20:56:37.135291+0000","last_undegraded":"2024-09-10T20:56:37.135291+0000","last_fullsized":"2024-09-10T20:56:37.135291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:33.618098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:33.618098+0000","last_clean_scrub_stamp":"2024-09-10T20:55:33.618098+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:17.442729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":108,"acting":108,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":958464,"data_stored":730131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":364544,"data_stored":139763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509456,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":133496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":133496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":133496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":364544,"data_stored":139763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":946176,"data_stored":723864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542160,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":133496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T20:56:42.399 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T20:56:42.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.591+0000 7ff518400640 1 -- 172.21.15.6:0/2177343612 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5100cf340 msgr2=0x7ff510161a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:42.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.591+0000 7ff518400640 1 --2- 172.21.15.6:0/2177343612 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5100cf340 0x7ff510161a20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc009830 tx=0x7ff4fc02a510 comp rx=0 tx=0).stop 2024-09-10T20:56:42.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.591+0000 7ff518400640 1 -- 172.21.15.6:0/2177343612 shutdown_connections 2024-09-10T20:56:42.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.591+0000 7ff518400640 1 --2- 172.21.15.6:0/2177343612 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff510161f60 0x7ff5100ad880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:42.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.592+0000 7ff518400640 1 --2- 172.21.15.6:0/2177343612 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5100cf340 0x7ff510161a20 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:42.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.592+0000 7ff518400640 1 -- 172.21.15.6:0/2177343612 >> 172.21.15.6:0/2177343612 conn(0x7ff5100cfa20 msgr2=0x7ff5100cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:42.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.592+0000 7ff518400640 1 -- 172.21.15.6:0/2177343612 shutdown_connections 2024-09-10T20:56:42.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.592+0000 7ff518400640 1 -- 172.21.15.6:0/2177343612 wait complete. 2024-09-10T20:56:42.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.593+0000 7ff518400640 1 Processor -- start 2024-09-10T20:56:42.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.593+0000 7ff518400640 1 -- start start 2024-09-10T20:56:42.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.594+0000 7ff518400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5100cf340 0x7ff51006f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:42.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.594+0000 7ff518400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff51015bb30 0x7ff5100b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:42.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.594+0000 7ff518400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff510161f60 0x7ff510158b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:42.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.594+0000 7ff518400640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff5100ae150 con 0x7ff5100cf340 2024-09-10T20:56:42.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.594+0000 7ff518400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff5100adfd0 con 0x7ff510161f60 2024-09-10T20:56:42.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.594+0000 7ff518400640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ff5100ae2d0 con 0x7ff51015bb30 2024-09-10T20:56:42.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.595+0000 7ff515a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5100cf340 0x7ff51006f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:42.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.595+0000 7ff515a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5100cf340 0x7ff51006f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37912/0 (socket says 172.21.15.6:37912) 2024-09-10T20:56:42.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.595+0000 7ff515a00640 1 -- 172.21.15.6:0/4168105748 learned_addr learned my addr 172.21.15.6:0/4168105748 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:42.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.595+0000 7ff516400640 1 --2- 172.21.15.6:0/4168105748 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff510161f60 0x7ff510158b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:42.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.595+0000 7ff515000640 1 --2- 172.21.15.6:0/4168105748 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff51015bb30 0x7ff5100b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:42.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.595+0000 7ff515a00640 1 -- 172.21.15.6:0/4168105748 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff51015bb30 msgr2=0x7ff5100b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:42.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.595+0000 7ff515a00640 1 --2- 172.21.15.6:0/4168105748 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff51015bb30 0x7ff5100b4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:42.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.595+0000 7ff515a00640 1 -- 172.21.15.6:0/4168105748 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff510161f60 msgr2=0x7ff510158b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:42.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.595+0000 7ff515a00640 1 --2- 172.21.15.6:0/4168105748 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff510161f60 0x7ff510158b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:42.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.595+0000 7ff515a00640 1 -- 172.21.15.6:0/4168105748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5100b4ad0 con 0x7ff5100cf340 2024-09-10T20:56:42.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.595+0000 7ff516400640 1 --2- 172.21.15.6:0/4168105748 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff510161f60 0x7ff510158b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:56:42.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.595+0000 7ff515a00640 1 --2- 172.21.15.6:0/4168105748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5100cf340 0x7ff51006f260 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff50400c480 tx=0x7ff50400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:42.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.596+0000 7ff50d600640 1 -- 172.21.15.6:0/4168105748 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5040052d0 con 0x7ff5100cf340 2024-09-10T20:56:42.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.596+0000 7ff50d600640 1 -- 172.21.15.6:0/4168105748 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff504005470 con 0x7ff5100cf340 2024-09-10T20:56:42.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.596+0000 7ff518400640 1 -- 172.21.15.6:0/4168105748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5100b4db0 con 0x7ff5100cf340 2024-09-10T20:56:42.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.596+0000 7ff50d600640 1 -- 172.21.15.6:0/4168105748 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff504012870 con 0x7ff5100cf340 2024-09-10T20:56:42.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.596+0000 7ff518400640 1 -- 172.21.15.6:0/4168105748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5101f81d0 con 0x7ff5100cf340 2024-09-10T20:56:42.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.597+0000 7ff518400640 1 -- 172.21.15.6:0/4168105748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff510050ee0 con 0x7ff5100cf340 2024-09-10T20:56:42.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.598+0000 7ff50d600640 1 -- 172.21.15.6:0/4168105748 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff5040035f0 con 0x7ff5100cf340 2024-09-10T20:56:42.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.599+0000 7ff50d600640 1 --2- 172.21.15.6:0/4168105748 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ff4f0077f70 0x7ff4f007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:42.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.599+0000 7ff50d600640 1 -- 172.21.15.6:0/4168105748 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7ff504099990 con 0x7ff5100cf340 2024-09-10T20:56:42.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.599+0000 7ff515000640 1 --2- 172.21.15.6:0/4168105748 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ff4f0077f70 0x7ff4f007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:42.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.600+0000 7ff515000640 1 --2- 172.21.15.6:0/4168105748 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ff4f0077f70 0x7ff4f007a430 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc034000 tx=0x7ff4fc004730 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:42.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.603+0000 7ff50d600640 1 -- 172.21.15.6:0/4168105748 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff510050ee0 con 0x7ff5100cf340 2024-09-10T20:56:42.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.792+0000 7ff518400640 1 -- 172.21.15.6:0/4168105748 --> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff5100c30f0 con 0x7ff4f0077f70 2024-09-10T20:56:42.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.797+0000 7ff50d600640 1 -- 172.21.15.6:0/4168105748 <== mgr.4120 v2:172.21.15.150:6800/1238179351 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245514 (secure 0 0 0) 0x7ff5100c30f0 con 0x7ff4f0077f70 2024-09-10T20:56:42.803 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:56:42.804 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-10T20:56:42.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.801+0000 7ff518400640 1 -- 172.21.15.6:0/4168105748 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ff4f0077f70 msgr2=0x7ff4f007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:42.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.801+0000 7ff518400640 1 --2- 172.21.15.6:0/4168105748 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ff4f0077f70 0x7ff4f007a430 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc034000 tx=0x7ff4fc004730 comp rx=0 tx=0).stop 2024-09-10T20:56:42.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.801+0000 7ff518400640 1 -- 172.21.15.6:0/4168105748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5100cf340 msgr2=0x7ff51006f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:42.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.801+0000 7ff518400640 1 --2- 172.21.15.6:0/4168105748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5100cf340 0x7ff51006f260 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff50400c480 tx=0x7ff50400c940 comp rx=0 tx=0).stop 2024-09-10T20:56:42.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.801+0000 7ff518400640 1 -- 172.21.15.6:0/4168105748 shutdown_connections 2024-09-10T20:56:42.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.801+0000 7ff518400640 1 --2- 172.21.15.6:0/4168105748 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ff4f0077f70 0x7ff4f007a430 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:42.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.801+0000 7ff518400640 1 --2- 172.21.15.6:0/4168105748 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff510161f60 0x7ff510158b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:42.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.801+0000 7ff518400640 1 --2- 172.21.15.6:0/4168105748 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff51015bb30 0x7ff5100b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:42.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.801+0000 7ff518400640 1 --2- 172.21.15.6:0/4168105748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5100cf340 0x7ff51006f260 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:42.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.801+0000 7ff518400640 1 -- 172.21.15.6:0/4168105748 >> 172.21.15.6:0/4168105748 conn(0x7ff5100cfa20 msgr2=0x7ff510073270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:42.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.801+0000 7ff518400640 1 -- 172.21.15.6:0/4168105748 shutdown_connections 2024-09-10T20:56:42.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:42.801+0000 7ff518400640 1 -- 172.21.15.6:0/4168105748 wait complete. 2024-09-10T20:56:42.821 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2024-09-10T20:56:41.186051+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220172,"kb_used_data":3948,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754548,"statfs":{"total":773094113280,"available":772868657152,"internally_reserved":0,"allocated":4042752,"data_stored":2267505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.065505"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.132643+0000","last_change":"2024-09-10T20:56:37.132643+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.132643+0000","last_undegraded":"2024-09-10T20:56:37.132643+0000","last_fullsized":"2024-09-10T20:56:37.132643+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:56:37.116004+0000","last_change":"2024-09-10T20:56:37.116004+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.116004+0000","last_undegraded":"2024-09-10T20:56:37.116004+0000","last_fullsized":"2024-09-10T20:56:37.116004+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.124027+0000","last_change":"2024-09-10T20:56:37.124027+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.124027+0000","last_undegraded":"2024-09-10T20:56:37.124027+0000","last_fullsized":"2024-09-10T20:56:37.124027+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.139563+0000","last_change":"2024-09-10T20:56:37.139563+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.139563+0000","last_undegraded":"2024-09-10T20:56:37.139563+0000","last_fullsized":"2024-09-10T20:56:37.139563+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.132015+0000","last_change":"2024-09-10T20:56:37.132015+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.132015+0000","last_undegraded":"2024-09-10T20:56:37.132015+0000","last_fullsized":"2024-09-10T20:56:37.132015+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:56:37.116004+0000","last_change":"2024-09-10T20:56:37.116004+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.116004+0000","last_undegraded":"2024-09-10T20:56:37.116004+0000","last_fullsized":"2024-09-10T20:56:37.116004+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.130878+0000","last_change":"2024-09-10T20:56:37.130878+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.130878+0000","last_undegraded":"2024-09-10T20:56:37.130878+0000","last_fullsized":"2024-09-10T20:56:37.130878+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.134783+0000","last_change":"2024-09-10T20:56:37.134783+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.134783+0000","last_undegraded":"2024-09-10T20:56:37.134783+0000","last_fullsized":"2024-09-10T20:56:37.134783+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.128169+0000","last_change":"2024-09-10T20:56:37.128169+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.128169+0000","last_undegraded":"2024-09-10T20:56:37.128169+0000","last_fullsized":"2024-09-10T20:56:37.128169+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.132785+0000","last_change":"2024-09-10T20:56:37.132785+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.132785+0000","last_undegraded":"2024-09-10T20:56:37.132785+0000","last_fullsized":"2024-09-10T20:56:37.132785+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.130617+0000","last_change":"2024-09-10T20:56:37.130617+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.130617+0000","last_undegraded":"2024-09-10T20:56:37.130617+0000","last_fullsized":"2024-09-10T20:56:37.130617+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.124302+0000","last_change":"2024-09-10T20:56:37.124302+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.124302+0000","last_undegraded":"2024-09-10T20:56:37.124302+0000","last_fullsized":"2024-09-10T20:56:37.124302+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.128743+0000","last_change":"2024-09-10T20:56:37.128743+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.128743+0000","last_undegraded":"2024-09-10T20:56:37.128743+0000","last_fullsized":"2024-09-10T20:56:37.128743+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:56:37.116004+0000","last_change":"2024-09-10T20:56:37.116004+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.116004+0000","last_undegraded":"2024-09-10T20:56:37.116004+0000","last_fullsized":"2024-09-10T20:56:37.116004+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.123640+0000","last_change":"2024-09-10T20:56:37.123640+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.123640+0000","last_undegraded":"2024-09-10T20:56:37.123640+0000","last_fullsized":"2024-09-10T20:56:37.123640+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.131656+0000","last_change":"2024-09-10T20:56:37.131656+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.131656+0000","last_undegraded":"2024-09-10T20:56:37.131656+0000","last_fullsized":"2024-09-10T20:56:37.131656+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.134245+0000","last_change":"2024-09-10T20:56:37.134245+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.134245+0000","last_undegraded":"2024-09-10T20:56:37.134245+0000","last_fullsized":"2024-09-10T20:56:37.134245+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:56:37.116004+0000","last_change":"2024-09-10T20:56:37.116004+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.116004+0000","last_undegraded":"2024-09-10T20:56:37.116004+0000","last_fullsized":"2024-09-10T20:56:37.116004+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:56:37.116004+0000","last_change":"2024-09-10T20:56:37.116004+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.116004+0000","last_undegraded":"2024-09-10T20:56:37.116004+0000","last_fullsized":"2024-09-10T20:56:37.116004+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.128028+0000","last_change":"2024-09-10T20:56:37.128028+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.128028+0000","last_undegraded":"2024-09-10T20:56:37.128028+0000","last_fullsized":"2024-09-10T20:56:37.128028+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.127664+0000","last_change":"2024-09-10T20:56:37.127664+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.127664+0000","last_undegraded":"2024-09-10T20:56:37.127664+0000","last_fullsized":"2024-09-10T20:56:37.127664+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.128361+0000","last_change":"2024-09-10T20:56:37.128361+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.128361+0000","last_undegraded":"2024-09-10T20:56:37.128361+0000","last_fullsized":"2024-09-10T20:56:37.128361+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.129163+0000","last_change":"2024-09-10T20:56:37.129163+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.129163+0000","last_undegraded":"2024-09-10T20:56:37.129163+0000","last_fullsized":"2024-09-10T20:56:37.129163+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.124824+0000","last_change":"2024-09-10T20:56:37.124824+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.124824+0000","last_undegraded":"2024-09-10T20:56:37.124824+0000","last_fullsized":"2024-09-10T20:56:37.124824+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.133617+0000","last_change":"2024-09-10T20:56:37.133617+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.133617+0000","last_undegraded":"2024-09-10T20:56:37.133617+0000","last_fullsized":"2024-09-10T20:56:37.133617+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:56:37.116004+0000","last_change":"2024-09-10T20:56:37.116004+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.116004+0000","last_undegraded":"2024-09-10T20:56:37.116004+0000","last_fullsized":"2024-09-10T20:56:37.116004+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.137922+0000","last_change":"2024-09-10T20:56:37.137922+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.137922+0000","last_undegraded":"2024-09-10T20:56:37.137922+0000","last_fullsized":"2024-09-10T20:56:37.137922+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.123595+0000","last_change":"2024-09-10T20:56:37.123595+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.123595+0000","last_undegraded":"2024-09-10T20:56:37.123595+0000","last_fullsized":"2024-09-10T20:56:37.123595+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.127201+0000","last_change":"2024-09-10T20:56:37.127201+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.127201+0000","last_undegraded":"2024-09-10T20:56:37.127201+0000","last_fullsized":"2024-09-10T20:56:37.127201+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.134131+0000","last_change":"2024-09-10T20:56:37.134131+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.134131+0000","last_undegraded":"2024-09-10T20:56:37.134131+0000","last_fullsized":"2024-09-10T20:56:37.134131+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.132776+0000","last_change":"2024-09-10T20:56:37.132776+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.132776+0000","last_undegraded":"2024-09-10T20:56:37.132776+0000","last_fullsized":"2024-09-10T20:56:37.132776+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.133871+0000","last_change":"2024-09-10T20:56:37.133871+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.133871+0000","last_undegraded":"2024-09-10T20:56:37.133871+0000","last_fullsized":"2024-09-10T20:56:37.133871+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.130856+0000","last_change":"2024-09-10T20:56:37.130856+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.130856+0000","last_undegraded":"2024-09-10T20:56:37.130856+0000","last_fullsized":"2024-09-10T20:56:37.130856+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.151482+0000","last_change":"2024-09-10T20:56:37.146191+0000","last_active":"2024-09-10T20:56:37.151482+0000","last_peered":"2024-09-10T20:56:37.151482+0000","last_clean":"2024-09-10T20:56:37.151482+0000","last_became_active":"2024-09-10T20:56:37.145878+0000","last_became_peered":"2024-09-10T20:56:37.145878+0000","last_unstale":"2024-09-10T20:56:37.151482+0000","last_undegraded":"2024-09-10T20:56:37.151482+0000","last_fullsized":"2024-09-10T20:56:37.151482+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:16:52.517767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.132148+0000","last_change":"2024-09-10T20:56:37.132148+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.132148+0000","last_undegraded":"2024-09-10T20:56:37.132148+0000","last_fullsized":"2024-09-10T20:56:37.132148+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.142378+0000","last_change":"2024-09-10T20:56:37.140973+0000","last_active":"2024-09-10T20:56:37.142378+0000","last_peered":"2024-09-10T20:56:37.142378+0000","last_clean":"2024-09-10T20:56:37.142378+0000","last_became_active":"2024-09-10T20:56:37.140621+0000","last_became_peered":"2024-09-10T20:56:37.140621+0000","last_unstale":"2024-09-10T20:56:37.142378+0000","last_undegraded":"2024-09-10T20:56:37.142378+0000","last_fullsized":"2024-09-10T20:56:37.142378+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:24:50.372283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.126671+0000","last_change":"2024-09-10T20:56:37.126671+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.126671+0000","last_undegraded":"2024-09-10T20:56:37.126671+0000","last_fullsized":"2024-09-10T20:56:37.126671+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-10T20:56:36.125256+0000","last_change":"2024-09-10T20:56:36.125256+0000","last_active":"2024-09-10T20:56:36.107458+0000","last_peered":"2024-09-10T20:56:36.107458+0000","last_clean":"2024-09-10T20:56:36.107458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:36.125256+0000","last_undegraded":"2024-09-10T20:56:36.125256+0000","last_fullsized":"2024-09-10T20:56:36.125256+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.136333+0000","last_change":"2024-09-10T20:56:37.136333+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.136333+0000","last_undegraded":"2024-09-10T20:56:37.136333+0000","last_fullsized":"2024-09-10T20:56:37.136333+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.143448+0000","last_change":"2024-09-10T20:56:37.141690+0000","last_active":"2024-09-10T20:56:37.143448+0000","last_peered":"2024-09-10T20:56:37.143448+0000","last_clean":"2024-09-10T20:56:37.143448+0000","last_became_active":"2024-09-10T20:56:37.141098+0000","last_became_peered":"2024-09-10T20:56:37.141098+0000","last_unstale":"2024-09-10T20:56:37.143448+0000","last_undegraded":"2024-09-10T20:56:37.143448+0000","last_fullsized":"2024-09-10T20:56:37.143448+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:01:02.644529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.130010+0000","last_change":"2024-09-10T20:56:37.130010+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.130010+0000","last_undegraded":"2024-09-10T20:56:37.130010+0000","last_fullsized":"2024-09-10T20:56:37.130010+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.145227+0000","last_change":"2024-09-10T20:56:37.142809+0000","last_active":"2024-09-10T20:56:37.145227+0000","last_peered":"2024-09-10T20:56:37.145227+0000","last_clean":"2024-09-10T20:56:37.145227+0000","last_became_active":"2024-09-10T20:56:37.142502+0000","last_became_peered":"2024-09-10T20:56:37.142502+0000","last_unstale":"2024-09-10T20:56:37.145227+0000","last_undegraded":"2024-09-10T20:56:37.145227+0000","last_fullsized":"2024-09-10T20:56:37.145227+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:55:50.305233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.124133+0000","last_change":"2024-09-10T20:56:37.124133+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.124133+0000","last_undegraded":"2024-09-10T20:56:37.124133+0000","last_fullsized":"2024-09-10T20:56:37.124133+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.141477+0000","last_change":"2024-09-10T20:56:37.138322+0000","last_active":"2024-09-10T20:56:37.141477+0000","last_peered":"2024-09-10T20:56:37.141477+0000","last_clean":"2024-09-10T20:56:37.141477+0000","last_became_active":"2024-09-10T20:56:37.138056+0000","last_became_peered":"2024-09-10T20:56:37.138056+0000","last_unstale":"2024-09-10T20:56:37.141477+0000","last_undegraded":"2024-09-10T20:56:37.141477+0000","last_fullsized":"2024-09-10T20:56:37.141477+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:05.932753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.125628+0000","last_change":"2024-09-10T20:56:37.125628+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.125628+0000","last_undegraded":"2024-09-10T20:56:37.125628+0000","last_fullsized":"2024-09-10T20:56:37.125628+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-10T20:56:36.125367+0000","last_change":"2024-09-10T20:56:36.125367+0000","last_active":"2024-09-10T20:56:36.107458+0000","last_peered":"2024-09-10T20:56:36.107458+0000","last_clean":"2024-09-10T20:56:36.107458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:36.125367+0000","last_undegraded":"2024-09-10T20:56:36.125367+0000","last_fullsized":"2024-09-10T20:56:36.125367+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.138442+0000","last_change":"2024-09-10T20:56:37.138442+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.138442+0000","last_undegraded":"2024-09-10T20:56:37.138442+0000","last_fullsized":"2024-09-10T20:56:37.138442+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.139776+0000","last_change":"2024-09-10T20:56:37.137604+0000","last_active":"2024-09-10T20:56:37.139776+0000","last_peered":"2024-09-10T20:56:37.139776+0000","last_clean":"2024-09-10T20:56:37.139776+0000","last_became_active":"2024-09-10T20:56:37.136277+0000","last_became_peered":"2024-09-10T20:56:37.136277+0000","last_unstale":"2024-09-10T20:56:37.139776+0000","last_undegraded":"2024-09-10T20:56:37.139776+0000","last_fullsized":"2024-09-10T20:56:37.139776+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:19:42.035866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.125416+0000","last_change":"2024-09-10T20:56:37.125416+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.125416+0000","last_undegraded":"2024-09-10T20:56:37.125416+0000","last_fullsized":"2024-09-10T20:56:37.125416+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-10T20:56:36.126515+0000","last_change":"2024-09-10T20:56:36.126515+0000","last_active":"2024-09-10T20:56:36.107458+0000","last_peered":"2024-09-10T20:56:36.107458+0000","last_clean":"2024-09-10T20:56:36.107458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:36.126515+0000","last_undegraded":"2024-09-10T20:56:36.126515+0000","last_fullsized":"2024-09-10T20:56:36.126515+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:56:37.116004+0000","last_change":"2024-09-10T20:56:37.116004+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.116004+0000","last_undegraded":"2024-09-10T20:56:37.116004+0000","last_fullsized":"2024-09-10T20:56:37.116004+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.155002+0000","last_change":"2024-09-10T20:56:37.151835+0000","last_active":"2024-09-10T20:56:37.155002+0000","last_peered":"2024-09-10T20:56:37.155002+0000","last_clean":"2024-09-10T20:56:37.155002+0000","last_became_active":"2024-09-10T20:56:37.151520+0000","last_became_peered":"2024-09-10T20:56:37.151520+0000","last_unstale":"2024-09-10T20:56:37.155002+0000","last_undegraded":"2024-09-10T20:56:37.155002+0000","last_fullsized":"2024-09-10T20:56:37.155002+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:44:03.145368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:56:37.116004+0000","last_change":"2024-09-10T20:56:37.116004+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.116004+0000","last_undegraded":"2024-09-10T20:56:37.116004+0000","last_fullsized":"2024-09-10T20:56:37.116004+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.145150+0000","last_change":"2024-09-10T20:56:37.137553+0000","last_active":"2024-09-10T20:56:37.145150+0000","last_peered":"2024-09-10T20:56:37.145150+0000","last_clean":"2024-09-10T20:56:37.145150+0000","last_became_active":"2024-09-10T20:56:37.137268+0000","last_became_peered":"2024-09-10T20:56:37.137268+0000","last_unstale":"2024-09-10T20:56:37.145150+0000","last_undegraded":"2024-09-10T20:56:37.145150+0000","last_fullsized":"2024-09-10T20:56:37.145150+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:09:21.218563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.124714+0000","last_change":"2024-09-10T20:56:37.124714+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.124714+0000","last_undegraded":"2024-09-10T20:56:37.124714+0000","last_fullsized":"2024-09-10T20:56:37.124714+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-10T20:56:36.126193+0000","last_change":"2024-09-10T20:56:36.126193+0000","last_active":"2024-09-10T20:56:36.107458+0000","last_peered":"2024-09-10T20:56:36.107458+0000","last_clean":"2024-09-10T20:56:36.107458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:36.126193+0000","last_undegraded":"2024-09-10T20:56:36.126193+0000","last_fullsized":"2024-09-10T20:56:36.126193+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.133717+0000","last_change":"2024-09-10T20:56:37.133717+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.133717+0000","last_undegraded":"2024-09-10T20:56:37.133717+0000","last_fullsized":"2024-09-10T20:56:37.133717+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.141918+0000","last_change":"2024-09-10T20:56:37.137520+0000","last_active":"2024-09-10T20:56:37.141918+0000","last_peered":"2024-09-10T20:56:37.141918+0000","last_clean":"2024-09-10T20:56:37.141918+0000","last_became_active":"2024-09-10T20:56:37.136605+0000","last_became_peered":"2024-09-10T20:56:37.136605+0000","last_unstale":"2024-09-10T20:56:37.141918+0000","last_undegraded":"2024-09-10T20:56:37.141918+0000","last_fullsized":"2024-09-10T20:56:37.141918+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:55:46.867274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:56:37.116004+0000","last_change":"2024-09-10T20:56:37.116004+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.116004+0000","last_undegraded":"2024-09-10T20:56:37.116004+0000","last_fullsized":"2024-09-10T20:56:37.116004+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.146794+0000","last_change":"2024-09-10T20:56:37.143926+0000","last_active":"2024-09-10T20:56:37.146794+0000","last_peered":"2024-09-10T20:56:37.146794+0000","last_clean":"2024-09-10T20:56:37.146794+0000","last_became_active":"2024-09-10T20:56:37.143615+0000","last_became_peered":"2024-09-10T20:56:37.143615+0000","last_unstale":"2024-09-10T20:56:37.146794+0000","last_undegraded":"2024-09-10T20:56:37.146794+0000","last_fullsized":"2024-09-10T20:56:37.146794+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:32:50.958886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.133467+0000","last_change":"2024-09-10T20:56:37.133467+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.133467+0000","last_undegraded":"2024-09-10T20:56:37.133467+0000","last_fullsized":"2024-09-10T20:56:37.133467+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-10T20:56:36.124665+0000","last_change":"2024-09-10T20:56:36.124665+0000","last_active":"2024-09-10T20:56:36.107458+0000","last_peered":"2024-09-10T20:56:36.107458+0000","last_clean":"2024-09-10T20:56:36.107458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:36.124665+0000","last_undegraded":"2024-09-10T20:56:36.124665+0000","last_fullsized":"2024-09-10T20:56:36.124665+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.129239+0000","last_change":"2024-09-10T20:56:37.129239+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.129239+0000","last_undegraded":"2024-09-10T20:56:37.129239+0000","last_fullsized":"2024-09-10T20:56:37.129239+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-10T20:56:36.125393+0000","last_change":"2024-09-10T20:56:36.125393+0000","last_active":"2024-09-10T20:56:36.107458+0000","last_peered":"2024-09-10T20:56:36.107458+0000","last_clean":"2024-09-10T20:56:36.107458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:36.125393+0000","last_undegraded":"2024-09-10T20:56:36.125393+0000","last_fullsized":"2024-09-10T20:56:36.125393+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.126205+0000","last_change":"2024-09-10T20:56:37.126205+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.126205+0000","last_undegraded":"2024-09-10T20:56:37.126205+0000","last_fullsized":"2024-09-10T20:56:37.126205+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.147170+0000","last_change":"2024-09-10T20:56:37.144780+0000","last_active":"2024-09-10T20:56:37.147170+0000","last_peered":"2024-09-10T20:56:37.147170+0000","last_clean":"2024-09-10T20:56:37.147170+0000","last_became_active":"2024-09-10T20:56:37.144525+0000","last_became_peered":"2024-09-10T20:56:37.144525+0000","last_unstale":"2024-09-10T20:56:37.147170+0000","last_undegraded":"2024-09-10T20:56:37.147170+0000","last_fullsized":"2024-09-10T20:56:37.147170+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:56.606141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.124883+0000","last_change":"2024-09-10T20:56:37.124883+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.124883+0000","last_undegraded":"2024-09-10T20:56:37.124883+0000","last_fullsized":"2024-09-10T20:56:37.124883+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.142245+0000","last_change":"2024-09-10T20:56:37.140328+0000","last_active":"2024-09-10T20:56:37.142245+0000","last_peered":"2024-09-10T20:56:37.142245+0000","last_clean":"2024-09-10T20:56:37.142245+0000","last_became_active":"2024-09-10T20:56:37.139983+0000","last_became_peered":"2024-09-10T20:56:37.139983+0000","last_unstale":"2024-09-10T20:56:37.142245+0000","last_undegraded":"2024-09-10T20:56:37.142245+0000","last_fullsized":"2024-09-10T20:56:37.142245+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:49.886280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.135063+0000","last_change":"2024-09-10T20:56:37.135063+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.135063+0000","last_undegraded":"2024-09-10T20:56:37.135063+0000","last_fullsized":"2024-09-10T20:56:37.135063+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.142364+0000","last_change":"2024-09-10T20:56:37.140465+0000","last_active":"2024-09-10T20:56:37.142364+0000","last_peered":"2024-09-10T20:56:37.142364+0000","last_clean":"2024-09-10T20:56:37.142364+0000","last_became_active":"2024-09-10T20:56:37.139201+0000","last_became_peered":"2024-09-10T20:56:37.139201+0000","last_unstale":"2024-09-10T20:56:37.142364+0000","last_undegraded":"2024-09-10T20:56:37.142364+0000","last_fullsized":"2024-09-10T20:56:37.142364+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:27:18.667139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.130430+0000","last_change":"2024-09-10T20:56:37.130430+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.130430+0000","last_undegraded":"2024-09-10T20:56:37.130430+0000","last_fullsized":"2024-09-10T20:56:37.130430+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.145049+0000","last_change":"2024-09-10T20:56:37.142632+0000","last_active":"2024-09-10T20:56:37.145049+0000","last_peered":"2024-09-10T20:56:37.145049+0000","last_clean":"2024-09-10T20:56:37.145049+0000","last_became_active":"2024-09-10T20:56:37.141122+0000","last_became_peered":"2024-09-10T20:56:37.141122+0000","last_unstale":"2024-09-10T20:56:37.145049+0000","last_undegraded":"2024-09-10T20:56:37.145049+0000","last_fullsized":"2024-09-10T20:56:37.145049+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:39:25.053576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.127959+0000","last_change":"2024-09-10T20:56:37.127959+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.127959+0000","last_undegraded":"2024-09-10T20:56:37.127959+0000","last_fullsized":"2024-09-10T20:56:37.127959+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.151581+0000","last_change":"2024-09-10T20:56:37.149392+0000","last_active":"2024-09-10T20:56:37.151581+0000","last_peered":"2024-09-10T20:56:37.151581+0000","last_clean":"2024-09-10T20:56:37.151581+0000","last_became_active":"2024-09-10T20:56:37.148872+0000","last_became_peered":"2024-09-10T20:56:37.148872+0000","last_unstale":"2024-09-10T20:56:37.151581+0000","last_undegraded":"2024-09-10T20:56:37.151581+0000","last_fullsized":"2024-09-10T20:56:37.151581+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:32:47.911940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.128300+0000","last_change":"2024-09-10T20:56:37.128300+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.128300+0000","last_undegraded":"2024-09-10T20:56:37.128300+0000","last_fullsized":"2024-09-10T20:56:37.128300+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.151513+0000","last_change":"2024-09-10T20:56:37.147505+0000","last_active":"2024-09-10T20:56:37.151513+0000","last_peered":"2024-09-10T20:56:37.151513+0000","last_clean":"2024-09-10T20:56:37.151513+0000","last_became_active":"2024-09-10T20:56:37.147242+0000","last_became_peered":"2024-09-10T20:56:37.147242+0000","last_unstale":"2024-09-10T20:56:37.151513+0000","last_undegraded":"2024-09-10T20:56:37.151513+0000","last_fullsized":"2024-09-10T20:56:37.151513+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:22:03.323752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.127971+0000","last_change":"2024-09-10T20:56:37.127971+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.127971+0000","last_undegraded":"2024-09-10T20:56:37.127971+0000","last_fullsized":"2024-09-10T20:56:37.127971+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.144987+0000","last_change":"2024-09-10T20:56:37.142604+0000","last_active":"2024-09-10T20:56:37.144987+0000","last_peered":"2024-09-10T20:56:37.144987+0000","last_clean":"2024-09-10T20:56:37.144987+0000","last_became_active":"2024-09-10T20:56:37.142340+0000","last_became_peered":"2024-09-10T20:56:37.142340+0000","last_unstale":"2024-09-10T20:56:37.144987+0000","last_undegraded":"2024-09-10T20:56:37.144987+0000","last_fullsized":"2024-09-10T20:56:37.144987+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:00:29.173140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.132037+0000","last_change":"2024-09-10T20:56:37.132037+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.132037+0000","last_undegraded":"2024-09-10T20:56:37.132037+0000","last_fullsized":"2024-09-10T20:56:37.132037+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.145228+0000","last_change":"2024-09-10T20:56:37.141051+0000","last_active":"2024-09-10T20:56:37.145228+0000","last_peered":"2024-09-10T20:56:37.145228+0000","last_clean":"2024-09-10T20:56:37.145228+0000","last_became_active":"2024-09-10T20:56:37.140705+0000","last_became_peered":"2024-09-10T20:56:37.140705+0000","last_unstale":"2024-09-10T20:56:37.145228+0000","last_undegraded":"2024-09-10T20:56:37.145228+0000","last_fullsized":"2024-09-10T20:56:37.145228+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:46:12.680205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.129290+0000","last_change":"2024-09-10T20:56:37.129290+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.129290+0000","last_undegraded":"2024-09-10T20:56:37.129290+0000","last_fullsized":"2024-09-10T20:56:37.129290+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.152216+0000","last_change":"2024-09-10T20:56:37.150166+0000","last_active":"2024-09-10T20:56:37.152216+0000","last_peered":"2024-09-10T20:56:37.152216+0000","last_clean":"2024-09-10T20:56:37.152216+0000","last_became_active":"2024-09-10T20:56:37.149784+0000","last_became_peered":"2024-09-10T20:56:37.149784+0000","last_unstale":"2024-09-10T20:56:37.152216+0000","last_undegraded":"2024-09-10T20:56:37.152216+0000","last_fullsized":"2024-09-10T20:56:37.152216+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:12.264819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.124378+0000","last_change":"2024-09-10T20:56:37.124378+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.124378+0000","last_undegraded":"2024-09-10T20:56:37.124378+0000","last_fullsized":"2024-09-10T20:56:37.124378+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.149331+0000","last_change":"2024-09-10T20:56:37.144142+0000","last_active":"2024-09-10T20:56:37.149331+0000","last_peered":"2024-09-10T20:56:37.149331+0000","last_clean":"2024-09-10T20:56:37.149331+0000","last_became_active":"2024-09-10T20:56:37.143835+0000","last_became_peered":"2024-09-10T20:56:37.143835+0000","last_unstale":"2024-09-10T20:56:37.149331+0000","last_undegraded":"2024-09-10T20:56:37.149331+0000","last_fullsized":"2024-09-10T20:56:37.149331+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:16:52.517767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.131275+0000","last_change":"2024-09-10T20:56:37.131275+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.131275+0000","last_undegraded":"2024-09-10T20:56:37.131275+0000","last_fullsized":"2024-09-10T20:56:37.131275+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.146937+0000","last_change":"2024-09-10T20:56:37.141713+0000","last_active":"2024-09-10T20:56:37.146937+0000","last_peered":"2024-09-10T20:56:37.146937+0000","last_clean":"2024-09-10T20:56:37.146937+0000","last_became_active":"2024-09-10T20:56:37.141385+0000","last_became_peered":"2024-09-10T20:56:37.141385+0000","last_unstale":"2024-09-10T20:56:37.146937+0000","last_undegraded":"2024-09-10T20:56:37.146937+0000","last_fullsized":"2024-09-10T20:56:37.146937+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:56:35.375133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.131721+0000","last_change":"2024-09-10T20:56:37.131721+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.131721+0000","last_undegraded":"2024-09-10T20:56:37.131721+0000","last_fullsized":"2024-09-10T20:56:37.131721+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.148239+0000","last_change":"2024-09-10T20:56:37.147085+0000","last_active":"2024-09-10T20:56:37.148239+0000","last_peered":"2024-09-10T20:56:37.148239+0000","last_clean":"2024-09-10T20:56:37.148239+0000","last_became_active":"2024-09-10T20:56:37.146431+0000","last_became_peered":"2024-09-10T20:56:37.146431+0000","last_unstale":"2024-09-10T20:56:37.148239+0000","last_undegraded":"2024-09-10T20:56:37.148239+0000","last_fullsized":"2024-09-10T20:56:37.148239+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:22:03.323752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.130861+0000","last_change":"2024-09-10T20:56:37.130861+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.130861+0000","last_undegraded":"2024-09-10T20:56:37.130861+0000","last_fullsized":"2024-09-10T20:56:37.130861+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.152379+0000","last_change":"2024-09-10T20:56:37.150585+0000","last_active":"2024-09-10T20:56:37.152379+0000","last_peered":"2024-09-10T20:56:37.152379+0000","last_clean":"2024-09-10T20:56:37.152379+0000","last_became_active":"2024-09-10T20:56:37.149813+0000","last_became_peered":"2024-09-10T20:56:37.149813+0000","last_unstale":"2024-09-10T20:56:37.152379+0000","last_undegraded":"2024-09-10T20:56:37.152379+0000","last_fullsized":"2024-09-10T20:56:37.152379+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:37:14.449011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T20:56:37.116004+0000","last_change":"2024-09-10T20:56:37.116004+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.116004+0000","last_undegraded":"2024-09-10T20:56:37.116004+0000","last_fullsized":"2024-09-10T20:56:37.116004+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.134678+0000","last_change":"2024-09-10T20:56:37.132028+0000","last_active":"2024-09-10T20:56:37.134678+0000","last_peered":"2024-09-10T20:56:37.134678+0000","last_clean":"2024-09-10T20:56:37.134678+0000","last_became_active":"2024-09-10T20:56:37.131705+0000","last_became_peered":"2024-09-10T20:56:37.131705+0000","last_unstale":"2024-09-10T20:56:37.134678+0000","last_undegraded":"2024-09-10T20:56:37.134678+0000","last_fullsized":"2024-09-10T20:56:37.134678+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:41:34.738091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.126679+0000","last_change":"2024-09-10T20:56:37.126679+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.126679+0000","last_undegraded":"2024-09-10T20:56:37.126679+0000","last_fullsized":"2024-09-10T20:56:37.126679+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-10T20:56:36.124748+0000","last_change":"2024-09-10T20:56:36.124748+0000","last_active":"2024-09-10T20:56:36.107458+0000","last_peered":"2024-09-10T20:56:36.107458+0000","last_clean":"2024-09-10T20:56:36.107458+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:36.124748+0000","last_undegraded":"2024-09-10T20:56:36.124748+0000","last_fullsized":"2024-09-10T20:56:36.124748+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-10T20:56:37.129944+0000","last_change":"2024-09-10T20:56:37.129944+0000","last_active":"2024-09-10T20:56:37.116004+0000","last_peered":"2024-09-10T20:56:37.116004+0000","last_clean":"2024-09-10T20:56:37.116004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:56:37.129944+0000","last_undegraded":"2024-09-10T20:56:37.129944+0000","last_fullsized":"2024-09-10T20:56:37.129944+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.141767+0000","last_change":"2024-09-10T20:56:37.139551+0000","last_active":"2024-09-10T20:56:37.141767+0000","last_peered":"2024-09-10T20:56:37.141767+0000","last_clean":"2024-09-10T20:56:37.141767+0000","last_became_active":"2024-09-10T20:56:37.139252+0000","last_became_peered":"2024-09-10T20:56:37.139252+0000","last_unstale":"2024-09-10T20:56:37.141767+0000","last_undegraded":"2024-09-10T20:56:37.141767+0000","last_fullsized":"2024-09-10T20:56:37.141767+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:24:50.372283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":130,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T20:56:37.135291+0000","last_change":"2024-09-10T20:55:34.718784+0000","last_active":"2024-09-10T20:56:37.135291+0000","last_peered":"2024-09-10T20:56:37.135291+0000","last_clean":"2024-09-10T20:56:37.135291+0000","last_became_active":"2024-09-10T20:55:34.717616+0000","last_became_peered":"2024-09-10T20:55:34.717616+0000","last_unstale":"2024-09-10T20:56:37.135291+0000","last_undegraded":"2024-09-10T20:56:37.135291+0000","last_fullsized":"2024-09-10T20:56:37.135291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:33.618098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:33.618098+0000","last_clean_scrub_stamp":"2024-09-10T20:55:33.618098+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:17.442729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":108,"acting":108,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":958464,"data_stored":730131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":364544,"data_stored":139763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509456,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":133496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":133496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":133496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":364544,"data_stored":139763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":946176,"data_stored":723864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542160,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":133496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T20:56:42.825 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T20:56:43.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.017+0000 7fcea7e00640 1 -- 172.21.15.6:0/24654660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcea80d0d40 msgr2=0x7fcea80d1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:43.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.017+0000 7fcea7e00640 1 --2- 172.21.15.6:0/24654660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcea80d0d40 0x7fcea80d1e70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcea808c500 tx=0x7fcea002aa10 comp rx=0 tx=0).stop 2024-09-10T20:56:43.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.017+0000 7fcea7e00640 1 -- 172.21.15.6:0/24654660 shutdown_connections 2024-09-10T20:56:43.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.017+0000 7fcea7e00640 1 --2- 172.21.15.6:0/24654660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcea80d0d40 0x7fcea80d1e70 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.017+0000 7fcea7e00640 1 --2- 172.21.15.6:0/24654660 >> v2:172.21.15.150:3300/0 conn(0x7fcea80b53e0 0x7fcea80d0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.017+0000 7fcea7e00640 1 --2- 172.21.15.6:0/24654660 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcea8161610 0x7fcea80d4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.017+0000 7fcea7e00640 1 -- 172.21.15.6:0/24654660 >> 172.21.15.6:0/24654660 conn(0x7fcea809d0f0 msgr2=0x7fcea80d3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:43.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.017+0000 7fcea7e00640 1 -- 172.21.15.6:0/24654660 shutdown_connections 2024-09-10T20:56:43.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.017+0000 7fcea7e00640 1 -- 172.21.15.6:0/24654660 wait complete. 2024-09-10T20:56:43.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.018+0000 7fcea7e00640 1 Processor -- start 2024-09-10T20:56:43.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.018+0000 7fcea7e00640 1 -- start start 2024-09-10T20:56:43.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.019+0000 7fcea7e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcea80b53e0 0x7fcea80cd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:43.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.019+0000 7fcea7e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcea80d0d40 0x7fcea81f3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:43.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.019+0000 7fcea7e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcea8161610 0x7fcea806e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:43.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.019+0000 7fcea7e00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcea80d2740 con 0x7fcea80d0d40 2024-09-10T20:56:43.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.019+0000 7fcea7e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fcea80d25c0 con 0x7fcea8161610 2024-09-10T20:56:43.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.019+0000 7fcea7e00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fcea80d28c0 con 0x7fcea80b53e0 2024-09-10T20:56:43.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.020+0000 7fcea6000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcea80d0d40 0x7fcea81f3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:43.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.020+0000 7fcea6000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcea80d0d40 0x7fcea81f3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37922/0 (socket says 172.21.15.6:37922) 2024-09-10T20:56:43.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.020+0000 7fcea6000640 1 -- 172.21.15.6:0/3724669704 learned_addr learned my addr 172.21.15.6:0/3724669704 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:43.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.020+0000 7fcea7400640 1 --2- 172.21.15.6:0/3724669704 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcea8161610 0x7fcea806e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:43.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.020+0000 7fcea6a00640 1 --2- 172.21.15.6:0/3724669704 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcea80b53e0 0x7fcea80cd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:43.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.020+0000 7fcea6000640 1 -- 172.21.15.6:0/3724669704 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcea80b53e0 msgr2=0x7fcea80cd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:43.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.020+0000 7fcea6000640 1 --2- 172.21.15.6:0/3724669704 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcea80b53e0 0x7fcea80cd6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.020+0000 7fcea6000640 1 -- 172.21.15.6:0/3724669704 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcea8161610 msgr2=0x7fcea806e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:43.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.020+0000 7fcea6000640 1 --2- 172.21.15.6:0/3724669704 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcea8161610 0x7fcea806e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.020+0000 7fcea6000640 1 -- 172.21.15.6:0/3724669704 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcea81f7f60 con 0x7fcea80d0d40 2024-09-10T20:56:43.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.020+0000 7fcea6000640 1 --2- 172.21.15.6:0/3724669704 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcea80d0d40 0x7fcea81f3ec0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fce9400d780 tx=0x7fce9400dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:43.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.021+0000 7fce9ea00640 1 -- 172.21.15.6:0/3724669704 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce94017070 con 0x7fcea80d0d40 2024-09-10T20:56:43.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.021+0000 7fce9ea00640 1 -- 172.21.15.6:0/3724669704 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce9400de90 con 0x7fcea80d0d40 2024-09-10T20:56:43.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.021+0000 7fce9ea00640 1 -- 172.21.15.6:0/3724669704 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce940099d0 con 0x7fcea80d0d40 2024-09-10T20:56:43.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.021+0000 7fcea7e00640 1 -- 172.21.15.6:0/3724669704 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcea81f8240 con 0x7fcea80d0d40 2024-09-10T20:56:43.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.021+0000 7fcea7e00640 1 -- 172.21.15.6:0/3724669704 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcea81f8ae0 con 0x7fcea80d0d40 2024-09-10T20:56:43.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.022+0000 7fcea7e00640 1 -- 172.21.15.6:0/3724669704 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcea80d1e70 con 0x7fcea80d0d40 2024-09-10T20:56:43.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.023+0000 7fce9ea00640 1 -- 172.21.15.6:0/3724669704 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fce94009b70 con 0x7fcea80d0d40 2024-09-10T20:56:43.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.025+0000 7fce9ea00640 1 --2- 172.21.15.6:0/3724669704 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fce88077f70 0x7fce8807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:43.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.025+0000 7fce9ea00640 1 -- 172.21.15.6:0/3724669704 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fce94099dd0 con 0x7fcea80d0d40 2024-09-10T20:56:43.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.025+0000 7fcea6a00640 1 --2- 172.21.15.6:0/3724669704 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fce88077f70 0x7fce8807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:43.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.026+0000 7fcea6a00640 1 --2- 172.21.15.6:0/3724669704 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fce88077f70 0x7fce8807a430 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fce98004630 tx=0x7fce9800b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:43.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.029+0000 7fce9ea00640 1 -- 172.21.15.6:0/3724669704 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fce94062270 con 0x7fcea80d0d40 2024-09-10T20:56:43.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.220+0000 7fcea7e00640 1 -- 172.21.15.6:0/3724669704 --> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcea81f8410 con 0x7fce88077f70 2024-09-10T20:56:43.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.225+0000 7fce9ea00640 1 -- 172.21.15.6:0/3724669704 <== mgr.4120 v2:172.21.15.150:6800/1238179351 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251940 (secure 0 0 0) 0x7fcea81f8410 con 0x7fce88077f70 2024-09-10T20:56:43.231 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:56:43.232 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-10T20:56:43.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.228+0000 7fcea7e00640 1 -- 172.21.15.6:0/3724669704 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fce88077f70 msgr2=0x7fce8807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:43.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.228+0000 7fcea7e00640 1 --2- 172.21.15.6:0/3724669704 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fce88077f70 0x7fce8807a430 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fce98004630 tx=0x7fce9800b2e0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.228+0000 7fcea7e00640 1 -- 172.21.15.6:0/3724669704 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcea80d0d40 msgr2=0x7fcea81f3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:43.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.228+0000 7fcea7e00640 1 --2- 172.21.15.6:0/3724669704 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcea80d0d40 0x7fcea81f3ec0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fce9400d780 tx=0x7fce9400dc40 comp rx=0 tx=0).stop 2024-09-10T20:56:43.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.228+0000 7fcea7e00640 1 -- 172.21.15.6:0/3724669704 shutdown_connections 2024-09-10T20:56:43.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.228+0000 7fcea7e00640 1 --2- 172.21.15.6:0/3724669704 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fce88077f70 0x7fce8807a430 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.228+0000 7fcea7e00640 1 --2- 172.21.15.6:0/3724669704 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcea80d0d40 0x7fcea81f3ec0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.228+0000 7fcea7e00640 1 --2- 172.21.15.6:0/3724669704 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcea8161610 0x7fcea806e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.228+0000 7fcea7e00640 1 --2- 172.21.15.6:0/3724669704 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcea80b53e0 0x7fcea80cd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.228+0000 7fcea7e00640 1 -- 172.21.15.6:0/3724669704 >> 172.21.15.6:0/3724669704 conn(0x7fcea809d0f0 msgr2=0x7fcea80cfea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:43.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.229+0000 7fcea7e00640 1 -- 172.21.15.6:0/3724669704 shutdown_connections 2024-09-10T20:56:43.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.229+0000 7fcea7e00640 1 -- 172.21.15.6:0/3724669704 wait complete. 2024-09-10T20:56:43.248 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2024-09-10T20:56:43.186492+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220520,"kb_used_data":4264,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754200,"statfs":{"total":773094113280,"available":772868300800,"internally_reserved":0,"allocated":4366336,"data_stored":2408260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.065747"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895829+0000","last_change":"2024-09-10T20:56:38.156240+0000","last_active":"2024-09-10T20:56:39.895829+0000","last_peered":"2024-09-10T20:56:39.895829+0000","last_clean":"2024-09-10T20:56:39.895829+0000","last_became_active":"2024-09-10T20:56:38.155782+0000","last_became_peered":"2024-09-10T20:56:38.155782+0000","last_unstale":"2024-09-10T20:56:39.895829+0000","last_undegraded":"2024-09-10T20:56:39.895829+0000","last_fullsized":"2024-09-10T20:56:39.895829+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:19.775884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159758+0000","last_change":"2024-09-10T20:56:38.171671+0000","last_active":"2024-09-10T20:56:39.159758+0000","last_peered":"2024-09-10T20:56:39.159758+0000","last_clean":"2024-09-10T20:56:39.159758+0000","last_became_active":"2024-09-10T20:56:38.171389+0000","last_became_peered":"2024-09-10T20:56:38.171389+0000","last_unstale":"2024-09-10T20:56:39.159758+0000","last_undegraded":"2024-09-10T20:56:39.159758+0000","last_fullsized":"2024-09-10T20:56:39.159758+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:17.915009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159548+0000","last_change":"2024-09-10T20:56:38.176130+0000","last_active":"2024-09-10T20:56:39.159548+0000","last_peered":"2024-09-10T20:56:39.159548+0000","last_clean":"2024-09-10T20:56:39.159548+0000","last_became_active":"2024-09-10T20:56:38.175453+0000","last_became_peered":"2024-09-10T20:56:38.175453+0000","last_unstale":"2024-09-10T20:56:39.159548+0000","last_undegraded":"2024-09-10T20:56:39.159548+0000","last_fullsized":"2024-09-10T20:56:39.159548+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:38.009983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.827631+0000","last_change":"2024-09-10T20:56:38.174330+0000","last_active":"2024-09-10T20:56:39.827631+0000","last_peered":"2024-09-10T20:56:39.827631+0000","last_clean":"2024-09-10T20:56:39.827631+0000","last_became_active":"2024-09-10T20:56:38.174085+0000","last_became_peered":"2024-09-10T20:56:38.174085+0000","last_unstale":"2024-09-10T20:56:39.827631+0000","last_undegraded":"2024-09-10T20:56:39.827631+0000","last_fullsized":"2024-09-10T20:56:39.827631+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:58:24.390781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.826376+0000","last_change":"2024-09-10T20:56:38.168194+0000","last_active":"2024-09-10T20:56:39.826376+0000","last_peered":"2024-09-10T20:56:39.826376+0000","last_clean":"2024-09-10T20:56:39.826376+0000","last_became_active":"2024-09-10T20:56:38.167861+0000","last_became_peered":"2024-09-10T20:56:38.167861+0000","last_unstale":"2024-09-10T20:56:39.826376+0000","last_undegraded":"2024-09-10T20:56:39.826376+0000","last_fullsized":"2024-09-10T20:56:39.826376+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:13.273365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159294+0000","last_change":"2024-09-10T20:56:38.156995+0000","last_active":"2024-09-10T20:56:39.159294+0000","last_peered":"2024-09-10T20:56:39.159294+0000","last_clean":"2024-09-10T20:56:39.159294+0000","last_became_active":"2024-09-10T20:56:38.156519+0000","last_became_peered":"2024-09-10T20:56:38.156519+0000","last_unstale":"2024-09-10T20:56:39.159294+0000","last_undegraded":"2024-09-10T20:56:39.159294+0000","last_fullsized":"2024-09-10T20:56:39.159294+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:44:30.630575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.160932+0000","last_change":"2024-09-10T20:56:38.180671+0000","last_active":"2024-09-10T20:56:39.160932+0000","last_peered":"2024-09-10T20:56:39.160932+0000","last_clean":"2024-09-10T20:56:39.160932+0000","last_became_active":"2024-09-10T20:56:38.180388+0000","last_became_peered":"2024-09-10T20:56:38.180388+0000","last_unstale":"2024-09-10T20:56:39.160932+0000","last_undegraded":"2024-09-10T20:56:39.160932+0000","last_fullsized":"2024-09-10T20:56:39.160932+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:51.074302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159545+0000","last_change":"2024-09-10T20:56:38.179102+0000","last_active":"2024-09-10T20:56:39.159545+0000","last_peered":"2024-09-10T20:56:39.159545+0000","last_clean":"2024-09-10T20:56:39.159545+0000","last_became_active":"2024-09-10T20:56:38.178426+0000","last_became_peered":"2024-09-10T20:56:38.178426+0000","last_unstale":"2024-09-10T20:56:39.159545+0000","last_undegraded":"2024-09-10T20:56:39.159545+0000","last_fullsized":"2024-09-10T20:56:39.159545+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:00:54.042716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.637843+0000","last_change":"2024-09-10T20:56:38.176880+0000","last_active":"2024-09-10T20:56:39.637843+0000","last_peered":"2024-09-10T20:56:39.637843+0000","last_clean":"2024-09-10T20:56:39.637843+0000","last_became_active":"2024-09-10T20:56:38.176589+0000","last_became_peered":"2024-09-10T20:56:38.176589+0000","last_unstale":"2024-09-10T20:56:39.637843+0000","last_undegraded":"2024-09-10T20:56:39.637843+0000","last_fullsized":"2024-09-10T20:56:39.637843+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:38.109672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.827739+0000","last_change":"2024-09-10T20:56:38.169154+0000","last_active":"2024-09-10T20:56:39.827739+0000","last_peered":"2024-09-10T20:56:39.827739+0000","last_clean":"2024-09-10T20:56:39.827739+0000","last_became_active":"2024-09-10T20:56:38.166148+0000","last_became_peered":"2024-09-10T20:56:38.166148+0000","last_unstale":"2024-09-10T20:56:39.827739+0000","last_undegraded":"2024-09-10T20:56:39.827739+0000","last_fullsized":"2024-09-10T20:56:39.827739+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:17:07.908211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.160898+0000","last_change":"2024-09-10T20:56:38.177874+0000","last_active":"2024-09-10T20:56:39.160898+0000","last_peered":"2024-09-10T20:56:39.160898+0000","last_clean":"2024-09-10T20:56:39.160898+0000","last_became_active":"2024-09-10T20:56:38.177513+0000","last_became_peered":"2024-09-10T20:56:38.177513+0000","last_unstale":"2024-09-10T20:56:39.160898+0000","last_undegraded":"2024-09-10T20:56:39.160898+0000","last_fullsized":"2024-09-10T20:56:39.160898+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:08:05.011647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159924+0000","last_change":"2024-09-10T20:56:38.163865+0000","last_active":"2024-09-10T20:56:39.159924+0000","last_peered":"2024-09-10T20:56:39.159924+0000","last_clean":"2024-09-10T20:56:39.159924+0000","last_became_active":"2024-09-10T20:56:38.163579+0000","last_became_peered":"2024-09-10T20:56:38.163579+0000","last_unstale":"2024-09-10T20:56:39.159924+0000","last_undegraded":"2024-09-10T20:56:39.159924+0000","last_fullsized":"2024-09-10T20:56:39.159924+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:55.667614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.826322+0000","last_change":"2024-09-10T20:56:38.173448+0000","last_active":"2024-09-10T20:56:39.826322+0000","last_peered":"2024-09-10T20:56:39.826322+0000","last_clean":"2024-09-10T20:56:39.826322+0000","last_became_active":"2024-09-10T20:56:38.173195+0000","last_became_peered":"2024-09-10T20:56:38.173195+0000","last_unstale":"2024-09-10T20:56:39.826322+0000","last_undegraded":"2024-09-10T20:56:39.826322+0000","last_fullsized":"2024-09-10T20:56:39.826322+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:32:51.967432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159409+0000","last_change":"2024-09-10T20:56:38.155556+0000","last_active":"2024-09-10T20:56:39.159409+0000","last_peered":"2024-09-10T20:56:39.159409+0000","last_clean":"2024-09-10T20:56:39.159409+0000","last_became_active":"2024-09-10T20:56:38.155251+0000","last_became_peered":"2024-09-10T20:56:38.155251+0000","last_unstale":"2024-09-10T20:56:39.159409+0000","last_undegraded":"2024-09-10T20:56:39.159409+0000","last_fullsized":"2024-09-10T20:56:39.159409+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:02:08.850930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159560+0000","last_change":"2024-09-10T20:56:38.153485+0000","last_active":"2024-09-10T20:56:39.159560+0000","last_peered":"2024-09-10T20:56:39.159560+0000","last_clean":"2024-09-10T20:56:39.159560+0000","last_became_active":"2024-09-10T20:56:38.153171+0000","last_became_peered":"2024-09-10T20:56:38.153171+0000","last_unstale":"2024-09-10T20:56:39.159560+0000","last_undegraded":"2024-09-10T20:56:39.159560+0000","last_fullsized":"2024-09-10T20:56:39.159560+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:28:45.478675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159861+0000","last_change":"2024-09-10T20:56:38.177749+0000","last_active":"2024-09-10T20:56:39.159861+0000","last_peered":"2024-09-10T20:56:39.159861+0000","last_clean":"2024-09-10T20:56:39.159861+0000","last_became_active":"2024-09-10T20:56:38.177346+0000","last_became_peered":"2024-09-10T20:56:38.177346+0000","last_unstale":"2024-09-10T20:56:39.159861+0000","last_undegraded":"2024-09-10T20:56:39.159861+0000","last_fullsized":"2024-09-10T20:56:39.159861+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:06:05.780968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.161471+0000","last_change":"2024-09-10T20:56:38.180281+0000","last_active":"2024-09-10T20:56:39.161471+0000","last_peered":"2024-09-10T20:56:39.161471+0000","last_clean":"2024-09-10T20:56:39.161471+0000","last_became_active":"2024-09-10T20:56:38.179991+0000","last_became_peered":"2024-09-10T20:56:38.179991+0000","last_unstale":"2024-09-10T20:56:39.161471+0000","last_undegraded":"2024-09-10T20:56:39.161471+0000","last_fullsized":"2024-09-10T20:56:39.161471+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:58:59.841437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159954+0000","last_change":"2024-09-10T20:56:38.166160+0000","last_active":"2024-09-10T20:56:39.159954+0000","last_peered":"2024-09-10T20:56:39.159954+0000","last_clean":"2024-09-10T20:56:39.159954+0000","last_became_active":"2024-09-10T20:56:38.165859+0000","last_became_peered":"2024-09-10T20:56:38.165859+0000","last_unstale":"2024-09-10T20:56:39.159954+0000","last_undegraded":"2024-09-10T20:56:39.159954+0000","last_fullsized":"2024-09-10T20:56:39.159954+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:48.491833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159445+0000","last_change":"2024-09-10T20:56:38.171799+0000","last_active":"2024-09-10T20:56:39.159445+0000","last_peered":"2024-09-10T20:56:39.159445+0000","last_clean":"2024-09-10T20:56:39.159445+0000","last_became_active":"2024-09-10T20:56:38.170480+0000","last_became_peered":"2024-09-10T20:56:38.170480+0000","last_unstale":"2024-09-10T20:56:39.159445+0000","last_undegraded":"2024-09-10T20:56:39.159445+0000","last_fullsized":"2024-09-10T20:56:39.159445+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:13.448693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.826511+0000","last_change":"2024-09-10T20:56:38.170878+0000","last_active":"2024-09-10T20:56:39.826511+0000","last_peered":"2024-09-10T20:56:39.826511+0000","last_clean":"2024-09-10T20:56:39.826511+0000","last_became_active":"2024-09-10T20:56:38.164065+0000","last_became_peered":"2024-09-10T20:56:38.164065+0000","last_unstale":"2024-09-10T20:56:39.826511+0000","last_undegraded":"2024-09-10T20:56:39.826511+0000","last_fullsized":"2024-09-10T20:56:39.826511+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:37:15.457558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.637528+0000","last_change":"2024-09-10T20:56:38.160211+0000","last_active":"2024-09-10T20:56:39.637528+0000","last_peered":"2024-09-10T20:56:39.637528+0000","last_clean":"2024-09-10T20:56:39.637528+0000","last_became_active":"2024-09-10T20:56:38.159934+0000","last_became_peered":"2024-09-10T20:56:38.159934+0000","last_unstale":"2024-09-10T20:56:39.637528+0000","last_undegraded":"2024-09-10T20:56:39.637528+0000","last_fullsized":"2024-09-10T20:56:39.637528+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:58:27.629519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.637570+0000","last_change":"2024-09-10T20:56:38.169611+0000","last_active":"2024-09-10T20:56:39.637570+0000","last_peered":"2024-09-10T20:56:39.637570+0000","last_clean":"2024-09-10T20:56:39.637570+0000","last_became_active":"2024-09-10T20:56:38.168669+0000","last_became_peered":"2024-09-10T20:56:38.168669+0000","last_unstale":"2024-09-10T20:56:39.637570+0000","last_undegraded":"2024-09-10T20:56:39.637570+0000","last_fullsized":"2024-09-10T20:56:39.637570+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:36.229445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895621+0000","last_change":"2024-09-10T20:56:38.171294+0000","last_active":"2024-09-10T20:56:39.895621+0000","last_peered":"2024-09-10T20:56:39.895621+0000","last_clean":"2024-09-10T20:56:39.895621+0000","last_became_active":"2024-09-10T20:56:38.171036+0000","last_became_peered":"2024-09-10T20:56:38.171036+0000","last_unstale":"2024-09-10T20:56:39.895621+0000","last_undegraded":"2024-09-10T20:56:39.895621+0000","last_fullsized":"2024-09-10T20:56:39.895621+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:50.366589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.160295+0000","last_change":"2024-09-10T20:56:38.161533+0000","last_active":"2024-09-10T20:56:39.160295+0000","last_peered":"2024-09-10T20:56:39.160295+0000","last_clean":"2024-09-10T20:56:39.160295+0000","last_became_active":"2024-09-10T20:56:38.160862+0000","last_became_peered":"2024-09-10T20:56:38.160862+0000","last_unstale":"2024-09-10T20:56:39.160295+0000","last_undegraded":"2024-09-10T20:56:39.160295+0000","last_fullsized":"2024-09-10T20:56:39.160295+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:49:12.825733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.827849+0000","last_change":"2024-09-10T20:56:38.168070+0000","last_active":"2024-09-10T20:56:39.827849+0000","last_peered":"2024-09-10T20:56:39.827849+0000","last_clean":"2024-09-10T20:56:39.827849+0000","last_became_active":"2024-09-10T20:56:38.167670+0000","last_became_peered":"2024-09-10T20:56:38.167670+0000","last_unstale":"2024-09-10T20:56:39.827849+0000","last_undegraded":"2024-09-10T20:56:39.827849+0000","last_fullsized":"2024-09-10T20:56:39.827849+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:59.382183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.160054+0000","last_change":"2024-09-10T20:56:38.171776+0000","last_active":"2024-09-10T20:56:39.160054+0000","last_peered":"2024-09-10T20:56:39.160054+0000","last_clean":"2024-09-10T20:56:39.160054+0000","last_became_active":"2024-09-10T20:56:38.171471+0000","last_became_peered":"2024-09-10T20:56:38.171471+0000","last_unstale":"2024-09-10T20:56:39.160054+0000","last_undegraded":"2024-09-10T20:56:39.160054+0000","last_fullsized":"2024-09-10T20:56:39.160054+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:38:19.333053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.827962+0000","last_change":"2024-09-10T20:56:38.174896+0000","last_active":"2024-09-10T20:56:39.827962+0000","last_peered":"2024-09-10T20:56:39.827962+0000","last_clean":"2024-09-10T20:56:39.827962+0000","last_became_active":"2024-09-10T20:56:38.174670+0000","last_became_peered":"2024-09-10T20:56:38.174670+0000","last_unstale":"2024-09-10T20:56:39.827962+0000","last_undegraded":"2024-09-10T20:56:39.827962+0000","last_fullsized":"2024-09-10T20:56:39.827962+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:00:54.042716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.160155+0000","last_change":"2024-09-10T20:56:38.154093+0000","last_active":"2024-09-10T20:56:39.160155+0000","last_peered":"2024-09-10T20:56:39.160155+0000","last_clean":"2024-09-10T20:56:39.160155+0000","last_became_active":"2024-09-10T20:56:38.153777+0000","last_became_peered":"2024-09-10T20:56:38.153777+0000","last_unstale":"2024-09-10T20:56:39.160155+0000","last_undegraded":"2024-09-10T20:56:39.160155+0000","last_fullsized":"2024-09-10T20:56:39.160155+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:59:49.859563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.637662+0000","last_change":"2024-09-10T20:56:38.170234+0000","last_active":"2024-09-10T20:56:39.637662+0000","last_peered":"2024-09-10T20:56:39.637662+0000","last_clean":"2024-09-10T20:56:39.637662+0000","last_became_active":"2024-09-10T20:56:38.169332+0000","last_became_peered":"2024-09-10T20:56:38.169332+0000","last_unstale":"2024-09-10T20:56:39.637662+0000","last_undegraded":"2024-09-10T20:56:39.637662+0000","last_fullsized":"2024-09-10T20:56:39.637662+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:11.752362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.160711+0000","last_change":"2024-09-10T20:56:38.175358+0000","last_active":"2024-09-10T20:56:39.160711+0000","last_peered":"2024-09-10T20:56:39.160711+0000","last_clean":"2024-09-10T20:56:39.160711+0000","last_became_active":"2024-09-10T20:56:38.175060+0000","last_became_peered":"2024-09-10T20:56:38.175060+0000","last_unstale":"2024-09-10T20:56:39.160711+0000","last_undegraded":"2024-09-10T20:56:39.160711+0000","last_fullsized":"2024-09-10T20:56:39.160711+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:59:49.859563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895822+0000","last_change":"2024-09-10T20:56:38.163171+0000","last_active":"2024-09-10T20:56:39.895822+0000","last_peered":"2024-09-10T20:56:39.895822+0000","last_clean":"2024-09-10T20:56:39.895822+0000","last_became_active":"2024-09-10T20:56:38.162550+0000","last_became_peered":"2024-09-10T20:56:38.162550+0000","last_unstale":"2024-09-10T20:56:39.895822+0000","last_undegraded":"2024-09-10T20:56:39.895822+0000","last_fullsized":"2024-09-10T20:56:39.895822+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:58:47.246890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159464+0000","last_change":"2024-09-10T20:56:38.169276+0000","last_active":"2024-09-10T20:56:39.159464+0000","last_peered":"2024-09-10T20:56:39.159464+0000","last_clean":"2024-09-10T20:56:39.159464+0000","last_became_active":"2024-09-10T20:56:38.166792+0000","last_became_peered":"2024-09-10T20:56:38.166792+0000","last_unstale":"2024-09-10T20:56:39.159464+0000","last_undegraded":"2024-09-10T20:56:39.159464+0000","last_fullsized":"2024-09-10T20:56:39.159464+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:38.009983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895822+0000","last_change":"2024-09-10T20:56:38.169453+0000","last_active":"2024-09-10T20:56:39.895822+0000","last_peered":"2024-09-10T20:56:39.895822+0000","last_clean":"2024-09-10T20:56:39.895822+0000","last_became_active":"2024-09-10T20:56:38.169173+0000","last_became_peered":"2024-09-10T20:56:38.169173+0000","last_unstale":"2024-09-10T20:56:39.895822+0000","last_undegraded":"2024-09-10T20:56:39.895822+0000","last_fullsized":"2024-09-10T20:56:39.895822+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:46:19.482863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895993+0000","last_change":"2024-09-10T20:56:37.146191+0000","last_active":"2024-09-10T20:56:39.895993+0000","last_peered":"2024-09-10T20:56:39.895993+0000","last_clean":"2024-09-10T20:56:39.895993+0000","last_became_active":"2024-09-10T20:56:37.145878+0000","last_became_peered":"2024-09-10T20:56:37.145878+0000","last_unstale":"2024-09-10T20:56:39.895993+0000","last_undegraded":"2024-09-10T20:56:39.895993+0000","last_fullsized":"2024-09-10T20:56:39.895993+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:27.004455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895968+0000","last_change":"2024-09-10T20:56:38.168411+0000","last_active":"2024-09-10T20:56:39.895968+0000","last_peered":"2024-09-10T20:56:39.895968+0000","last_clean":"2024-09-10T20:56:39.895968+0000","last_became_active":"2024-09-10T20:56:38.167842+0000","last_became_peered":"2024-09-10T20:56:38.167842+0000","last_unstale":"2024-09-10T20:56:39.895968+0000","last_undegraded":"2024-09-10T20:56:39.895968+0000","last_fullsized":"2024-09-10T20:56:39.895968+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:45.328902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895800+0000","last_change":"2024-09-10T20:56:37.140973+0000","last_active":"2024-09-10T20:56:39.895800+0000","last_peered":"2024-09-10T20:56:39.895800+0000","last_clean":"2024-09-10T20:56:39.895800+0000","last_became_active":"2024-09-10T20:56:37.140621+0000","last_became_peered":"2024-09-10T20:56:37.140621+0000","last_unstale":"2024-09-10T20:56:39.895800+0000","last_undegraded":"2024-09-10T20:56:39.895800+0000","last_fullsized":"2024-09-10T20:56:39.895800+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:38.108076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.637901+0000","last_change":"2024-09-10T20:56:38.169377+0000","last_active":"2024-09-10T20:56:39.637901+0000","last_peered":"2024-09-10T20:56:39.637901+0000","last_clean":"2024-09-10T20:56:39.637901+0000","last_became_active":"2024-09-10T20:56:38.169086+0000","last_became_peered":"2024-09-10T20:56:38.169086+0000","last_unstale":"2024-09-10T20:56:39.637901+0000","last_undegraded":"2024-09-10T20:56:39.637901+0000","last_fullsized":"2024-09-10T20:56:39.637901+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:40.150106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159487+0000","last_change":"2024-09-10T20:56:37.144531+0000","last_active":"2024-09-10T20:56:39.159487+0000","last_peered":"2024-09-10T20:56:39.159487+0000","last_clean":"2024-09-10T20:56:39.159487+0000","last_became_active":"2024-09-10T20:56:37.144184+0000","last_became_peered":"2024-09-10T20:56:37.144184+0000","last_unstale":"2024-09-10T20:56:39.159487+0000","last_undegraded":"2024-09-10T20:56:39.159487+0000","last_fullsized":"2024-09-10T20:56:39.159487+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:27.031518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.828023+0000","last_change":"2024-09-10T20:56:38.169857+0000","last_active":"2024-09-10T20:56:39.828023+0000","last_peered":"2024-09-10T20:56:39.828023+0000","last_clean":"2024-09-10T20:56:39.828023+0000","last_became_active":"2024-09-10T20:56:38.169565+0000","last_became_peered":"2024-09-10T20:56:38.169565+0000","last_unstale":"2024-09-10T20:56:39.828023+0000","last_undegraded":"2024-09-10T20:56:39.828023+0000","last_fullsized":"2024-09-10T20:56:39.828023+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:11.205627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.826464+0000","last_change":"2024-09-10T20:56:37.141690+0000","last_active":"2024-09-10T20:56:39.826464+0000","last_peered":"2024-09-10T20:56:39.826464+0000","last_clean":"2024-09-10T20:56:39.826464+0000","last_became_active":"2024-09-10T20:56:37.141098+0000","last_became_peered":"2024-09-10T20:56:37.141098+0000","last_unstale":"2024-09-10T20:56:39.826464+0000","last_undegraded":"2024-09-10T20:56:39.826464+0000","last_fullsized":"2024-09-10T20:56:39.826464+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:47:59.966545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.160694+0000","last_change":"2024-09-10T20:56:38.174236+0000","last_active":"2024-09-10T20:56:39.160694+0000","last_peered":"2024-09-10T20:56:39.160694+0000","last_clean":"2024-09-10T20:56:39.160694+0000","last_became_active":"2024-09-10T20:56:38.173182+0000","last_became_peered":"2024-09-10T20:56:38.173182+0000","last_unstale":"2024-09-10T20:56:39.160694+0000","last_undegraded":"2024-09-10T20:56:39.160694+0000","last_fullsized":"2024-09-10T20:56:39.160694+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:04:55.129378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.637689+0000","last_change":"2024-09-10T20:56:37.142809+0000","last_active":"2024-09-10T20:56:39.637689+0000","last_peered":"2024-09-10T20:56:39.637689+0000","last_clean":"2024-09-10T20:56:39.637689+0000","last_became_active":"2024-09-10T20:56:37.142502+0000","last_became_peered":"2024-09-10T20:56:37.142502+0000","last_unstale":"2024-09-10T20:56:39.637689+0000","last_undegraded":"2024-09-10T20:56:39.637689+0000","last_fullsized":"2024-09-10T20:56:39.637689+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:05.157672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159627+0000","last_change":"2024-09-10T20:56:38.159186+0000","last_active":"2024-09-10T20:56:39.159627+0000","last_peered":"2024-09-10T20:56:39.159627+0000","last_clean":"2024-09-10T20:56:39.159627+0000","last_became_active":"2024-09-10T20:56:38.157690+0000","last_became_peered":"2024-09-10T20:56:38.157690+0000","last_unstale":"2024-09-10T20:56:39.159627+0000","last_undegraded":"2024-09-10T20:56:39.159627+0000","last_fullsized":"2024-09-10T20:56:39.159627+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:11.205627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.637585+0000","last_change":"2024-09-10T20:56:37.138322+0000","last_active":"2024-09-10T20:56:39.637585+0000","last_peered":"2024-09-10T20:56:39.637585+0000","last_clean":"2024-09-10T20:56:39.637585+0000","last_became_active":"2024-09-10T20:56:37.138056+0000","last_became_peered":"2024-09-10T20:56:37.138056+0000","last_unstale":"2024-09-10T20:56:39.637585+0000","last_undegraded":"2024-09-10T20:56:39.637585+0000","last_fullsized":"2024-09-10T20:56:39.637585+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:54:41.214426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.637832+0000","last_change":"2024-09-10T20:56:38.157572+0000","last_active":"2024-09-10T20:56:39.637832+0000","last_peered":"2024-09-10T20:56:39.637832+0000","last_clean":"2024-09-10T20:56:39.637832+0000","last_became_active":"2024-09-10T20:56:38.156050+0000","last_became_peered":"2024-09-10T20:56:38.156050+0000","last_unstale":"2024-09-10T20:56:39.637832+0000","last_undegraded":"2024-09-10T20:56:39.637832+0000","last_fullsized":"2024-09-10T20:56:39.637832+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:26:40.971161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159051+0000","last_change":"2024-09-10T20:56:37.145395+0000","last_active":"2024-09-10T20:56:39.159051+0000","last_peered":"2024-09-10T20:56:39.159051+0000","last_clean":"2024-09-10T20:56:39.159051+0000","last_became_active":"2024-09-10T20:56:37.145130+0000","last_became_peered":"2024-09-10T20:56:37.145130+0000","last_unstale":"2024-09-10T20:56:39.159051+0000","last_undegraded":"2024-09-10T20:56:39.159051+0000","last_fullsized":"2024-09-10T20:56:39.159051+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:03:46.184293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.827480+0000","last_change":"2024-09-10T20:56:38.158119+0000","last_active":"2024-09-10T20:56:39.827480+0000","last_peered":"2024-09-10T20:56:39.827480+0000","last_clean":"2024-09-10T20:56:39.827480+0000","last_became_active":"2024-09-10T20:56:38.157795+0000","last_became_peered":"2024-09-10T20:56:38.157795+0000","last_unstale":"2024-09-10T20:56:39.827480+0000","last_undegraded":"2024-09-10T20:56:39.827480+0000","last_fullsized":"2024-09-10T20:56:39.827480+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:22:15.010616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.637452+0000","last_change":"2024-09-10T20:56:37.137604+0000","last_active":"2024-09-10T20:56:39.637452+0000","last_peered":"2024-09-10T20:56:39.637452+0000","last_clean":"2024-09-10T20:56:39.637452+0000","last_became_active":"2024-09-10T20:56:37.136277+0000","last_became_peered":"2024-09-10T20:56:37.136277+0000","last_unstale":"2024-09-10T20:56:39.637452+0000","last_undegraded":"2024-09-10T20:56:39.637452+0000","last_fullsized":"2024-09-10T20:56:39.637452+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:45.530317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159719+0000","last_change":"2024-09-10T20:56:38.161102+0000","last_active":"2024-09-10T20:56:39.159719+0000","last_peered":"2024-09-10T20:56:39.159719+0000","last_clean":"2024-09-10T20:56:39.159719+0000","last_became_active":"2024-09-10T20:56:38.160615+0000","last_became_peered":"2024-09-10T20:56:38.160615+0000","last_unstale":"2024-09-10T20:56:39.159719+0000","last_undegraded":"2024-09-10T20:56:39.159719+0000","last_fullsized":"2024-09-10T20:56:39.159719+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:06:05.780968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159557+0000","last_change":"2024-09-10T20:56:37.148316+0000","last_active":"2024-09-10T20:56:39.159557+0000","last_peered":"2024-09-10T20:56:39.159557+0000","last_clean":"2024-09-10T20:56:39.159557+0000","last_became_active":"2024-09-10T20:56:37.148034+0000","last_became_peered":"2024-09-10T20:56:37.148034+0000","last_unstale":"2024-09-10T20:56:39.159557+0000","last_undegraded":"2024-09-10T20:56:39.159557+0000","last_fullsized":"2024-09-10T20:56:39.159557+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:48:35.506758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159491+0000","last_change":"2024-09-10T20:56:38.168062+0000","last_active":"2024-09-10T20:56:39.159491+0000","last_peered":"2024-09-10T20:56:39.159491+0000","last_clean":"2024-09-10T20:56:39.159491+0000","last_became_active":"2024-09-10T20:56:38.166076+0000","last_became_peered":"2024-09-10T20:56:38.166076+0000","last_unstale":"2024-09-10T20:56:39.159491+0000","last_undegraded":"2024-09-10T20:56:39.159491+0000","last_fullsized":"2024-09-10T20:56:39.159491+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:01:46.029373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895916+0000","last_change":"2024-09-10T20:56:37.151835+0000","last_active":"2024-09-10T20:56:39.895916+0000","last_peered":"2024-09-10T20:56:39.895916+0000","last_clean":"2024-09-10T20:56:39.895916+0000","last_became_active":"2024-09-10T20:56:37.151520+0000","last_became_peered":"2024-09-10T20:56:37.151520+0000","last_unstale":"2024-09-10T20:56:39.895916+0000","last_undegraded":"2024-09-10T20:56:39.895916+0000","last_fullsized":"2024-09-10T20:56:39.895916+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:04:37.157796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159839+0000","last_change":"2024-09-10T20:56:38.172457+0000","last_active":"2024-09-10T20:56:39.159839+0000","last_peered":"2024-09-10T20:56:39.159839+0000","last_clean":"2024-09-10T20:56:39.159839+0000","last_became_active":"2024-09-10T20:56:38.172146+0000","last_became_peered":"2024-09-10T20:56:38.172146+0000","last_unstale":"2024-09-10T20:56:39.159839+0000","last_undegraded":"2024-09-10T20:56:39.159839+0000","last_fullsized":"2024-09-10T20:56:39.159839+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:14:03.795634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159712+0000","last_change":"2024-09-10T20:56:37.137553+0000","last_active":"2024-09-10T20:56:39.159712+0000","last_peered":"2024-09-10T20:56:39.159712+0000","last_clean":"2024-09-10T20:56:39.159712+0000","last_became_active":"2024-09-10T20:56:37.137268+0000","last_became_peered":"2024-09-10T20:56:37.137268+0000","last_unstale":"2024-09-10T20:56:39.159712+0000","last_undegraded":"2024-09-10T20:56:39.159712+0000","last_fullsized":"2024-09-10T20:56:39.159712+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:58:46.238344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.161098+0000","last_change":"2024-09-10T20:56:38.176322+0000","last_active":"2024-09-10T20:56:39.161098+0000","last_peered":"2024-09-10T20:56:39.161098+0000","last_clean":"2024-09-10T20:56:39.161098+0000","last_became_active":"2024-09-10T20:56:38.175858+0000","last_became_peered":"2024-09-10T20:56:38.175858+0000","last_unstale":"2024-09-10T20:56:39.161098+0000","last_undegraded":"2024-09-10T20:56:39.161098+0000","last_fullsized":"2024-09-10T20:56:39.161098+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:51.074302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159871+0000","last_change":"2024-09-10T20:56:37.144471+0000","last_active":"2024-09-10T20:56:39.159871+0000","last_peered":"2024-09-10T20:56:39.159871+0000","last_clean":"2024-09-10T20:56:39.159871+0000","last_became_active":"2024-09-10T20:56:37.144170+0000","last_became_peered":"2024-09-10T20:56:37.144170+0000","last_unstale":"2024-09-10T20:56:39.159871+0000","last_undegraded":"2024-09-10T20:56:39.159871+0000","last_fullsized":"2024-09-10T20:56:39.159871+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:24:26.058645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.827521+0000","last_change":"2024-09-10T20:56:38.160855+0000","last_active":"2024-09-10T20:56:39.827521+0000","last_peered":"2024-09-10T20:56:39.827521+0000","last_clean":"2024-09-10T20:56:39.827521+0000","last_became_active":"2024-09-10T20:56:38.160481+0000","last_became_peered":"2024-09-10T20:56:38.160481+0000","last_unstale":"2024-09-10T20:56:39.827521+0000","last_undegraded":"2024-09-10T20:56:39.827521+0000","last_fullsized":"2024-09-10T20:56:39.827521+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:48:49.752855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.637759+0000","last_change":"2024-09-10T20:56:37.137520+0000","last_active":"2024-09-10T20:56:39.637759+0000","last_peered":"2024-09-10T20:56:39.637759+0000","last_clean":"2024-09-10T20:56:39.637759+0000","last_became_active":"2024-09-10T20:56:37.136605+0000","last_became_peered":"2024-09-10T20:56:37.136605+0000","last_unstale":"2024-09-10T20:56:39.637759+0000","last_undegraded":"2024-09-10T20:56:39.637759+0000","last_fullsized":"2024-09-10T20:56:39.637759+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:51:14.065783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159616+0000","last_change":"2024-09-10T20:56:38.161692+0000","last_active":"2024-09-10T20:56:39.159616+0000","last_peered":"2024-09-10T20:56:39.159616+0000","last_clean":"2024-09-10T20:56:39.159616+0000","last_became_active":"2024-09-10T20:56:38.161390+0000","last_became_peered":"2024-09-10T20:56:38.161390+0000","last_unstale":"2024-09-10T20:56:39.159616+0000","last_undegraded":"2024-09-10T20:56:39.159616+0000","last_fullsized":"2024-09-10T20:56:39.159616+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:55:42.667720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.827509+0000","last_change":"2024-09-10T20:56:37.143926+0000","last_active":"2024-09-10T20:56:39.827509+0000","last_peered":"2024-09-10T20:56:39.827509+0000","last_clean":"2024-09-10T20:56:39.827509+0000","last_became_active":"2024-09-10T20:56:37.143615+0000","last_became_peered":"2024-09-10T20:56:37.143615+0000","last_unstale":"2024-09-10T20:56:39.827509+0000","last_undegraded":"2024-09-10T20:56:39.827509+0000","last_fullsized":"2024-09-10T20:56:39.827509+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:27.004455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159672+0000","last_change":"2024-09-10T20:56:38.169797+0000","last_active":"2024-09-10T20:56:39.159672+0000","last_peered":"2024-09-10T20:56:39.159672+0000","last_clean":"2024-09-10T20:56:39.159672+0000","last_became_active":"2024-09-10T20:56:38.166936+0000","last_became_peered":"2024-09-10T20:56:38.166936+0000","last_unstale":"2024-09-10T20:56:39.159672+0000","last_undegraded":"2024-09-10T20:56:39.159672+0000","last_fullsized":"2024-09-10T20:56:39.159672+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:11.205627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.160025+0000","last_change":"2024-09-10T20:56:37.142835+0000","last_active":"2024-09-10T20:56:39.160025+0000","last_peered":"2024-09-10T20:56:39.160025+0000","last_clean":"2024-09-10T20:56:39.160025+0000","last_became_active":"2024-09-10T20:56:37.141132+0000","last_became_peered":"2024-09-10T20:56:37.141132+0000","last_unstale":"2024-09-10T20:56:39.160025+0000","last_undegraded":"2024-09-10T20:56:39.160025+0000","last_fullsized":"2024-09-10T20:56:39.160025+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:32:42.408845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895963+0000","last_change":"2024-09-10T20:56:38.163561+0000","last_active":"2024-09-10T20:56:39.895963+0000","last_peered":"2024-09-10T20:56:39.895963+0000","last_clean":"2024-09-10T20:56:39.895963+0000","last_became_active":"2024-09-10T20:56:38.162903+0000","last_became_peered":"2024-09-10T20:56:38.162903+0000","last_unstale":"2024-09-10T20:56:39.895963+0000","last_undegraded":"2024-09-10T20:56:39.895963+0000","last_fullsized":"2024-09-10T20:56:39.895963+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:11.063733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159095+0000","last_change":"2024-09-10T20:56:37.145061+0000","last_active":"2024-09-10T20:56:39.159095+0000","last_peered":"2024-09-10T20:56:39.159095+0000","last_clean":"2024-09-10T20:56:39.159095+0000","last_became_active":"2024-09-10T20:56:37.144758+0000","last_became_peered":"2024-09-10T20:56:37.144758+0000","last_unstale":"2024-09-10T20:56:39.159095+0000","last_undegraded":"2024-09-10T20:56:39.159095+0000","last_fullsized":"2024-09-10T20:56:39.159095+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:22.395325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.637765+0000","last_change":"2024-09-10T20:56:38.159041+0000","last_active":"2024-09-10T20:56:39.637765+0000","last_peered":"2024-09-10T20:56:39.637765+0000","last_clean":"2024-09-10T20:56:39.637765+0000","last_became_active":"2024-09-10T20:56:38.158749+0000","last_became_peered":"2024-09-10T20:56:38.158749+0000","last_unstale":"2024-09-10T20:56:39.637765+0000","last_undegraded":"2024-09-10T20:56:39.637765+0000","last_fullsized":"2024-09-10T20:56:39.637765+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:28:54.408161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.828097+0000","last_change":"2024-09-10T20:56:37.144780+0000","last_active":"2024-09-10T20:56:39.828097+0000","last_peered":"2024-09-10T20:56:39.828097+0000","last_clean":"2024-09-10T20:56:39.828097+0000","last_became_active":"2024-09-10T20:56:37.144525+0000","last_became_peered":"2024-09-10T20:56:37.144525+0000","last_unstale":"2024-09-10T20:56:39.828097+0000","last_undegraded":"2024-09-10T20:56:39.828097+0000","last_fullsized":"2024-09-10T20:56:39.828097+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:22.559705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.160081+0000","last_change":"2024-09-10T20:56:38.158317+0000","last_active":"2024-09-10T20:56:39.160081+0000","last_peered":"2024-09-10T20:56:39.160081+0000","last_clean":"2024-09-10T20:56:39.160081+0000","last_became_active":"2024-09-10T20:56:38.157842+0000","last_became_peered":"2024-09-10T20:56:38.157842+0000","last_unstale":"2024-09-10T20:56:39.160081+0000","last_undegraded":"2024-09-10T20:56:39.160081+0000","last_fullsized":"2024-09-10T20:56:39.160081+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:04:55.129378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.637932+0000","last_change":"2024-09-10T20:56:37.140328+0000","last_active":"2024-09-10T20:56:39.637932+0000","last_peered":"2024-09-10T20:56:39.637932+0000","last_clean":"2024-09-10T20:56:39.637932+0000","last_became_active":"2024-09-10T20:56:37.139983+0000","last_became_peered":"2024-09-10T20:56:37.139983+0000","last_unstale":"2024-09-10T20:56:39.637932+0000","last_undegraded":"2024-09-10T20:56:39.637932+0000","last_fullsized":"2024-09-10T20:56:39.637932+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:47:52.623998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.827873+0000","last_change":"2024-09-10T20:56:38.172980+0000","last_active":"2024-09-10T20:56:39.827873+0000","last_peered":"2024-09-10T20:56:39.827873+0000","last_clean":"2024-09-10T20:56:39.827873+0000","last_became_active":"2024-09-10T20:56:38.172622+0000","last_became_peered":"2024-09-10T20:56:38.172622+0000","last_unstale":"2024-09-10T20:56:39.827873+0000","last_undegraded":"2024-09-10T20:56:39.827873+0000","last_fullsized":"2024-09-10T20:56:39.827873+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:38.009983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.638136+0000","last_change":"2024-09-10T20:56:37.140465+0000","last_active":"2024-09-10T20:56:39.638136+0000","last_peered":"2024-09-10T20:56:39.638136+0000","last_clean":"2024-09-10T20:56:39.638136+0000","last_became_active":"2024-09-10T20:56:37.139201+0000","last_became_peered":"2024-09-10T20:56:37.139201+0000","last_unstale":"2024-09-10T20:56:39.638136+0000","last_undegraded":"2024-09-10T20:56:39.638136+0000","last_fullsized":"2024-09-10T20:56:39.638136+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:18.812116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.826391+0000","last_change":"2024-09-10T20:56:38.178486+0000","last_active":"2024-09-10T20:56:39.826391+0000","last_peered":"2024-09-10T20:56:39.826391+0000","last_clean":"2024-09-10T20:56:39.826391+0000","last_became_active":"2024-09-10T20:56:38.178188+0000","last_became_peered":"2024-09-10T20:56:38.178188+0000","last_unstale":"2024-09-10T20:56:39.826391+0000","last_undegraded":"2024-09-10T20:56:39.826391+0000","last_fullsized":"2024-09-10T20:56:39.826391+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:57.614688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.637936+0000","last_change":"2024-09-10T20:56:37.142632+0000","last_active":"2024-09-10T20:56:39.637936+0000","last_peered":"2024-09-10T20:56:39.637936+0000","last_clean":"2024-09-10T20:56:39.637936+0000","last_became_active":"2024-09-10T20:56:37.141122+0000","last_became_peered":"2024-09-10T20:56:37.141122+0000","last_unstale":"2024-09-10T20:56:39.637936+0000","last_undegraded":"2024-09-10T20:56:39.637936+0000","last_fullsized":"2024-09-10T20:56:39.637936+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:01:18.539787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.826269+0000","last_change":"2024-09-10T20:56:38.153799+0000","last_active":"2024-09-10T20:56:39.826269+0000","last_peered":"2024-09-10T20:56:39.826269+0000","last_clean":"2024-09-10T20:56:39.826269+0000","last_became_active":"2024-09-10T20:56:38.153529+0000","last_became_peered":"2024-09-10T20:56:38.153529+0000","last_unstale":"2024-09-10T20:56:39.826269+0000","last_undegraded":"2024-09-10T20:56:39.826269+0000","last_fullsized":"2024-09-10T20:56:39.826269+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:56:36.383679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895790+0000","last_change":"2024-09-10T20:56:37.149392+0000","last_active":"2024-09-10T20:56:39.895790+0000","last_peered":"2024-09-10T20:56:39.895790+0000","last_clean":"2024-09-10T20:56:39.895790+0000","last_became_active":"2024-09-10T20:56:37.148872+0000","last_became_peered":"2024-09-10T20:56:37.148872+0000","last_unstale":"2024-09-10T20:56:39.895790+0000","last_undegraded":"2024-09-10T20:56:39.895790+0000","last_fullsized":"2024-09-10T20:56:39.895790+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:50:29.602715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.826588+0000","last_change":"2024-09-10T20:56:38.159089+0000","last_active":"2024-09-10T20:56:39.826588+0000","last_peered":"2024-09-10T20:56:39.826588+0000","last_clean":"2024-09-10T20:56:39.826588+0000","last_became_active":"2024-09-10T20:56:38.158741+0000","last_became_peered":"2024-09-10T20:56:38.158741+0000","last_unstale":"2024-09-10T20:56:39.826588+0000","last_undegraded":"2024-09-10T20:56:39.826588+0000","last_fullsized":"2024-09-10T20:56:39.826588+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:27:53.250076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895831+0000","last_change":"2024-09-10T20:56:37.147505+0000","last_active":"2024-09-10T20:56:39.895831+0000","last_peered":"2024-09-10T20:56:39.895831+0000","last_clean":"2024-09-10T20:56:39.895831+0000","last_became_active":"2024-09-10T20:56:37.147242+0000","last_became_peered":"2024-09-10T20:56:37.147242+0000","last_unstale":"2024-09-10T20:56:39.895831+0000","last_undegraded":"2024-09-10T20:56:39.895831+0000","last_fullsized":"2024-09-10T20:56:39.895831+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:12.264819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.825928+0000","last_change":"2024-09-10T20:56:38.158162+0000","last_active":"2024-09-10T20:56:39.825928+0000","last_peered":"2024-09-10T20:56:39.825928+0000","last_clean":"2024-09-10T20:56:39.825928+0000","last_became_active":"2024-09-10T20:56:38.157889+0000","last_became_peered":"2024-09-10T20:56:38.157889+0000","last_unstale":"2024-09-10T20:56:39.825928+0000","last_undegraded":"2024-09-10T20:56:39.825928+0000","last_fullsized":"2024-09-10T20:56:39.825928+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:46:00.932827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.637450+0000","last_change":"2024-09-10T20:56:37.142604+0000","last_active":"2024-09-10T20:56:39.637450+0000","last_peered":"2024-09-10T20:56:39.637450+0000","last_clean":"2024-09-10T20:56:39.637450+0000","last_became_active":"2024-09-10T20:56:37.142340+0000","last_became_peered":"2024-09-10T20:56:37.142340+0000","last_unstale":"2024-09-10T20:56:39.637450+0000","last_undegraded":"2024-09-10T20:56:39.637450+0000","last_fullsized":"2024-09-10T20:56:39.637450+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:57.416321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.160756+0000","last_change":"2024-09-10T20:56:38.181525+0000","last_active":"2024-09-10T20:56:39.160756+0000","last_peered":"2024-09-10T20:56:39.160756+0000","last_clean":"2024-09-10T20:56:39.160756+0000","last_became_active":"2024-09-10T20:56:38.178525+0000","last_became_peered":"2024-09-10T20:56:38.178525+0000","last_unstale":"2024-09-10T20:56:39.160756+0000","last_undegraded":"2024-09-10T20:56:39.160756+0000","last_fullsized":"2024-09-10T20:56:39.160756+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:49:12.825733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.160361+0000","last_change":"2024-09-10T20:56:37.141051+0000","last_active":"2024-09-10T20:56:39.160361+0000","last_peered":"2024-09-10T20:56:39.160361+0000","last_clean":"2024-09-10T20:56:39.160361+0000","last_became_active":"2024-09-10T20:56:37.140705+0000","last_became_peered":"2024-09-10T20:56:37.140705+0000","last_unstale":"2024-09-10T20:56:39.160361+0000","last_undegraded":"2024-09-10T20:56:39.160361+0000","last_fullsized":"2024-09-10T20:56:39.160361+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:10:06.780644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.826542+0000","last_change":"2024-09-10T20:56:38.165637+0000","last_active":"2024-09-10T20:56:39.826542+0000","last_peered":"2024-09-10T20:56:39.826542+0000","last_clean":"2024-09-10T20:56:39.826542+0000","last_became_active":"2024-09-10T20:56:38.165344+0000","last_became_peered":"2024-09-10T20:56:38.165344+0000","last_unstale":"2024-09-10T20:56:39.826542+0000","last_undegraded":"2024-09-10T20:56:39.826542+0000","last_fullsized":"2024-09-10T20:56:39.826542+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:28.013002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.828127+0000","last_change":"2024-09-10T20:56:37.150166+0000","last_active":"2024-09-10T20:56:39.828127+0000","last_peered":"2024-09-10T20:56:39.828127+0000","last_clean":"2024-09-10T20:56:39.828127+0000","last_became_active":"2024-09-10T20:56:37.149784+0000","last_became_peered":"2024-09-10T20:56:37.149784+0000","last_unstale":"2024-09-10T20:56:39.828127+0000","last_undegraded":"2024-09-10T20:56:39.828127+0000","last_fullsized":"2024-09-10T20:56:39.828127+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:11:22.203970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.160456+0000","last_change":"2024-09-10T20:56:38.179086+0000","last_active":"2024-09-10T20:56:39.160456+0000","last_peered":"2024-09-10T20:56:39.160456+0000","last_clean":"2024-09-10T20:56:39.160456+0000","last_became_active":"2024-09-10T20:56:38.176381+0000","last_became_peered":"2024-09-10T20:56:38.176381+0000","last_unstale":"2024-09-10T20:56:39.160456+0000","last_undegraded":"2024-09-10T20:56:39.160456+0000","last_fullsized":"2024-09-10T20:56:39.160456+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:08:05.011647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.896012+0000","last_change":"2024-09-10T20:56:37.144142+0000","last_active":"2024-09-10T20:56:39.896012+0000","last_peered":"2024-09-10T20:56:39.896012+0000","last_clean":"2024-09-10T20:56:39.896012+0000","last_became_active":"2024-09-10T20:56:37.143835+0000","last_became_peered":"2024-09-10T20:56:37.143835+0000","last_unstale":"2024-09-10T20:56:39.896012+0000","last_undegraded":"2024-09-10T20:56:39.896012+0000","last_fullsized":"2024-09-10T20:56:39.896012+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:51:50.869361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895723+0000","last_change":"2024-09-10T20:56:38.177166+0000","last_active":"2024-09-10T20:56:39.895723+0000","last_peered":"2024-09-10T20:56:39.895723+0000","last_clean":"2024-09-10T20:56:39.895723+0000","last_became_active":"2024-09-10T20:56:38.176862+0000","last_became_peered":"2024-09-10T20:56:38.176862+0000","last_unstale":"2024-09-10T20:56:39.895723+0000","last_undegraded":"2024-09-10T20:56:39.895723+0000","last_fullsized":"2024-09-10T20:56:39.895723+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:11.063733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.827981+0000","last_change":"2024-09-10T20:56:37.141713+0000","last_active":"2024-09-10T20:56:39.827981+0000","last_peered":"2024-09-10T20:56:39.827981+0000","last_clean":"2024-09-10T20:56:39.827981+0000","last_became_active":"2024-09-10T20:56:37.141385+0000","last_became_peered":"2024-09-10T20:56:37.141385+0000","last_unstale":"2024-09-10T20:56:39.827981+0000","last_undegraded":"2024-09-10T20:56:39.827981+0000","last_fullsized":"2024-09-10T20:56:39.827981+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:45:54.051740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895806+0000","last_change":"2024-09-10T20:56:38.166177+0000","last_active":"2024-09-10T20:56:39.895806+0000","last_peered":"2024-09-10T20:56:39.895806+0000","last_clean":"2024-09-10T20:56:39.895806+0000","last_became_active":"2024-09-10T20:56:38.165844+0000","last_became_peered":"2024-09-10T20:56:38.165844+0000","last_unstale":"2024-09-10T20:56:39.895806+0000","last_undegraded":"2024-09-10T20:56:39.895806+0000","last_fullsized":"2024-09-10T20:56:39.895806+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:55:02.168176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895935+0000","last_change":"2024-09-10T20:56:37.147085+0000","last_active":"2024-09-10T20:56:39.895935+0000","last_peered":"2024-09-10T20:56:39.895935+0000","last_clean":"2024-09-10T20:56:39.895935+0000","last_became_active":"2024-09-10T20:56:37.146431+0000","last_became_peered":"2024-09-10T20:56:37.146431+0000","last_unstale":"2024-09-10T20:56:39.895935+0000","last_undegraded":"2024-09-10T20:56:39.895935+0000","last_fullsized":"2024-09-10T20:56:39.895935+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:41:31.782397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895850+0000","last_change":"2024-09-10T20:56:38.154317+0000","last_active":"2024-09-10T20:56:39.895850+0000","last_peered":"2024-09-10T20:56:39.895850+0000","last_clean":"2024-09-10T20:56:39.895850+0000","last_became_active":"2024-09-10T20:56:38.154012+0000","last_became_peered":"2024-09-10T20:56:38.154012+0000","last_unstale":"2024-09-10T20:56:39.895850+0000","last_undegraded":"2024-09-10T20:56:39.895850+0000","last_fullsized":"2024-09-10T20:56:39.895850+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:45.328902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.827631+0000","last_change":"2024-09-10T20:56:37.150585+0000","last_active":"2024-09-10T20:56:39.827631+0000","last_peered":"2024-09-10T20:56:39.827631+0000","last_clean":"2024-09-10T20:56:39.827631+0000","last_became_active":"2024-09-10T20:56:37.149813+0000","last_became_peered":"2024-09-10T20:56:37.149813+0000","last_unstale":"2024-09-10T20:56:39.827631+0000","last_undegraded":"2024-09-10T20:56:39.827631+0000","last_fullsized":"2024-09-10T20:56:39.827631+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:27:52.241529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159186+0000","last_change":"2024-09-10T20:56:38.171350+0000","last_active":"2024-09-10T20:56:39.159186+0000","last_peered":"2024-09-10T20:56:39.159186+0000","last_clean":"2024-09-10T20:56:39.159186+0000","last_became_active":"2024-09-10T20:56:38.166604+0000","last_became_peered":"2024-09-10T20:56:38.166604+0000","last_unstale":"2024-09-10T20:56:39.159186+0000","last_undegraded":"2024-09-10T20:56:39.159186+0000","last_fullsized":"2024-09-10T20:56:39.159186+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:04:41.603241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.638068+0000","last_change":"2024-09-10T20:56:37.132028+0000","last_active":"2024-09-10T20:56:39.638068+0000","last_peered":"2024-09-10T20:56:39.638068+0000","last_clean":"2024-09-10T20:56:39.638068+0000","last_became_active":"2024-09-10T20:56:37.131705+0000","last_became_peered":"2024-09-10T20:56:37.131705+0000","last_unstale":"2024-09-10T20:56:39.638068+0000","last_undegraded":"2024-09-10T20:56:39.638068+0000","last_fullsized":"2024-09-10T20:56:39.638068+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:17:42.504437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.637465+0000","last_change":"2024-09-10T20:56:38.163061+0000","last_active":"2024-09-10T20:56:39.637465+0000","last_peered":"2024-09-10T20:56:39.637465+0000","last_clean":"2024-09-10T20:56:39.637465+0000","last_became_active":"2024-09-10T20:56:38.162746+0000","last_became_peered":"2024-09-10T20:56:38.162746+0000","last_unstale":"2024-09-10T20:56:39.637465+0000","last_undegraded":"2024-09-10T20:56:39.637465+0000","last_fullsized":"2024-09-10T20:56:39.637465+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:52:08.011169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159202+0000","last_change":"2024-09-10T20:56:37.148385+0000","last_active":"2024-09-10T20:56:39.159202+0000","last_peered":"2024-09-10T20:56:39.159202+0000","last_clean":"2024-09-10T20:56:39.159202+0000","last_became_active":"2024-09-10T20:56:37.148079+0000","last_became_peered":"2024-09-10T20:56:37.148079+0000","last_unstale":"2024-09-10T20:56:39.159202+0000","last_undegraded":"2024-09-10T20:56:39.159202+0000","last_fullsized":"2024-09-10T20:56:39.159202+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:46:05.846818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.160626+0000","last_change":"2024-09-10T20:56:38.179549+0000","last_active":"2024-09-10T20:56:39.160626+0000","last_peered":"2024-09-10T20:56:39.160626+0000","last_clean":"2024-09-10T20:56:39.160626+0000","last_became_active":"2024-09-10T20:56:38.179259+0000","last_became_peered":"2024-09-10T20:56:38.179259+0000","last_unstale":"2024-09-10T20:56:39.160626+0000","last_undegraded":"2024-09-10T20:56:39.160626+0000","last_fullsized":"2024-09-10T20:56:39.160626+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:55.667614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895736+0000","last_change":"2024-09-10T20:56:37.139551+0000","last_active":"2024-09-10T20:56:39.895736+0000","last_peered":"2024-09-10T20:56:39.895736+0000","last_clean":"2024-09-10T20:56:39.895736+0000","last_became_active":"2024-09-10T20:56:37.139252+0000","last_became_peered":"2024-09-10T20:56:37.139252+0000","last_unstale":"2024-09-10T20:56:39.895736+0000","last_undegraded":"2024-09-10T20:56:39.895736+0000","last_fullsized":"2024-09-10T20:56:39.895736+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:37:14.449011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":134,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159985+0000","last_change":"2024-09-10T20:55:34.718784+0000","last_active":"2024-09-10T20:56:39.159985+0000","last_peered":"2024-09-10T20:56:39.159985+0000","last_clean":"2024-09-10T20:56:39.159985+0000","last_became_active":"2024-09-10T20:55:34.717616+0000","last_became_peered":"2024-09-10T20:55:34.717616+0000","last_unstale":"2024-09-10T20:56:39.159985+0000","last_undegraded":"2024-09-10T20:56:39.159985+0000","last_fullsized":"2024-09-10T20:56:39.159985+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:33.618098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:33.618098+0000","last_clean_scrub_stamp":"2024-09-10T20:55:33.618098+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:17.442729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":987136,"data_stored":743296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":397312,"data_stored":153454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":397312,"data_stored":153510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509456,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":397312,"data_stored":152942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":393216,"data_stored":152908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":154472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":983040,"data_stored":743206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":154472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T20:56:43.252 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T20:56:43.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.442+0000 7f1dcaa00640 1 -- 172.21.15.6:0/3671923449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dc415c170 msgr2=0x7f1dc40cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:43.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.442+0000 7f1dcaa00640 1 --2- 172.21.15.6:0/3671923449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dc415c170 0x7f1dc40cd920 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4051860 tx=0x7f1db002a4d0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.442+0000 7f1dcaa00640 1 -- 172.21.15.6:0/3671923449 shutdown_connections 2024-09-10T20:56:43.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.442+0000 7f1dcaa00640 1 --2- 172.21.15.6:0/3671923449 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1dc406fd40 0x7f1dc4070170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.442+0000 7f1dcaa00640 1 --2- 172.21.15.6:0/3671923449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dc415c170 0x7f1dc40cd920 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.442+0000 7f1dcaa00640 1 --2- 172.21.15.6:0/3671923449 >> v2:172.21.15.150:3300/0 conn(0x7f1dc4159670 0x7f1dc40743b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.442+0000 7f1dcaa00640 1 -- 172.21.15.6:0/3671923449 >> 172.21.15.6:0/3671923449 conn(0x7f1dc40cfa20 msgr2=0x7f1dc40cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:43.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.442+0000 7f1dcaa00640 1 -- 172.21.15.6:0/3671923449 shutdown_connections 2024-09-10T20:56:43.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.442+0000 7f1dcaa00640 1 -- 172.21.15.6:0/3671923449 wait complete. 2024-09-10T20:56:43.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.443+0000 7f1dcaa00640 1 Processor -- start 2024-09-10T20:56:43.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.443+0000 7f1dcaa00640 1 -- start start 2024-09-10T20:56:43.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.444+0000 7f1dcaa00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1dc406fd40 0x7f1dc40c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:43.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.444+0000 7f1dcaa00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dc4159670 0x7f1dc40adaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:43.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.444+0000 7f1dcaa00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1dc415c170 0x7f1dc40b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:43.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.444+0000 7f1dcaa00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc40b4a90 con 0x7f1dc4159670 2024-09-10T20:56:43.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.444+0000 7f1dcaa00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc40b4910 con 0x7f1dc406fd40 2024-09-10T20:56:43.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.444+0000 7f1dcaa00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f1dc40b4c10 con 0x7f1dc415c170 2024-09-10T20:56:43.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.445+0000 7f1dc3400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dc4159670 0x7f1dc40adaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:43.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.445+0000 7f1dc3400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dc4159670 0x7f1dc40adaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37936/0 (socket says 172.21.15.6:37936) 2024-09-10T20:56:43.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.445+0000 7f1dc3400640 1 -- 172.21.15.6:0/1004819214 learned_addr learned my addr 172.21.15.6:0/1004819214 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:43.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.445+0000 7f1dc3e00640 1 --2- 172.21.15.6:0/1004819214 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1dc406fd40 0x7f1dc40c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:43.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.445+0000 7f1dc8a00640 1 --2- 172.21.15.6:0/1004819214 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1dc415c170 0x7f1dc40b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:43.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.445+0000 7f1dc3400640 1 -- 172.21.15.6:0/1004819214 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1dc415c170 msgr2=0x7f1dc40b3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:43.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.445+0000 7f1dc3400640 1 --2- 172.21.15.6:0/1004819214 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1dc415c170 0x7f1dc40b3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.445+0000 7f1dc3400640 1 -- 172.21.15.6:0/1004819214 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1dc406fd40 msgr2=0x7f1dc40c89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:43.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.445+0000 7f1dc3400640 1 --2- 172.21.15.6:0/1004819214 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1dc406fd40 0x7f1dc40c89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.445+0000 7f1dc3400640 1 -- 172.21.15.6:0/1004819214 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dc40c7be0 con 0x7f1dc4159670 2024-09-10T20:56:43.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.445+0000 7f1dc8a00640 1 --2- 172.21.15.6:0/1004819214 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1dc415c170 0x7f1dc40b3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:56:43.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.445+0000 7f1dc3400640 1 --2- 172.21.15.6:0/1004819214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dc4159670 0x7f1dc40adaf0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1db0000c00 tx=0x7f1db0003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:43.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.446+0000 7f1dbbe00640 1 -- 172.21.15.6:0/1004819214 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db003f070 con 0x7f1dc4159670 2024-09-10T20:56:43.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.446+0000 7f1dbbe00640 1 -- 172.21.15.6:0/1004819214 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1db00047a0 con 0x7f1dc4159670 2024-09-10T20:56:43.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.446+0000 7f1dbbe00640 1 -- 172.21.15.6:0/1004819214 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db0035030 con 0x7f1dc4159670 2024-09-10T20:56:43.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.446+0000 7f1dcaa00640 1 -- 172.21.15.6:0/1004819214 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dc40c7ec0 con 0x7f1dc4159670 2024-09-10T20:56:43.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.446+0000 7f1dcaa00640 1 -- 172.21.15.6:0/1004819214 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dc40b3d50 con 0x7f1dc4159670 2024-09-10T20:56:43.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.447+0000 7f1dcaa00640 1 -- 172.21.15.6:0/1004819214 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dc40b51a0 con 0x7f1dc4159670 2024-09-10T20:56:43.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.448+0000 7f1dbbe00640 1 -- 172.21.15.6:0/1004819214 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f1db0004bb0 con 0x7f1dc4159670 2024-09-10T20:56:43.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.449+0000 7f1dbbe00640 1 --2- 172.21.15.6:0/1004819214 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f1da4077f70 0x7f1da407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:43.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.449+0000 7f1dbbe00640 1 -- 172.21.15.6:0/1004819214 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f1db00bae50 con 0x7f1dc4159670 2024-09-10T20:56:43.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.450+0000 7f1dc3e00640 1 --2- 172.21.15.6:0/1004819214 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f1da4077f70 0x7f1da407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:43.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.450+0000 7f1dc3e00640 1 --2- 172.21.15.6:0/1004819214 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f1da4077f70 0x7f1da407a430 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1db400bbe0 tx=0x7f1db400b390 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:43.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.453+0000 7f1dbbe00640 1 -- 172.21.15.6:0/1004819214 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f1db0083300 con 0x7f1dc4159670 2024-09-10T20:56:43.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.723+0000 7f1dcaa00640 1 -- 172.21.15.6:0/1004819214 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f1dc4069d20 con 0x7f1dc4159670 2024-09-10T20:56:43.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.723+0000 7f1dbbe00640 1 -- 172.21.15.6:0/1004819214 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1699 (secure 0 0 0) 0x7f1db0087d30 con 0x7f1dc4159670 2024-09-10T20:56:43.920 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:56:43.920 INFO:teuthology.orchestra.run.smithi006.stdout:{"fsid":"9e04309e-61c3-4c78-82db-9576e465d98a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":85,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":35,"num_osds":8,"num_up_osds":8,"osd_up_since":1726001732,"num_in_osds":8,"osd_in_since":1726001722,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":61},{"state_name":"active+clean","count":26},{"state_name":"unknown","count":10}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":225456128,"bytes_avail":772868657152,"bytes_total":773094113280,"unknown_pgs_ratio":0.10309278219938278,"inactive_pgs_ratio":0.62886595726013184},"fsmap":{"epoch":17,"btime":"2024-09-10T20:56:41:162013+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":4956}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-09-10T20:56:33.184810+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T20:56:43.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.726+0000 7f1dcaa00640 1 -- 172.21.15.6:0/1004819214 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f1da4077f70 msgr2=0x7f1da407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:43.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.726+0000 7f1dcaa00640 1 --2- 172.21.15.6:0/1004819214 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f1da4077f70 0x7f1da407a430 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1db400bbe0 tx=0x7f1db400b390 comp rx=0 tx=0).stop 2024-09-10T20:56:43.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.726+0000 7f1dcaa00640 1 -- 172.21.15.6:0/1004819214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dc4159670 msgr2=0x7f1dc40adaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:43.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.726+0000 7f1dcaa00640 1 --2- 172.21.15.6:0/1004819214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dc4159670 0x7f1dc40adaf0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1db0000c00 tx=0x7f1db0003910 comp rx=0 tx=0).stop 2024-09-10T20:56:43.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.726+0000 7f1dcaa00640 1 -- 172.21.15.6:0/1004819214 shutdown_connections 2024-09-10T20:56:43.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.726+0000 7f1dcaa00640 1 --2- 172.21.15.6:0/1004819214 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f1da4077f70 0x7f1da407a430 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.726+0000 7f1dcaa00640 1 --2- 172.21.15.6:0/1004819214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dc4159670 0x7f1dc40adaf0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.726+0000 7f1dcaa00640 1 --2- 172.21.15.6:0/1004819214 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1dc415c170 0x7f1dc40b3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.726+0000 7f1dcaa00640 1 --2- 172.21.15.6:0/1004819214 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1dc406fd40 0x7f1dc40c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.726+0000 7f1dcaa00640 1 -- 172.21.15.6:0/1004819214 >> 172.21.15.6:0/1004819214 conn(0x7f1dc40cfa20 msgr2=0x7f1dc415d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:43.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.726+0000 7f1dcaa00640 1 -- 172.21.15.6:0/1004819214 shutdown_connections 2024-09-10T20:56:43.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:43.726+0000 7f1dcaa00640 1 -- 172.21.15.6:0/1004819214 wait complete. 2024-09-10T20:56:43.923 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-10T20:56:43.923 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T20:56:44.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.080+0000 7fc667000640 1 -- 172.21.15.6:0/1761578387 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc66015c170 msgr2=0x7fc6600cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:44.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.080+0000 7fc667000640 1 --2- 172.21.15.6:0/1761578387 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc66015c170 0x7fc6600cd920 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc648005fd0 tx=0x7fc64802a540 comp rx=0 tx=0).stop 2024-09-10T20:56:44.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.080+0000 7fc667000640 1 -- 172.21.15.6:0/1761578387 shutdown_connections 2024-09-10T20:56:44.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.080+0000 7fc667000640 1 --2- 172.21.15.6:0/1761578387 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc66015c170 0x7fc6600cd920 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:44.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.080+0000 7fc667000640 1 --2- 172.21.15.6:0/1761578387 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc660159670 0x7fc6600743b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:44.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.080+0000 7fc667000640 1 -- 172.21.15.6:0/1761578387 >> 172.21.15.6:0/1761578387 conn(0x7fc6600cfa20 msgr2=0x7fc6600cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:44.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.080+0000 7fc667000640 1 -- 172.21.15.6:0/1761578387 shutdown_connections 2024-09-10T20:56:44.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.080+0000 7fc667000640 1 -- 172.21.15.6:0/1761578387 wait complete. 2024-09-10T20:56:44.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.081+0000 7fc667000640 1 Processor -- start 2024-09-10T20:56:44.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.082+0000 7fc667000640 1 -- start start 2024-09-10T20:56:44.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.082+0000 7fc667000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc66006fd40 0x7fc6601551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:44.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.082+0000 7fc667000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc660159670 0x7fc66015b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:44.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.083+0000 7fc667000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc66015c170 0x7fc6601545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:44.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.083+0000 7fc667000640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc6600b4ca0 con 0x7fc66006fd40 2024-09-10T20:56:44.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.083+0000 7fc667000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc6600b4b20 con 0x7fc660159670 2024-09-10T20:56:44.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.083+0000 7fc667000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fc6600b4e20 con 0x7fc66015c170 2024-09-10T20:56:44.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.083+0000 7fc65fe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc66006fd40 0x7fc6601551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:44.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.083+0000 7fc65fe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc66006fd40 0x7fc6601551d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37958/0 (socket says 172.21.15.6:37958) 2024-09-10T20:56:44.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.083+0000 7fc65fe00640 1 -- 172.21.15.6:0/2892364343 learned_addr learned my addr 172.21.15.6:0/2892364343 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:44.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.083+0000 7fc657400640 1 --2- 172.21.15.6:0/2892364343 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc660159670 0x7fc66015b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:44.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.083+0000 7fc665000640 1 --2- 172.21.15.6:0/2892364343 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc66015c170 0x7fc6601545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:44.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.083+0000 7fc65fe00640 1 -- 172.21.15.6:0/2892364343 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc66015c170 msgr2=0x7fc6601545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:44.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.083+0000 7fc65fe00640 1 --2- 172.21.15.6:0/2892364343 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc66015c170 0x7fc6601545e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:44.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.083+0000 7fc65fe00640 1 -- 172.21.15.6:0/2892364343 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc660159670 msgr2=0x7fc66015b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:44.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.083+0000 7fc65fe00640 1 --2- 172.21.15.6:0/2892364343 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc660159670 0x7fc66015b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:44.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.083+0000 7fc65fe00640 1 -- 172.21.15.6:0/2892364343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc66015bc70 con 0x7fc66006fd40 2024-09-10T20:56:44.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.084+0000 7fc65fe00640 1 --2- 172.21.15.6:0/2892364343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc66006fd40 0x7fc6601551d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc65000d980 tx=0x7fc65000de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:44.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.084+0000 7fc65cc00640 1 -- 172.21.15.6:0/2892364343 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc650017070 con 0x7fc66006fd40 2024-09-10T20:56:44.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.084+0000 7fc65cc00640 1 -- 172.21.15.6:0/2892364343 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc650009d20 con 0x7fc66006fd40 2024-09-10T20:56:44.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.084+0000 7fc65cc00640 1 -- 172.21.15.6:0/2892364343 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6500106c0 con 0x7fc66006fd40 2024-09-10T20:56:44.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.084+0000 7fc667000640 1 -- 172.21.15.6:0/2892364343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc660156b50 con 0x7fc66006fd40 2024-09-10T20:56:44.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.084+0000 7fc667000640 1 -- 172.21.15.6:0/2892364343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc660156790 con 0x7fc66006fd40 2024-09-10T20:56:44.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.085+0000 7fc667000640 1 -- 172.21.15.6:0/2892364343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6600b5340 con 0x7fc66006fd40 2024-09-10T20:56:44.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.086+0000 7fc65cc00640 1 -- 172.21.15.6:0/2892364343 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc650010860 con 0x7fc66006fd40 2024-09-10T20:56:44.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.087+0000 7fc65cc00640 1 --2- 172.21.15.6:0/2892364343 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fc63c077fa0 0x7fc63c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:44.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.087+0000 7fc65cc00640 1 -- 172.21.15.6:0/2892364343 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fc65009a1e0 con 0x7fc66006fd40 2024-09-10T20:56:44.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.088+0000 7fc657400640 1 --2- 172.21.15.6:0/2892364343 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fc63c077fa0 0x7fc63c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:44.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.088+0000 7fc657400640 1 --2- 172.21.15.6:0/2892364343 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fc63c077fa0 0x7fc63c07a460 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc648033000 tx=0x7fc648004730 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:44.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.091+0000 7fc65cc00640 1 -- 172.21.15.6:0/2892364343 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc6500625f0 con 0x7fc66006fd40 2024-09-10T20:56:44.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.285+0000 7fc667000640 1 -- 172.21.15.6:0/2892364343 --> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc660069d20 con 0x7fc63c077fa0 2024-09-10T20:56:44.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.290+0000 7fc65cc00640 1 -- 172.21.15.6:0/2892364343 <== mgr.4120 v2:172.21.15.150:6800/1238179351 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251940 (secure 0 0 0) 0x7fc660069d20 con 0x7fc63c077fa0 2024-09-10T20:56:44.297 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:56:44.298 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-10T20:56:44.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.294+0000 7fc667000640 1 -- 172.21.15.6:0/2892364343 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fc63c077fa0 msgr2=0x7fc63c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:44.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.294+0000 7fc667000640 1 --2- 172.21.15.6:0/2892364343 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fc63c077fa0 0x7fc63c07a460 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc648033000 tx=0x7fc648004730 comp rx=0 tx=0).stop 2024-09-10T20:56:44.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.294+0000 7fc667000640 1 -- 172.21.15.6:0/2892364343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc66006fd40 msgr2=0x7fc6601551d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:44.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.294+0000 7fc667000640 1 --2- 172.21.15.6:0/2892364343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc66006fd40 0x7fc6601551d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc65000d980 tx=0x7fc65000de40 comp rx=0 tx=0).stop 2024-09-10T20:56:44.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.294+0000 7fc667000640 1 -- 172.21.15.6:0/2892364343 shutdown_connections 2024-09-10T20:56:44.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.294+0000 7fc667000640 1 --2- 172.21.15.6:0/2892364343 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fc63c077fa0 0x7fc63c07a460 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:44.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.294+0000 7fc667000640 1 --2- 172.21.15.6:0/2892364343 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc66015c170 0x7fc6601545e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:44.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.294+0000 7fc667000640 1 --2- 172.21.15.6:0/2892364343 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc660159670 0x7fc66015b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:44.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.294+0000 7fc667000640 1 --2- 172.21.15.6:0/2892364343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc66006fd40 0x7fc6601551d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:44.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.294+0000 7fc667000640 1 -- 172.21.15.6:0/2892364343 >> 172.21.15.6:0/2892364343 conn(0x7fc6600cfa20 msgr2=0x7fc6600b28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:44.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.295+0000 7fc667000640 1 -- 172.21.15.6:0/2892364343 shutdown_connections 2024-09-10T20:56:44.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:44.295+0000 7fc667000640 1 -- 172.21.15.6:0/2892364343 wait complete. 2024-09-10T20:56:44.314 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2024-09-10T20:56:43.186492+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220520,"kb_used_data":4264,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754200,"statfs":{"total":773094113280,"available":772868300800,"internally_reserved":0,"allocated":4366336,"data_stored":2408260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.065747"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895829+0000","last_change":"2024-09-10T20:56:38.156240+0000","last_active":"2024-09-10T20:56:39.895829+0000","last_peered":"2024-09-10T20:56:39.895829+0000","last_clean":"2024-09-10T20:56:39.895829+0000","last_became_active":"2024-09-10T20:56:38.155782+0000","last_became_peered":"2024-09-10T20:56:38.155782+0000","last_unstale":"2024-09-10T20:56:39.895829+0000","last_undegraded":"2024-09-10T20:56:39.895829+0000","last_fullsized":"2024-09-10T20:56:39.895829+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:19.775884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159758+0000","last_change":"2024-09-10T20:56:38.171671+0000","last_active":"2024-09-10T20:56:39.159758+0000","last_peered":"2024-09-10T20:56:39.159758+0000","last_clean":"2024-09-10T20:56:39.159758+0000","last_became_active":"2024-09-10T20:56:38.171389+0000","last_became_peered":"2024-09-10T20:56:38.171389+0000","last_unstale":"2024-09-10T20:56:39.159758+0000","last_undegraded":"2024-09-10T20:56:39.159758+0000","last_fullsized":"2024-09-10T20:56:39.159758+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:17.915009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159548+0000","last_change":"2024-09-10T20:56:38.176130+0000","last_active":"2024-09-10T20:56:39.159548+0000","last_peered":"2024-09-10T20:56:39.159548+0000","last_clean":"2024-09-10T20:56:39.159548+0000","last_became_active":"2024-09-10T20:56:38.175453+0000","last_became_peered":"2024-09-10T20:56:38.175453+0000","last_unstale":"2024-09-10T20:56:39.159548+0000","last_undegraded":"2024-09-10T20:56:39.159548+0000","last_fullsized":"2024-09-10T20:56:39.159548+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:38.009983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.827631+0000","last_change":"2024-09-10T20:56:38.174330+0000","last_active":"2024-09-10T20:56:39.827631+0000","last_peered":"2024-09-10T20:56:39.827631+0000","last_clean":"2024-09-10T20:56:39.827631+0000","last_became_active":"2024-09-10T20:56:38.174085+0000","last_became_peered":"2024-09-10T20:56:38.174085+0000","last_unstale":"2024-09-10T20:56:39.827631+0000","last_undegraded":"2024-09-10T20:56:39.827631+0000","last_fullsized":"2024-09-10T20:56:39.827631+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:58:24.390781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.826376+0000","last_change":"2024-09-10T20:56:38.168194+0000","last_active":"2024-09-10T20:56:39.826376+0000","last_peered":"2024-09-10T20:56:39.826376+0000","last_clean":"2024-09-10T20:56:39.826376+0000","last_became_active":"2024-09-10T20:56:38.167861+0000","last_became_peered":"2024-09-10T20:56:38.167861+0000","last_unstale":"2024-09-10T20:56:39.826376+0000","last_undegraded":"2024-09-10T20:56:39.826376+0000","last_fullsized":"2024-09-10T20:56:39.826376+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:13.273365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159294+0000","last_change":"2024-09-10T20:56:38.156995+0000","last_active":"2024-09-10T20:56:39.159294+0000","last_peered":"2024-09-10T20:56:39.159294+0000","last_clean":"2024-09-10T20:56:39.159294+0000","last_became_active":"2024-09-10T20:56:38.156519+0000","last_became_peered":"2024-09-10T20:56:38.156519+0000","last_unstale":"2024-09-10T20:56:39.159294+0000","last_undegraded":"2024-09-10T20:56:39.159294+0000","last_fullsized":"2024-09-10T20:56:39.159294+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:44:30.630575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.160932+0000","last_change":"2024-09-10T20:56:38.180671+0000","last_active":"2024-09-10T20:56:39.160932+0000","last_peered":"2024-09-10T20:56:39.160932+0000","last_clean":"2024-09-10T20:56:39.160932+0000","last_became_active":"2024-09-10T20:56:38.180388+0000","last_became_peered":"2024-09-10T20:56:38.180388+0000","last_unstale":"2024-09-10T20:56:39.160932+0000","last_undegraded":"2024-09-10T20:56:39.160932+0000","last_fullsized":"2024-09-10T20:56:39.160932+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:51.074302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159545+0000","last_change":"2024-09-10T20:56:38.179102+0000","last_active":"2024-09-10T20:56:39.159545+0000","last_peered":"2024-09-10T20:56:39.159545+0000","last_clean":"2024-09-10T20:56:39.159545+0000","last_became_active":"2024-09-10T20:56:38.178426+0000","last_became_peered":"2024-09-10T20:56:38.178426+0000","last_unstale":"2024-09-10T20:56:39.159545+0000","last_undegraded":"2024-09-10T20:56:39.159545+0000","last_fullsized":"2024-09-10T20:56:39.159545+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:00:54.042716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.637843+0000","last_change":"2024-09-10T20:56:38.176880+0000","last_active":"2024-09-10T20:56:39.637843+0000","last_peered":"2024-09-10T20:56:39.637843+0000","last_clean":"2024-09-10T20:56:39.637843+0000","last_became_active":"2024-09-10T20:56:38.176589+0000","last_became_peered":"2024-09-10T20:56:38.176589+0000","last_unstale":"2024-09-10T20:56:39.637843+0000","last_undegraded":"2024-09-10T20:56:39.637843+0000","last_fullsized":"2024-09-10T20:56:39.637843+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:38.109672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.827739+0000","last_change":"2024-09-10T20:56:38.169154+0000","last_active":"2024-09-10T20:56:39.827739+0000","last_peered":"2024-09-10T20:56:39.827739+0000","last_clean":"2024-09-10T20:56:39.827739+0000","last_became_active":"2024-09-10T20:56:38.166148+0000","last_became_peered":"2024-09-10T20:56:38.166148+0000","last_unstale":"2024-09-10T20:56:39.827739+0000","last_undegraded":"2024-09-10T20:56:39.827739+0000","last_fullsized":"2024-09-10T20:56:39.827739+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:17:07.908211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.160898+0000","last_change":"2024-09-10T20:56:38.177874+0000","last_active":"2024-09-10T20:56:39.160898+0000","last_peered":"2024-09-10T20:56:39.160898+0000","last_clean":"2024-09-10T20:56:39.160898+0000","last_became_active":"2024-09-10T20:56:38.177513+0000","last_became_peered":"2024-09-10T20:56:38.177513+0000","last_unstale":"2024-09-10T20:56:39.160898+0000","last_undegraded":"2024-09-10T20:56:39.160898+0000","last_fullsized":"2024-09-10T20:56:39.160898+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:08:05.011647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159924+0000","last_change":"2024-09-10T20:56:38.163865+0000","last_active":"2024-09-10T20:56:39.159924+0000","last_peered":"2024-09-10T20:56:39.159924+0000","last_clean":"2024-09-10T20:56:39.159924+0000","last_became_active":"2024-09-10T20:56:38.163579+0000","last_became_peered":"2024-09-10T20:56:38.163579+0000","last_unstale":"2024-09-10T20:56:39.159924+0000","last_undegraded":"2024-09-10T20:56:39.159924+0000","last_fullsized":"2024-09-10T20:56:39.159924+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:55.667614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.826322+0000","last_change":"2024-09-10T20:56:38.173448+0000","last_active":"2024-09-10T20:56:39.826322+0000","last_peered":"2024-09-10T20:56:39.826322+0000","last_clean":"2024-09-10T20:56:39.826322+0000","last_became_active":"2024-09-10T20:56:38.173195+0000","last_became_peered":"2024-09-10T20:56:38.173195+0000","last_unstale":"2024-09-10T20:56:39.826322+0000","last_undegraded":"2024-09-10T20:56:39.826322+0000","last_fullsized":"2024-09-10T20:56:39.826322+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:32:51.967432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159409+0000","last_change":"2024-09-10T20:56:38.155556+0000","last_active":"2024-09-10T20:56:39.159409+0000","last_peered":"2024-09-10T20:56:39.159409+0000","last_clean":"2024-09-10T20:56:39.159409+0000","last_became_active":"2024-09-10T20:56:38.155251+0000","last_became_peered":"2024-09-10T20:56:38.155251+0000","last_unstale":"2024-09-10T20:56:39.159409+0000","last_undegraded":"2024-09-10T20:56:39.159409+0000","last_fullsized":"2024-09-10T20:56:39.159409+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:02:08.850930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159560+0000","last_change":"2024-09-10T20:56:38.153485+0000","last_active":"2024-09-10T20:56:39.159560+0000","last_peered":"2024-09-10T20:56:39.159560+0000","last_clean":"2024-09-10T20:56:39.159560+0000","last_became_active":"2024-09-10T20:56:38.153171+0000","last_became_peered":"2024-09-10T20:56:38.153171+0000","last_unstale":"2024-09-10T20:56:39.159560+0000","last_undegraded":"2024-09-10T20:56:39.159560+0000","last_fullsized":"2024-09-10T20:56:39.159560+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:28:45.478675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159861+0000","last_change":"2024-09-10T20:56:38.177749+0000","last_active":"2024-09-10T20:56:39.159861+0000","last_peered":"2024-09-10T20:56:39.159861+0000","last_clean":"2024-09-10T20:56:39.159861+0000","last_became_active":"2024-09-10T20:56:38.177346+0000","last_became_peered":"2024-09-10T20:56:38.177346+0000","last_unstale":"2024-09-10T20:56:39.159861+0000","last_undegraded":"2024-09-10T20:56:39.159861+0000","last_fullsized":"2024-09-10T20:56:39.159861+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:06:05.780968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.161471+0000","last_change":"2024-09-10T20:56:38.180281+0000","last_active":"2024-09-10T20:56:39.161471+0000","last_peered":"2024-09-10T20:56:39.161471+0000","last_clean":"2024-09-10T20:56:39.161471+0000","last_became_active":"2024-09-10T20:56:38.179991+0000","last_became_peered":"2024-09-10T20:56:38.179991+0000","last_unstale":"2024-09-10T20:56:39.161471+0000","last_undegraded":"2024-09-10T20:56:39.161471+0000","last_fullsized":"2024-09-10T20:56:39.161471+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:58:59.841437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159954+0000","last_change":"2024-09-10T20:56:38.166160+0000","last_active":"2024-09-10T20:56:39.159954+0000","last_peered":"2024-09-10T20:56:39.159954+0000","last_clean":"2024-09-10T20:56:39.159954+0000","last_became_active":"2024-09-10T20:56:38.165859+0000","last_became_peered":"2024-09-10T20:56:38.165859+0000","last_unstale":"2024-09-10T20:56:39.159954+0000","last_undegraded":"2024-09-10T20:56:39.159954+0000","last_fullsized":"2024-09-10T20:56:39.159954+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:48.491833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159445+0000","last_change":"2024-09-10T20:56:38.171799+0000","last_active":"2024-09-10T20:56:39.159445+0000","last_peered":"2024-09-10T20:56:39.159445+0000","last_clean":"2024-09-10T20:56:39.159445+0000","last_became_active":"2024-09-10T20:56:38.170480+0000","last_became_peered":"2024-09-10T20:56:38.170480+0000","last_unstale":"2024-09-10T20:56:39.159445+0000","last_undegraded":"2024-09-10T20:56:39.159445+0000","last_fullsized":"2024-09-10T20:56:39.159445+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:13.448693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.826511+0000","last_change":"2024-09-10T20:56:38.170878+0000","last_active":"2024-09-10T20:56:39.826511+0000","last_peered":"2024-09-10T20:56:39.826511+0000","last_clean":"2024-09-10T20:56:39.826511+0000","last_became_active":"2024-09-10T20:56:38.164065+0000","last_became_peered":"2024-09-10T20:56:38.164065+0000","last_unstale":"2024-09-10T20:56:39.826511+0000","last_undegraded":"2024-09-10T20:56:39.826511+0000","last_fullsized":"2024-09-10T20:56:39.826511+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:37:15.457558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.637528+0000","last_change":"2024-09-10T20:56:38.160211+0000","last_active":"2024-09-10T20:56:39.637528+0000","last_peered":"2024-09-10T20:56:39.637528+0000","last_clean":"2024-09-10T20:56:39.637528+0000","last_became_active":"2024-09-10T20:56:38.159934+0000","last_became_peered":"2024-09-10T20:56:38.159934+0000","last_unstale":"2024-09-10T20:56:39.637528+0000","last_undegraded":"2024-09-10T20:56:39.637528+0000","last_fullsized":"2024-09-10T20:56:39.637528+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:58:27.629519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.637570+0000","last_change":"2024-09-10T20:56:38.169611+0000","last_active":"2024-09-10T20:56:39.637570+0000","last_peered":"2024-09-10T20:56:39.637570+0000","last_clean":"2024-09-10T20:56:39.637570+0000","last_became_active":"2024-09-10T20:56:38.168669+0000","last_became_peered":"2024-09-10T20:56:38.168669+0000","last_unstale":"2024-09-10T20:56:39.637570+0000","last_undegraded":"2024-09-10T20:56:39.637570+0000","last_fullsized":"2024-09-10T20:56:39.637570+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:36.229445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895621+0000","last_change":"2024-09-10T20:56:38.171294+0000","last_active":"2024-09-10T20:56:39.895621+0000","last_peered":"2024-09-10T20:56:39.895621+0000","last_clean":"2024-09-10T20:56:39.895621+0000","last_became_active":"2024-09-10T20:56:38.171036+0000","last_became_peered":"2024-09-10T20:56:38.171036+0000","last_unstale":"2024-09-10T20:56:39.895621+0000","last_undegraded":"2024-09-10T20:56:39.895621+0000","last_fullsized":"2024-09-10T20:56:39.895621+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:50.366589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.160295+0000","last_change":"2024-09-10T20:56:38.161533+0000","last_active":"2024-09-10T20:56:39.160295+0000","last_peered":"2024-09-10T20:56:39.160295+0000","last_clean":"2024-09-10T20:56:39.160295+0000","last_became_active":"2024-09-10T20:56:38.160862+0000","last_became_peered":"2024-09-10T20:56:38.160862+0000","last_unstale":"2024-09-10T20:56:39.160295+0000","last_undegraded":"2024-09-10T20:56:39.160295+0000","last_fullsized":"2024-09-10T20:56:39.160295+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:49:12.825733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.827849+0000","last_change":"2024-09-10T20:56:38.168070+0000","last_active":"2024-09-10T20:56:39.827849+0000","last_peered":"2024-09-10T20:56:39.827849+0000","last_clean":"2024-09-10T20:56:39.827849+0000","last_became_active":"2024-09-10T20:56:38.167670+0000","last_became_peered":"2024-09-10T20:56:38.167670+0000","last_unstale":"2024-09-10T20:56:39.827849+0000","last_undegraded":"2024-09-10T20:56:39.827849+0000","last_fullsized":"2024-09-10T20:56:39.827849+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:59.382183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.160054+0000","last_change":"2024-09-10T20:56:38.171776+0000","last_active":"2024-09-10T20:56:39.160054+0000","last_peered":"2024-09-10T20:56:39.160054+0000","last_clean":"2024-09-10T20:56:39.160054+0000","last_became_active":"2024-09-10T20:56:38.171471+0000","last_became_peered":"2024-09-10T20:56:38.171471+0000","last_unstale":"2024-09-10T20:56:39.160054+0000","last_undegraded":"2024-09-10T20:56:39.160054+0000","last_fullsized":"2024-09-10T20:56:39.160054+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:38:19.333053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.827962+0000","last_change":"2024-09-10T20:56:38.174896+0000","last_active":"2024-09-10T20:56:39.827962+0000","last_peered":"2024-09-10T20:56:39.827962+0000","last_clean":"2024-09-10T20:56:39.827962+0000","last_became_active":"2024-09-10T20:56:38.174670+0000","last_became_peered":"2024-09-10T20:56:38.174670+0000","last_unstale":"2024-09-10T20:56:39.827962+0000","last_undegraded":"2024-09-10T20:56:39.827962+0000","last_fullsized":"2024-09-10T20:56:39.827962+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:00:54.042716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.160155+0000","last_change":"2024-09-10T20:56:38.154093+0000","last_active":"2024-09-10T20:56:39.160155+0000","last_peered":"2024-09-10T20:56:39.160155+0000","last_clean":"2024-09-10T20:56:39.160155+0000","last_became_active":"2024-09-10T20:56:38.153777+0000","last_became_peered":"2024-09-10T20:56:38.153777+0000","last_unstale":"2024-09-10T20:56:39.160155+0000","last_undegraded":"2024-09-10T20:56:39.160155+0000","last_fullsized":"2024-09-10T20:56:39.160155+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:59:49.859563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.637662+0000","last_change":"2024-09-10T20:56:38.170234+0000","last_active":"2024-09-10T20:56:39.637662+0000","last_peered":"2024-09-10T20:56:39.637662+0000","last_clean":"2024-09-10T20:56:39.637662+0000","last_became_active":"2024-09-10T20:56:38.169332+0000","last_became_peered":"2024-09-10T20:56:38.169332+0000","last_unstale":"2024-09-10T20:56:39.637662+0000","last_undegraded":"2024-09-10T20:56:39.637662+0000","last_fullsized":"2024-09-10T20:56:39.637662+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:11.752362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.160711+0000","last_change":"2024-09-10T20:56:38.175358+0000","last_active":"2024-09-10T20:56:39.160711+0000","last_peered":"2024-09-10T20:56:39.160711+0000","last_clean":"2024-09-10T20:56:39.160711+0000","last_became_active":"2024-09-10T20:56:38.175060+0000","last_became_peered":"2024-09-10T20:56:38.175060+0000","last_unstale":"2024-09-10T20:56:39.160711+0000","last_undegraded":"2024-09-10T20:56:39.160711+0000","last_fullsized":"2024-09-10T20:56:39.160711+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:59:49.859563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895822+0000","last_change":"2024-09-10T20:56:38.163171+0000","last_active":"2024-09-10T20:56:39.895822+0000","last_peered":"2024-09-10T20:56:39.895822+0000","last_clean":"2024-09-10T20:56:39.895822+0000","last_became_active":"2024-09-10T20:56:38.162550+0000","last_became_peered":"2024-09-10T20:56:38.162550+0000","last_unstale":"2024-09-10T20:56:39.895822+0000","last_undegraded":"2024-09-10T20:56:39.895822+0000","last_fullsized":"2024-09-10T20:56:39.895822+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:58:47.246890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159464+0000","last_change":"2024-09-10T20:56:38.169276+0000","last_active":"2024-09-10T20:56:39.159464+0000","last_peered":"2024-09-10T20:56:39.159464+0000","last_clean":"2024-09-10T20:56:39.159464+0000","last_became_active":"2024-09-10T20:56:38.166792+0000","last_became_peered":"2024-09-10T20:56:38.166792+0000","last_unstale":"2024-09-10T20:56:39.159464+0000","last_undegraded":"2024-09-10T20:56:39.159464+0000","last_fullsized":"2024-09-10T20:56:39.159464+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:38.009983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895822+0000","last_change":"2024-09-10T20:56:38.169453+0000","last_active":"2024-09-10T20:56:39.895822+0000","last_peered":"2024-09-10T20:56:39.895822+0000","last_clean":"2024-09-10T20:56:39.895822+0000","last_became_active":"2024-09-10T20:56:38.169173+0000","last_became_peered":"2024-09-10T20:56:38.169173+0000","last_unstale":"2024-09-10T20:56:39.895822+0000","last_undegraded":"2024-09-10T20:56:39.895822+0000","last_fullsized":"2024-09-10T20:56:39.895822+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:46:19.482863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895993+0000","last_change":"2024-09-10T20:56:37.146191+0000","last_active":"2024-09-10T20:56:39.895993+0000","last_peered":"2024-09-10T20:56:39.895993+0000","last_clean":"2024-09-10T20:56:39.895993+0000","last_became_active":"2024-09-10T20:56:37.145878+0000","last_became_peered":"2024-09-10T20:56:37.145878+0000","last_unstale":"2024-09-10T20:56:39.895993+0000","last_undegraded":"2024-09-10T20:56:39.895993+0000","last_fullsized":"2024-09-10T20:56:39.895993+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:27.004455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895968+0000","last_change":"2024-09-10T20:56:38.168411+0000","last_active":"2024-09-10T20:56:39.895968+0000","last_peered":"2024-09-10T20:56:39.895968+0000","last_clean":"2024-09-10T20:56:39.895968+0000","last_became_active":"2024-09-10T20:56:38.167842+0000","last_became_peered":"2024-09-10T20:56:38.167842+0000","last_unstale":"2024-09-10T20:56:39.895968+0000","last_undegraded":"2024-09-10T20:56:39.895968+0000","last_fullsized":"2024-09-10T20:56:39.895968+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:45.328902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895800+0000","last_change":"2024-09-10T20:56:37.140973+0000","last_active":"2024-09-10T20:56:39.895800+0000","last_peered":"2024-09-10T20:56:39.895800+0000","last_clean":"2024-09-10T20:56:39.895800+0000","last_became_active":"2024-09-10T20:56:37.140621+0000","last_became_peered":"2024-09-10T20:56:37.140621+0000","last_unstale":"2024-09-10T20:56:39.895800+0000","last_undegraded":"2024-09-10T20:56:39.895800+0000","last_fullsized":"2024-09-10T20:56:39.895800+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:38.108076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.637901+0000","last_change":"2024-09-10T20:56:38.169377+0000","last_active":"2024-09-10T20:56:39.637901+0000","last_peered":"2024-09-10T20:56:39.637901+0000","last_clean":"2024-09-10T20:56:39.637901+0000","last_became_active":"2024-09-10T20:56:38.169086+0000","last_became_peered":"2024-09-10T20:56:38.169086+0000","last_unstale":"2024-09-10T20:56:39.637901+0000","last_undegraded":"2024-09-10T20:56:39.637901+0000","last_fullsized":"2024-09-10T20:56:39.637901+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:40.150106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159487+0000","last_change":"2024-09-10T20:56:37.144531+0000","last_active":"2024-09-10T20:56:39.159487+0000","last_peered":"2024-09-10T20:56:39.159487+0000","last_clean":"2024-09-10T20:56:39.159487+0000","last_became_active":"2024-09-10T20:56:37.144184+0000","last_became_peered":"2024-09-10T20:56:37.144184+0000","last_unstale":"2024-09-10T20:56:39.159487+0000","last_undegraded":"2024-09-10T20:56:39.159487+0000","last_fullsized":"2024-09-10T20:56:39.159487+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:27.031518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.828023+0000","last_change":"2024-09-10T20:56:38.169857+0000","last_active":"2024-09-10T20:56:39.828023+0000","last_peered":"2024-09-10T20:56:39.828023+0000","last_clean":"2024-09-10T20:56:39.828023+0000","last_became_active":"2024-09-10T20:56:38.169565+0000","last_became_peered":"2024-09-10T20:56:38.169565+0000","last_unstale":"2024-09-10T20:56:39.828023+0000","last_undegraded":"2024-09-10T20:56:39.828023+0000","last_fullsized":"2024-09-10T20:56:39.828023+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:11.205627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.826464+0000","last_change":"2024-09-10T20:56:37.141690+0000","last_active":"2024-09-10T20:56:39.826464+0000","last_peered":"2024-09-10T20:56:39.826464+0000","last_clean":"2024-09-10T20:56:39.826464+0000","last_became_active":"2024-09-10T20:56:37.141098+0000","last_became_peered":"2024-09-10T20:56:37.141098+0000","last_unstale":"2024-09-10T20:56:39.826464+0000","last_undegraded":"2024-09-10T20:56:39.826464+0000","last_fullsized":"2024-09-10T20:56:39.826464+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:47:59.966545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.160694+0000","last_change":"2024-09-10T20:56:38.174236+0000","last_active":"2024-09-10T20:56:39.160694+0000","last_peered":"2024-09-10T20:56:39.160694+0000","last_clean":"2024-09-10T20:56:39.160694+0000","last_became_active":"2024-09-10T20:56:38.173182+0000","last_became_peered":"2024-09-10T20:56:38.173182+0000","last_unstale":"2024-09-10T20:56:39.160694+0000","last_undegraded":"2024-09-10T20:56:39.160694+0000","last_fullsized":"2024-09-10T20:56:39.160694+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:04:55.129378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.637689+0000","last_change":"2024-09-10T20:56:37.142809+0000","last_active":"2024-09-10T20:56:39.637689+0000","last_peered":"2024-09-10T20:56:39.637689+0000","last_clean":"2024-09-10T20:56:39.637689+0000","last_became_active":"2024-09-10T20:56:37.142502+0000","last_became_peered":"2024-09-10T20:56:37.142502+0000","last_unstale":"2024-09-10T20:56:39.637689+0000","last_undegraded":"2024-09-10T20:56:39.637689+0000","last_fullsized":"2024-09-10T20:56:39.637689+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:05.157672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159627+0000","last_change":"2024-09-10T20:56:38.159186+0000","last_active":"2024-09-10T20:56:39.159627+0000","last_peered":"2024-09-10T20:56:39.159627+0000","last_clean":"2024-09-10T20:56:39.159627+0000","last_became_active":"2024-09-10T20:56:38.157690+0000","last_became_peered":"2024-09-10T20:56:38.157690+0000","last_unstale":"2024-09-10T20:56:39.159627+0000","last_undegraded":"2024-09-10T20:56:39.159627+0000","last_fullsized":"2024-09-10T20:56:39.159627+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:11.205627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.637585+0000","last_change":"2024-09-10T20:56:37.138322+0000","last_active":"2024-09-10T20:56:39.637585+0000","last_peered":"2024-09-10T20:56:39.637585+0000","last_clean":"2024-09-10T20:56:39.637585+0000","last_became_active":"2024-09-10T20:56:37.138056+0000","last_became_peered":"2024-09-10T20:56:37.138056+0000","last_unstale":"2024-09-10T20:56:39.637585+0000","last_undegraded":"2024-09-10T20:56:39.637585+0000","last_fullsized":"2024-09-10T20:56:39.637585+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:54:41.214426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.637832+0000","last_change":"2024-09-10T20:56:38.157572+0000","last_active":"2024-09-10T20:56:39.637832+0000","last_peered":"2024-09-10T20:56:39.637832+0000","last_clean":"2024-09-10T20:56:39.637832+0000","last_became_active":"2024-09-10T20:56:38.156050+0000","last_became_peered":"2024-09-10T20:56:38.156050+0000","last_unstale":"2024-09-10T20:56:39.637832+0000","last_undegraded":"2024-09-10T20:56:39.637832+0000","last_fullsized":"2024-09-10T20:56:39.637832+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:26:40.971161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159051+0000","last_change":"2024-09-10T20:56:37.145395+0000","last_active":"2024-09-10T20:56:39.159051+0000","last_peered":"2024-09-10T20:56:39.159051+0000","last_clean":"2024-09-10T20:56:39.159051+0000","last_became_active":"2024-09-10T20:56:37.145130+0000","last_became_peered":"2024-09-10T20:56:37.145130+0000","last_unstale":"2024-09-10T20:56:39.159051+0000","last_undegraded":"2024-09-10T20:56:39.159051+0000","last_fullsized":"2024-09-10T20:56:39.159051+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:03:46.184293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.827480+0000","last_change":"2024-09-10T20:56:38.158119+0000","last_active":"2024-09-10T20:56:39.827480+0000","last_peered":"2024-09-10T20:56:39.827480+0000","last_clean":"2024-09-10T20:56:39.827480+0000","last_became_active":"2024-09-10T20:56:38.157795+0000","last_became_peered":"2024-09-10T20:56:38.157795+0000","last_unstale":"2024-09-10T20:56:39.827480+0000","last_undegraded":"2024-09-10T20:56:39.827480+0000","last_fullsized":"2024-09-10T20:56:39.827480+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:22:15.010616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.637452+0000","last_change":"2024-09-10T20:56:37.137604+0000","last_active":"2024-09-10T20:56:39.637452+0000","last_peered":"2024-09-10T20:56:39.637452+0000","last_clean":"2024-09-10T20:56:39.637452+0000","last_became_active":"2024-09-10T20:56:37.136277+0000","last_became_peered":"2024-09-10T20:56:37.136277+0000","last_unstale":"2024-09-10T20:56:39.637452+0000","last_undegraded":"2024-09-10T20:56:39.637452+0000","last_fullsized":"2024-09-10T20:56:39.637452+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:45.530317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159719+0000","last_change":"2024-09-10T20:56:38.161102+0000","last_active":"2024-09-10T20:56:39.159719+0000","last_peered":"2024-09-10T20:56:39.159719+0000","last_clean":"2024-09-10T20:56:39.159719+0000","last_became_active":"2024-09-10T20:56:38.160615+0000","last_became_peered":"2024-09-10T20:56:38.160615+0000","last_unstale":"2024-09-10T20:56:39.159719+0000","last_undegraded":"2024-09-10T20:56:39.159719+0000","last_fullsized":"2024-09-10T20:56:39.159719+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:06:05.780968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159557+0000","last_change":"2024-09-10T20:56:37.148316+0000","last_active":"2024-09-10T20:56:39.159557+0000","last_peered":"2024-09-10T20:56:39.159557+0000","last_clean":"2024-09-10T20:56:39.159557+0000","last_became_active":"2024-09-10T20:56:37.148034+0000","last_became_peered":"2024-09-10T20:56:37.148034+0000","last_unstale":"2024-09-10T20:56:39.159557+0000","last_undegraded":"2024-09-10T20:56:39.159557+0000","last_fullsized":"2024-09-10T20:56:39.159557+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:48:35.506758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159491+0000","last_change":"2024-09-10T20:56:38.168062+0000","last_active":"2024-09-10T20:56:39.159491+0000","last_peered":"2024-09-10T20:56:39.159491+0000","last_clean":"2024-09-10T20:56:39.159491+0000","last_became_active":"2024-09-10T20:56:38.166076+0000","last_became_peered":"2024-09-10T20:56:38.166076+0000","last_unstale":"2024-09-10T20:56:39.159491+0000","last_undegraded":"2024-09-10T20:56:39.159491+0000","last_fullsized":"2024-09-10T20:56:39.159491+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:01:46.029373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895916+0000","last_change":"2024-09-10T20:56:37.151835+0000","last_active":"2024-09-10T20:56:39.895916+0000","last_peered":"2024-09-10T20:56:39.895916+0000","last_clean":"2024-09-10T20:56:39.895916+0000","last_became_active":"2024-09-10T20:56:37.151520+0000","last_became_peered":"2024-09-10T20:56:37.151520+0000","last_unstale":"2024-09-10T20:56:39.895916+0000","last_undegraded":"2024-09-10T20:56:39.895916+0000","last_fullsized":"2024-09-10T20:56:39.895916+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:04:37.157796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159839+0000","last_change":"2024-09-10T20:56:38.172457+0000","last_active":"2024-09-10T20:56:39.159839+0000","last_peered":"2024-09-10T20:56:39.159839+0000","last_clean":"2024-09-10T20:56:39.159839+0000","last_became_active":"2024-09-10T20:56:38.172146+0000","last_became_peered":"2024-09-10T20:56:38.172146+0000","last_unstale":"2024-09-10T20:56:39.159839+0000","last_undegraded":"2024-09-10T20:56:39.159839+0000","last_fullsized":"2024-09-10T20:56:39.159839+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:14:03.795634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159712+0000","last_change":"2024-09-10T20:56:37.137553+0000","last_active":"2024-09-10T20:56:39.159712+0000","last_peered":"2024-09-10T20:56:39.159712+0000","last_clean":"2024-09-10T20:56:39.159712+0000","last_became_active":"2024-09-10T20:56:37.137268+0000","last_became_peered":"2024-09-10T20:56:37.137268+0000","last_unstale":"2024-09-10T20:56:39.159712+0000","last_undegraded":"2024-09-10T20:56:39.159712+0000","last_fullsized":"2024-09-10T20:56:39.159712+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:58:46.238344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.161098+0000","last_change":"2024-09-10T20:56:38.176322+0000","last_active":"2024-09-10T20:56:39.161098+0000","last_peered":"2024-09-10T20:56:39.161098+0000","last_clean":"2024-09-10T20:56:39.161098+0000","last_became_active":"2024-09-10T20:56:38.175858+0000","last_became_peered":"2024-09-10T20:56:38.175858+0000","last_unstale":"2024-09-10T20:56:39.161098+0000","last_undegraded":"2024-09-10T20:56:39.161098+0000","last_fullsized":"2024-09-10T20:56:39.161098+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:51.074302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159871+0000","last_change":"2024-09-10T20:56:37.144471+0000","last_active":"2024-09-10T20:56:39.159871+0000","last_peered":"2024-09-10T20:56:39.159871+0000","last_clean":"2024-09-10T20:56:39.159871+0000","last_became_active":"2024-09-10T20:56:37.144170+0000","last_became_peered":"2024-09-10T20:56:37.144170+0000","last_unstale":"2024-09-10T20:56:39.159871+0000","last_undegraded":"2024-09-10T20:56:39.159871+0000","last_fullsized":"2024-09-10T20:56:39.159871+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:24:26.058645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.827521+0000","last_change":"2024-09-10T20:56:38.160855+0000","last_active":"2024-09-10T20:56:39.827521+0000","last_peered":"2024-09-10T20:56:39.827521+0000","last_clean":"2024-09-10T20:56:39.827521+0000","last_became_active":"2024-09-10T20:56:38.160481+0000","last_became_peered":"2024-09-10T20:56:38.160481+0000","last_unstale":"2024-09-10T20:56:39.827521+0000","last_undegraded":"2024-09-10T20:56:39.827521+0000","last_fullsized":"2024-09-10T20:56:39.827521+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:48:49.752855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.637759+0000","last_change":"2024-09-10T20:56:37.137520+0000","last_active":"2024-09-10T20:56:39.637759+0000","last_peered":"2024-09-10T20:56:39.637759+0000","last_clean":"2024-09-10T20:56:39.637759+0000","last_became_active":"2024-09-10T20:56:37.136605+0000","last_became_peered":"2024-09-10T20:56:37.136605+0000","last_unstale":"2024-09-10T20:56:39.637759+0000","last_undegraded":"2024-09-10T20:56:39.637759+0000","last_fullsized":"2024-09-10T20:56:39.637759+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:51:14.065783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159616+0000","last_change":"2024-09-10T20:56:38.161692+0000","last_active":"2024-09-10T20:56:39.159616+0000","last_peered":"2024-09-10T20:56:39.159616+0000","last_clean":"2024-09-10T20:56:39.159616+0000","last_became_active":"2024-09-10T20:56:38.161390+0000","last_became_peered":"2024-09-10T20:56:38.161390+0000","last_unstale":"2024-09-10T20:56:39.159616+0000","last_undegraded":"2024-09-10T20:56:39.159616+0000","last_fullsized":"2024-09-10T20:56:39.159616+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:55:42.667720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.827509+0000","last_change":"2024-09-10T20:56:37.143926+0000","last_active":"2024-09-10T20:56:39.827509+0000","last_peered":"2024-09-10T20:56:39.827509+0000","last_clean":"2024-09-10T20:56:39.827509+0000","last_became_active":"2024-09-10T20:56:37.143615+0000","last_became_peered":"2024-09-10T20:56:37.143615+0000","last_unstale":"2024-09-10T20:56:39.827509+0000","last_undegraded":"2024-09-10T20:56:39.827509+0000","last_fullsized":"2024-09-10T20:56:39.827509+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:27.004455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159672+0000","last_change":"2024-09-10T20:56:38.169797+0000","last_active":"2024-09-10T20:56:39.159672+0000","last_peered":"2024-09-10T20:56:39.159672+0000","last_clean":"2024-09-10T20:56:39.159672+0000","last_became_active":"2024-09-10T20:56:38.166936+0000","last_became_peered":"2024-09-10T20:56:38.166936+0000","last_unstale":"2024-09-10T20:56:39.159672+0000","last_undegraded":"2024-09-10T20:56:39.159672+0000","last_fullsized":"2024-09-10T20:56:39.159672+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:11.205627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.160025+0000","last_change":"2024-09-10T20:56:37.142835+0000","last_active":"2024-09-10T20:56:39.160025+0000","last_peered":"2024-09-10T20:56:39.160025+0000","last_clean":"2024-09-10T20:56:39.160025+0000","last_became_active":"2024-09-10T20:56:37.141132+0000","last_became_peered":"2024-09-10T20:56:37.141132+0000","last_unstale":"2024-09-10T20:56:39.160025+0000","last_undegraded":"2024-09-10T20:56:39.160025+0000","last_fullsized":"2024-09-10T20:56:39.160025+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:32:42.408845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895963+0000","last_change":"2024-09-10T20:56:38.163561+0000","last_active":"2024-09-10T20:56:39.895963+0000","last_peered":"2024-09-10T20:56:39.895963+0000","last_clean":"2024-09-10T20:56:39.895963+0000","last_became_active":"2024-09-10T20:56:38.162903+0000","last_became_peered":"2024-09-10T20:56:38.162903+0000","last_unstale":"2024-09-10T20:56:39.895963+0000","last_undegraded":"2024-09-10T20:56:39.895963+0000","last_fullsized":"2024-09-10T20:56:39.895963+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:11.063733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159095+0000","last_change":"2024-09-10T20:56:37.145061+0000","last_active":"2024-09-10T20:56:39.159095+0000","last_peered":"2024-09-10T20:56:39.159095+0000","last_clean":"2024-09-10T20:56:39.159095+0000","last_became_active":"2024-09-10T20:56:37.144758+0000","last_became_peered":"2024-09-10T20:56:37.144758+0000","last_unstale":"2024-09-10T20:56:39.159095+0000","last_undegraded":"2024-09-10T20:56:39.159095+0000","last_fullsized":"2024-09-10T20:56:39.159095+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:22.395325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.637765+0000","last_change":"2024-09-10T20:56:38.159041+0000","last_active":"2024-09-10T20:56:39.637765+0000","last_peered":"2024-09-10T20:56:39.637765+0000","last_clean":"2024-09-10T20:56:39.637765+0000","last_became_active":"2024-09-10T20:56:38.158749+0000","last_became_peered":"2024-09-10T20:56:38.158749+0000","last_unstale":"2024-09-10T20:56:39.637765+0000","last_undegraded":"2024-09-10T20:56:39.637765+0000","last_fullsized":"2024-09-10T20:56:39.637765+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:28:54.408161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.828097+0000","last_change":"2024-09-10T20:56:37.144780+0000","last_active":"2024-09-10T20:56:39.828097+0000","last_peered":"2024-09-10T20:56:39.828097+0000","last_clean":"2024-09-10T20:56:39.828097+0000","last_became_active":"2024-09-10T20:56:37.144525+0000","last_became_peered":"2024-09-10T20:56:37.144525+0000","last_unstale":"2024-09-10T20:56:39.828097+0000","last_undegraded":"2024-09-10T20:56:39.828097+0000","last_fullsized":"2024-09-10T20:56:39.828097+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:22.559705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.160081+0000","last_change":"2024-09-10T20:56:38.158317+0000","last_active":"2024-09-10T20:56:39.160081+0000","last_peered":"2024-09-10T20:56:39.160081+0000","last_clean":"2024-09-10T20:56:39.160081+0000","last_became_active":"2024-09-10T20:56:38.157842+0000","last_became_peered":"2024-09-10T20:56:38.157842+0000","last_unstale":"2024-09-10T20:56:39.160081+0000","last_undegraded":"2024-09-10T20:56:39.160081+0000","last_fullsized":"2024-09-10T20:56:39.160081+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:04:55.129378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.637932+0000","last_change":"2024-09-10T20:56:37.140328+0000","last_active":"2024-09-10T20:56:39.637932+0000","last_peered":"2024-09-10T20:56:39.637932+0000","last_clean":"2024-09-10T20:56:39.637932+0000","last_became_active":"2024-09-10T20:56:37.139983+0000","last_became_peered":"2024-09-10T20:56:37.139983+0000","last_unstale":"2024-09-10T20:56:39.637932+0000","last_undegraded":"2024-09-10T20:56:39.637932+0000","last_fullsized":"2024-09-10T20:56:39.637932+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:47:52.623998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.827873+0000","last_change":"2024-09-10T20:56:38.172980+0000","last_active":"2024-09-10T20:56:39.827873+0000","last_peered":"2024-09-10T20:56:39.827873+0000","last_clean":"2024-09-10T20:56:39.827873+0000","last_became_active":"2024-09-10T20:56:38.172622+0000","last_became_peered":"2024-09-10T20:56:38.172622+0000","last_unstale":"2024-09-10T20:56:39.827873+0000","last_undegraded":"2024-09-10T20:56:39.827873+0000","last_fullsized":"2024-09-10T20:56:39.827873+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:38.009983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.638136+0000","last_change":"2024-09-10T20:56:37.140465+0000","last_active":"2024-09-10T20:56:39.638136+0000","last_peered":"2024-09-10T20:56:39.638136+0000","last_clean":"2024-09-10T20:56:39.638136+0000","last_became_active":"2024-09-10T20:56:37.139201+0000","last_became_peered":"2024-09-10T20:56:37.139201+0000","last_unstale":"2024-09-10T20:56:39.638136+0000","last_undegraded":"2024-09-10T20:56:39.638136+0000","last_fullsized":"2024-09-10T20:56:39.638136+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:18.812116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.826391+0000","last_change":"2024-09-10T20:56:38.178486+0000","last_active":"2024-09-10T20:56:39.826391+0000","last_peered":"2024-09-10T20:56:39.826391+0000","last_clean":"2024-09-10T20:56:39.826391+0000","last_became_active":"2024-09-10T20:56:38.178188+0000","last_became_peered":"2024-09-10T20:56:38.178188+0000","last_unstale":"2024-09-10T20:56:39.826391+0000","last_undegraded":"2024-09-10T20:56:39.826391+0000","last_fullsized":"2024-09-10T20:56:39.826391+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:57.614688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.637936+0000","last_change":"2024-09-10T20:56:37.142632+0000","last_active":"2024-09-10T20:56:39.637936+0000","last_peered":"2024-09-10T20:56:39.637936+0000","last_clean":"2024-09-10T20:56:39.637936+0000","last_became_active":"2024-09-10T20:56:37.141122+0000","last_became_peered":"2024-09-10T20:56:37.141122+0000","last_unstale":"2024-09-10T20:56:39.637936+0000","last_undegraded":"2024-09-10T20:56:39.637936+0000","last_fullsized":"2024-09-10T20:56:39.637936+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:01:18.539787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.826269+0000","last_change":"2024-09-10T20:56:38.153799+0000","last_active":"2024-09-10T20:56:39.826269+0000","last_peered":"2024-09-10T20:56:39.826269+0000","last_clean":"2024-09-10T20:56:39.826269+0000","last_became_active":"2024-09-10T20:56:38.153529+0000","last_became_peered":"2024-09-10T20:56:38.153529+0000","last_unstale":"2024-09-10T20:56:39.826269+0000","last_undegraded":"2024-09-10T20:56:39.826269+0000","last_fullsized":"2024-09-10T20:56:39.826269+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:56:36.383679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895790+0000","last_change":"2024-09-10T20:56:37.149392+0000","last_active":"2024-09-10T20:56:39.895790+0000","last_peered":"2024-09-10T20:56:39.895790+0000","last_clean":"2024-09-10T20:56:39.895790+0000","last_became_active":"2024-09-10T20:56:37.148872+0000","last_became_peered":"2024-09-10T20:56:37.148872+0000","last_unstale":"2024-09-10T20:56:39.895790+0000","last_undegraded":"2024-09-10T20:56:39.895790+0000","last_fullsized":"2024-09-10T20:56:39.895790+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:50:29.602715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.826588+0000","last_change":"2024-09-10T20:56:38.159089+0000","last_active":"2024-09-10T20:56:39.826588+0000","last_peered":"2024-09-10T20:56:39.826588+0000","last_clean":"2024-09-10T20:56:39.826588+0000","last_became_active":"2024-09-10T20:56:38.158741+0000","last_became_peered":"2024-09-10T20:56:38.158741+0000","last_unstale":"2024-09-10T20:56:39.826588+0000","last_undegraded":"2024-09-10T20:56:39.826588+0000","last_fullsized":"2024-09-10T20:56:39.826588+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:27:53.250076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895831+0000","last_change":"2024-09-10T20:56:37.147505+0000","last_active":"2024-09-10T20:56:39.895831+0000","last_peered":"2024-09-10T20:56:39.895831+0000","last_clean":"2024-09-10T20:56:39.895831+0000","last_became_active":"2024-09-10T20:56:37.147242+0000","last_became_peered":"2024-09-10T20:56:37.147242+0000","last_unstale":"2024-09-10T20:56:39.895831+0000","last_undegraded":"2024-09-10T20:56:39.895831+0000","last_fullsized":"2024-09-10T20:56:39.895831+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:12.264819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.825928+0000","last_change":"2024-09-10T20:56:38.158162+0000","last_active":"2024-09-10T20:56:39.825928+0000","last_peered":"2024-09-10T20:56:39.825928+0000","last_clean":"2024-09-10T20:56:39.825928+0000","last_became_active":"2024-09-10T20:56:38.157889+0000","last_became_peered":"2024-09-10T20:56:38.157889+0000","last_unstale":"2024-09-10T20:56:39.825928+0000","last_undegraded":"2024-09-10T20:56:39.825928+0000","last_fullsized":"2024-09-10T20:56:39.825928+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:46:00.932827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.637450+0000","last_change":"2024-09-10T20:56:37.142604+0000","last_active":"2024-09-10T20:56:39.637450+0000","last_peered":"2024-09-10T20:56:39.637450+0000","last_clean":"2024-09-10T20:56:39.637450+0000","last_became_active":"2024-09-10T20:56:37.142340+0000","last_became_peered":"2024-09-10T20:56:37.142340+0000","last_unstale":"2024-09-10T20:56:39.637450+0000","last_undegraded":"2024-09-10T20:56:39.637450+0000","last_fullsized":"2024-09-10T20:56:39.637450+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:57.416321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.160756+0000","last_change":"2024-09-10T20:56:38.181525+0000","last_active":"2024-09-10T20:56:39.160756+0000","last_peered":"2024-09-10T20:56:39.160756+0000","last_clean":"2024-09-10T20:56:39.160756+0000","last_became_active":"2024-09-10T20:56:38.178525+0000","last_became_peered":"2024-09-10T20:56:38.178525+0000","last_unstale":"2024-09-10T20:56:39.160756+0000","last_undegraded":"2024-09-10T20:56:39.160756+0000","last_fullsized":"2024-09-10T20:56:39.160756+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:49:12.825733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.160361+0000","last_change":"2024-09-10T20:56:37.141051+0000","last_active":"2024-09-10T20:56:39.160361+0000","last_peered":"2024-09-10T20:56:39.160361+0000","last_clean":"2024-09-10T20:56:39.160361+0000","last_became_active":"2024-09-10T20:56:37.140705+0000","last_became_peered":"2024-09-10T20:56:37.140705+0000","last_unstale":"2024-09-10T20:56:39.160361+0000","last_undegraded":"2024-09-10T20:56:39.160361+0000","last_fullsized":"2024-09-10T20:56:39.160361+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:10:06.780644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.826542+0000","last_change":"2024-09-10T20:56:38.165637+0000","last_active":"2024-09-10T20:56:39.826542+0000","last_peered":"2024-09-10T20:56:39.826542+0000","last_clean":"2024-09-10T20:56:39.826542+0000","last_became_active":"2024-09-10T20:56:38.165344+0000","last_became_peered":"2024-09-10T20:56:38.165344+0000","last_unstale":"2024-09-10T20:56:39.826542+0000","last_undegraded":"2024-09-10T20:56:39.826542+0000","last_fullsized":"2024-09-10T20:56:39.826542+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:28.013002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.828127+0000","last_change":"2024-09-10T20:56:37.150166+0000","last_active":"2024-09-10T20:56:39.828127+0000","last_peered":"2024-09-10T20:56:39.828127+0000","last_clean":"2024-09-10T20:56:39.828127+0000","last_became_active":"2024-09-10T20:56:37.149784+0000","last_became_peered":"2024-09-10T20:56:37.149784+0000","last_unstale":"2024-09-10T20:56:39.828127+0000","last_undegraded":"2024-09-10T20:56:39.828127+0000","last_fullsized":"2024-09-10T20:56:39.828127+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:11:22.203970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.160456+0000","last_change":"2024-09-10T20:56:38.179086+0000","last_active":"2024-09-10T20:56:39.160456+0000","last_peered":"2024-09-10T20:56:39.160456+0000","last_clean":"2024-09-10T20:56:39.160456+0000","last_became_active":"2024-09-10T20:56:38.176381+0000","last_became_peered":"2024-09-10T20:56:38.176381+0000","last_unstale":"2024-09-10T20:56:39.160456+0000","last_undegraded":"2024-09-10T20:56:39.160456+0000","last_fullsized":"2024-09-10T20:56:39.160456+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:08:05.011647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.896012+0000","last_change":"2024-09-10T20:56:37.144142+0000","last_active":"2024-09-10T20:56:39.896012+0000","last_peered":"2024-09-10T20:56:39.896012+0000","last_clean":"2024-09-10T20:56:39.896012+0000","last_became_active":"2024-09-10T20:56:37.143835+0000","last_became_peered":"2024-09-10T20:56:37.143835+0000","last_unstale":"2024-09-10T20:56:39.896012+0000","last_undegraded":"2024-09-10T20:56:39.896012+0000","last_fullsized":"2024-09-10T20:56:39.896012+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:51:50.869361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895723+0000","last_change":"2024-09-10T20:56:38.177166+0000","last_active":"2024-09-10T20:56:39.895723+0000","last_peered":"2024-09-10T20:56:39.895723+0000","last_clean":"2024-09-10T20:56:39.895723+0000","last_became_active":"2024-09-10T20:56:38.176862+0000","last_became_peered":"2024-09-10T20:56:38.176862+0000","last_unstale":"2024-09-10T20:56:39.895723+0000","last_undegraded":"2024-09-10T20:56:39.895723+0000","last_fullsized":"2024-09-10T20:56:39.895723+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:11.063733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.827981+0000","last_change":"2024-09-10T20:56:37.141713+0000","last_active":"2024-09-10T20:56:39.827981+0000","last_peered":"2024-09-10T20:56:39.827981+0000","last_clean":"2024-09-10T20:56:39.827981+0000","last_became_active":"2024-09-10T20:56:37.141385+0000","last_became_peered":"2024-09-10T20:56:37.141385+0000","last_unstale":"2024-09-10T20:56:39.827981+0000","last_undegraded":"2024-09-10T20:56:39.827981+0000","last_fullsized":"2024-09-10T20:56:39.827981+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:45:54.051740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895806+0000","last_change":"2024-09-10T20:56:38.166177+0000","last_active":"2024-09-10T20:56:39.895806+0000","last_peered":"2024-09-10T20:56:39.895806+0000","last_clean":"2024-09-10T20:56:39.895806+0000","last_became_active":"2024-09-10T20:56:38.165844+0000","last_became_peered":"2024-09-10T20:56:38.165844+0000","last_unstale":"2024-09-10T20:56:39.895806+0000","last_undegraded":"2024-09-10T20:56:39.895806+0000","last_fullsized":"2024-09-10T20:56:39.895806+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:55:02.168176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895935+0000","last_change":"2024-09-10T20:56:37.147085+0000","last_active":"2024-09-10T20:56:39.895935+0000","last_peered":"2024-09-10T20:56:39.895935+0000","last_clean":"2024-09-10T20:56:39.895935+0000","last_became_active":"2024-09-10T20:56:37.146431+0000","last_became_peered":"2024-09-10T20:56:37.146431+0000","last_unstale":"2024-09-10T20:56:39.895935+0000","last_undegraded":"2024-09-10T20:56:39.895935+0000","last_fullsized":"2024-09-10T20:56:39.895935+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:41:31.782397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895850+0000","last_change":"2024-09-10T20:56:38.154317+0000","last_active":"2024-09-10T20:56:39.895850+0000","last_peered":"2024-09-10T20:56:39.895850+0000","last_clean":"2024-09-10T20:56:39.895850+0000","last_became_active":"2024-09-10T20:56:38.154012+0000","last_became_peered":"2024-09-10T20:56:38.154012+0000","last_unstale":"2024-09-10T20:56:39.895850+0000","last_undegraded":"2024-09-10T20:56:39.895850+0000","last_fullsized":"2024-09-10T20:56:39.895850+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:45.328902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.827631+0000","last_change":"2024-09-10T20:56:37.150585+0000","last_active":"2024-09-10T20:56:39.827631+0000","last_peered":"2024-09-10T20:56:39.827631+0000","last_clean":"2024-09-10T20:56:39.827631+0000","last_became_active":"2024-09-10T20:56:37.149813+0000","last_became_peered":"2024-09-10T20:56:37.149813+0000","last_unstale":"2024-09-10T20:56:39.827631+0000","last_undegraded":"2024-09-10T20:56:39.827631+0000","last_fullsized":"2024-09-10T20:56:39.827631+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:27:52.241529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159186+0000","last_change":"2024-09-10T20:56:38.171350+0000","last_active":"2024-09-10T20:56:39.159186+0000","last_peered":"2024-09-10T20:56:39.159186+0000","last_clean":"2024-09-10T20:56:39.159186+0000","last_became_active":"2024-09-10T20:56:38.166604+0000","last_became_peered":"2024-09-10T20:56:38.166604+0000","last_unstale":"2024-09-10T20:56:39.159186+0000","last_undegraded":"2024-09-10T20:56:39.159186+0000","last_fullsized":"2024-09-10T20:56:39.159186+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:04:41.603241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.638068+0000","last_change":"2024-09-10T20:56:37.132028+0000","last_active":"2024-09-10T20:56:39.638068+0000","last_peered":"2024-09-10T20:56:39.638068+0000","last_clean":"2024-09-10T20:56:39.638068+0000","last_became_active":"2024-09-10T20:56:37.131705+0000","last_became_peered":"2024-09-10T20:56:37.131705+0000","last_unstale":"2024-09-10T20:56:39.638068+0000","last_undegraded":"2024-09-10T20:56:39.638068+0000","last_fullsized":"2024-09-10T20:56:39.638068+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:17:42.504437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.637465+0000","last_change":"2024-09-10T20:56:38.163061+0000","last_active":"2024-09-10T20:56:39.637465+0000","last_peered":"2024-09-10T20:56:39.637465+0000","last_clean":"2024-09-10T20:56:39.637465+0000","last_became_active":"2024-09-10T20:56:38.162746+0000","last_became_peered":"2024-09-10T20:56:38.162746+0000","last_unstale":"2024-09-10T20:56:39.637465+0000","last_undegraded":"2024-09-10T20:56:39.637465+0000","last_fullsized":"2024-09-10T20:56:39.637465+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:52:08.011169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159202+0000","last_change":"2024-09-10T20:56:37.148385+0000","last_active":"2024-09-10T20:56:39.159202+0000","last_peered":"2024-09-10T20:56:39.159202+0000","last_clean":"2024-09-10T20:56:39.159202+0000","last_became_active":"2024-09-10T20:56:37.148079+0000","last_became_peered":"2024-09-10T20:56:37.148079+0000","last_unstale":"2024-09-10T20:56:39.159202+0000","last_undegraded":"2024-09-10T20:56:39.159202+0000","last_fullsized":"2024-09-10T20:56:39.159202+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:46:05.846818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.160626+0000","last_change":"2024-09-10T20:56:38.179549+0000","last_active":"2024-09-10T20:56:39.160626+0000","last_peered":"2024-09-10T20:56:39.160626+0000","last_clean":"2024-09-10T20:56:39.160626+0000","last_became_active":"2024-09-10T20:56:38.179259+0000","last_became_peered":"2024-09-10T20:56:38.179259+0000","last_unstale":"2024-09-10T20:56:39.160626+0000","last_undegraded":"2024-09-10T20:56:39.160626+0000","last_fullsized":"2024-09-10T20:56:39.160626+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:55.667614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895736+0000","last_change":"2024-09-10T20:56:37.139551+0000","last_active":"2024-09-10T20:56:39.895736+0000","last_peered":"2024-09-10T20:56:39.895736+0000","last_clean":"2024-09-10T20:56:39.895736+0000","last_became_active":"2024-09-10T20:56:37.139252+0000","last_became_peered":"2024-09-10T20:56:37.139252+0000","last_unstale":"2024-09-10T20:56:39.895736+0000","last_undegraded":"2024-09-10T20:56:39.895736+0000","last_fullsized":"2024-09-10T20:56:39.895736+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:37:14.449011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":134,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159985+0000","last_change":"2024-09-10T20:55:34.718784+0000","last_active":"2024-09-10T20:56:39.159985+0000","last_peered":"2024-09-10T20:56:39.159985+0000","last_clean":"2024-09-10T20:56:39.159985+0000","last_became_active":"2024-09-10T20:55:34.717616+0000","last_became_peered":"2024-09-10T20:55:34.717616+0000","last_unstale":"2024-09-10T20:56:39.159985+0000","last_undegraded":"2024-09-10T20:56:39.159985+0000","last_fullsized":"2024-09-10T20:56:39.159985+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:33.618098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:33.618098+0000","last_clean_scrub_stamp":"2024-09-10T20:55:33.618098+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:17.442729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":987136,"data_stored":743296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":397312,"data_stored":153454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":397312,"data_stored":153510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509456,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":397312,"data_stored":152942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":393216,"data_stored":152908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":154472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":983040,"data_stored":743206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":154472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T20:56:47.321 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T20:56:47.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.489+0000 7fa80fe00640 1 -- 172.21.15.6:0/3627305088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa81006e180 msgr2=0x7fa81006e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:47.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.489+0000 7fa80fe00640 1 --2- 172.21.15.6:0/3627305088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa81006e180 0x7fa81006e5c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa808005fd0 tx=0x7fa80802a820 comp rx=0 tx=0).stop 2024-09-10T20:56:47.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.489+0000 7fa80fe00640 1 -- 172.21.15.6:0/3627305088 shutdown_connections 2024-09-10T20:56:47.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.489+0000 7fa80fe00640 1 --2- 172.21.15.6:0/3627305088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa81006e180 0x7fa81006e5c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:47.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.489+0000 7fa80fe00640 1 --2- 172.21.15.6:0/3627305088 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa810073d50 0x7fa81015c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:47.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.489+0000 7fa80fe00640 1 -- 172.21.15.6:0/3627305088 >> 172.21.15.6:0/3627305088 conn(0x7fa81006cf90 msgr2=0x7fa81006d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:47.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.489+0000 7fa80fe00640 1 -- 172.21.15.6:0/3627305088 shutdown_connections 2024-09-10T20:56:47.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.489+0000 7fa80fe00640 1 -- 172.21.15.6:0/3627305088 wait complete. 2024-09-10T20:56:47.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.490+0000 7fa80fe00640 1 Processor -- start 2024-09-10T20:56:47.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.491+0000 7fa80fe00640 1 -- start start 2024-09-10T20:56:47.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.491+0000 7fa80fe00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa81006e180 0x7fa8101f6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:47.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.492+0000 7fa80fe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa810073d50 0x7fa810151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:47.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.492+0000 7fa80fe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8100cfd30 0x7fa81013f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:47.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.492+0000 7fa80fe00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa810072f00 con 0x7fa810073d50 2024-09-10T20:56:47.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.492+0000 7fa80fe00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa810072d80 con 0x7fa8100cfd30 2024-09-10T20:56:47.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.492+0000 7fa80fe00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa810073080 con 0x7fa81006e180 2024-09-10T20:56:47.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.492+0000 7fa806000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa810073d50 0x7fa810151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:47.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.492+0000 7fa806000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa810073d50 0x7fa810151450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37986/0 (socket says 172.21.15.6:37986) 2024-09-10T20:56:47.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.492+0000 7fa806000640 1 -- 172.21.15.6:0/968745747 learned_addr learned my addr 172.21.15.6:0/968745747 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:47.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.492+0000 7fa80ea00640 1 --2- 172.21.15.6:0/968745747 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa81006e180 0x7fa8101f6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:47.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.492+0000 7fa80f400640 1 --2- 172.21.15.6:0/968745747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8100cfd30 0x7fa81013f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:47.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.492+0000 7fa806000640 1 -- 172.21.15.6:0/968745747 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa81006e180 msgr2=0x7fa8101f6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:47.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.492+0000 7fa806000640 1 --2- 172.21.15.6:0/968745747 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa81006e180 0x7fa8101f6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:47.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.492+0000 7fa806000640 1 -- 172.21.15.6:0/968745747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8100cfd30 msgr2=0x7fa81013f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:47.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.492+0000 7fa806000640 1 --2- 172.21.15.6:0/968745747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8100cfd30 0x7fa81013f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:47.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.492+0000 7fa806000640 1 -- 172.21.15.6:0/968745747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa810151cb0 con 0x7fa810073d50 2024-09-10T20:56:47.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.493+0000 7fa806000640 1 --2- 172.21.15.6:0/968745747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa810073d50 0x7fa810151450 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa7f800d980 tx=0x7fa7f800de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:47.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.493+0000 7fa807400640 1 -- 172.21.15.6:0/968745747 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8017070 con 0x7fa810073d50 2024-09-10T20:56:47.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.493+0000 7fa807400640 1 -- 172.21.15.6:0/968745747 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa7f8009cc0 con 0x7fa810073d50 2024-09-10T20:56:47.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.493+0000 7fa807400640 1 -- 172.21.15.6:0/968745747 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f80106c0 con 0x7fa810073d50 2024-09-10T20:56:47.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.493+0000 7fa80fe00640 1 -- 172.21.15.6:0/968745747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa810151f90 con 0x7fa810073d50 2024-09-10T20:56:47.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.493+0000 7fa80fe00640 1 -- 172.21.15.6:0/968745747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa810152550 con 0x7fa810073d50 2024-09-10T20:56:47.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.494+0000 7fa80fe00640 1 -- 172.21.15.6:0/968745747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa81006fbe0 con 0x7fa810073d50 2024-09-10T20:56:47.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.495+0000 7fa807400640 1 -- 172.21.15.6:0/968745747 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa7f8010860 con 0x7fa810073d50 2024-09-10T20:56:47.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.496+0000 7fa807400640 1 --2- 172.21.15.6:0/968745747 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa7ec077f70 0x7fa7ec07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:47.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.496+0000 7fa807400640 1 -- 172.21.15.6:0/968745747 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fa7f809a110 con 0x7fa810073d50 2024-09-10T20:56:47.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.497+0000 7fa80ea00640 1 --2- 172.21.15.6:0/968745747 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa7ec077f70 0x7fa7ec07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:47.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.497+0000 7fa80ea00640 1 --2- 172.21.15.6:0/968745747 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa7ec077f70 0x7fa7ec07a430 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa8000015e0 tx=0x7fa800009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:47.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.500+0000 7fa807400640 1 -- 172.21.15.6:0/968745747 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fa81006fbe0 con 0x7fa810073d50 2024-09-10T20:56:47.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.690+0000 7fa80fe00640 1 -- 172.21.15.6:0/968745747 --> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa8100cd200 con 0x7fa7ec077f70 2024-09-10T20:56:47.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.696+0000 7fa807400640 1 -- 172.21.15.6:0/968745747 <== mgr.4120 v2:172.21.15.150:6800/1238179351 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251928 (secure 0 0 0) 0x7fa8100cd200 con 0x7fa7ec077f70 2024-09-10T20:56:47.702 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:56:47.703 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-10T20:56:47.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.699+0000 7fa80fe00640 1 -- 172.21.15.6:0/968745747 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa7ec077f70 msgr2=0x7fa7ec07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:47.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.699+0000 7fa80fe00640 1 --2- 172.21.15.6:0/968745747 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa7ec077f70 0x7fa7ec07a430 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa8000015e0 tx=0x7fa800009040 comp rx=0 tx=0).stop 2024-09-10T20:56:47.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.699+0000 7fa80fe00640 1 -- 172.21.15.6:0/968745747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa810073d50 msgr2=0x7fa810151450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:47.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.699+0000 7fa80fe00640 1 --2- 172.21.15.6:0/968745747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa810073d50 0x7fa810151450 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa7f800d980 tx=0x7fa7f800de40 comp rx=0 tx=0).stop 2024-09-10T20:56:47.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.699+0000 7fa80fe00640 1 -- 172.21.15.6:0/968745747 shutdown_connections 2024-09-10T20:56:47.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.699+0000 7fa80fe00640 1 --2- 172.21.15.6:0/968745747 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa7ec077f70 0x7fa7ec07a430 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:47.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.699+0000 7fa80fe00640 1 --2- 172.21.15.6:0/968745747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa810073d50 0x7fa810151450 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:47.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.699+0000 7fa80fe00640 1 --2- 172.21.15.6:0/968745747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8100cfd30 0x7fa81013f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:47.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.699+0000 7fa80fe00640 1 --2- 172.21.15.6:0/968745747 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa81006e180 0x7fa8101f6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:47.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.699+0000 7fa80fe00640 1 -- 172.21.15.6:0/968745747 >> 172.21.15.6:0/968745747 conn(0x7fa81006cf90 msgr2=0x7fa8101589c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:47.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.700+0000 7fa80fe00640 1 -- 172.21.15.6:0/968745747 shutdown_connections 2024-09-10T20:56:47.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.700+0000 7fa80fe00640 1 -- 172.21.15.6:0/968745747 wait complete. 2024-09-10T20:56:47.719 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-09-10T20:56:47.187423+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220520,"kb_used_data":4264,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754200,"statfs":{"total":773094113280,"available":772868300800,"internally_reserved":0,"allocated":4366336,"data_stored":2408260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.045681"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895829+0000","last_change":"2024-09-10T20:56:38.156240+0000","last_active":"2024-09-10T20:56:39.895829+0000","last_peered":"2024-09-10T20:56:39.895829+0000","last_clean":"2024-09-10T20:56:39.895829+0000","last_became_active":"2024-09-10T20:56:38.155782+0000","last_became_peered":"2024-09-10T20:56:38.155782+0000","last_unstale":"2024-09-10T20:56:39.895829+0000","last_undegraded":"2024-09-10T20:56:39.895829+0000","last_fullsized":"2024-09-10T20:56:39.895829+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:19.775884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159758+0000","last_change":"2024-09-10T20:56:38.171671+0000","last_active":"2024-09-10T20:56:39.159758+0000","last_peered":"2024-09-10T20:56:39.159758+0000","last_clean":"2024-09-10T20:56:39.159758+0000","last_became_active":"2024-09-10T20:56:38.171389+0000","last_became_peered":"2024-09-10T20:56:38.171389+0000","last_unstale":"2024-09-10T20:56:39.159758+0000","last_undegraded":"2024-09-10T20:56:39.159758+0000","last_fullsized":"2024-09-10T20:56:39.159758+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:17.915009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159548+0000","last_change":"2024-09-10T20:56:38.176130+0000","last_active":"2024-09-10T20:56:39.159548+0000","last_peered":"2024-09-10T20:56:39.159548+0000","last_clean":"2024-09-10T20:56:39.159548+0000","last_became_active":"2024-09-10T20:56:38.175453+0000","last_became_peered":"2024-09-10T20:56:38.175453+0000","last_unstale":"2024-09-10T20:56:39.159548+0000","last_undegraded":"2024-09-10T20:56:39.159548+0000","last_fullsized":"2024-09-10T20:56:39.159548+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:38.009983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.827631+0000","last_change":"2024-09-10T20:56:38.174330+0000","last_active":"2024-09-10T20:56:39.827631+0000","last_peered":"2024-09-10T20:56:39.827631+0000","last_clean":"2024-09-10T20:56:39.827631+0000","last_became_active":"2024-09-10T20:56:38.174085+0000","last_became_peered":"2024-09-10T20:56:38.174085+0000","last_unstale":"2024-09-10T20:56:39.827631+0000","last_undegraded":"2024-09-10T20:56:39.827631+0000","last_fullsized":"2024-09-10T20:56:39.827631+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:58:24.390781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.826376+0000","last_change":"2024-09-10T20:56:38.168194+0000","last_active":"2024-09-10T20:56:39.826376+0000","last_peered":"2024-09-10T20:56:39.826376+0000","last_clean":"2024-09-10T20:56:39.826376+0000","last_became_active":"2024-09-10T20:56:38.167861+0000","last_became_peered":"2024-09-10T20:56:38.167861+0000","last_unstale":"2024-09-10T20:56:39.826376+0000","last_undegraded":"2024-09-10T20:56:39.826376+0000","last_fullsized":"2024-09-10T20:56:39.826376+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:13.273365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159294+0000","last_change":"2024-09-10T20:56:38.156995+0000","last_active":"2024-09-10T20:56:39.159294+0000","last_peered":"2024-09-10T20:56:39.159294+0000","last_clean":"2024-09-10T20:56:39.159294+0000","last_became_active":"2024-09-10T20:56:38.156519+0000","last_became_peered":"2024-09-10T20:56:38.156519+0000","last_unstale":"2024-09-10T20:56:39.159294+0000","last_undegraded":"2024-09-10T20:56:39.159294+0000","last_fullsized":"2024-09-10T20:56:39.159294+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:44:30.630575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.160932+0000","last_change":"2024-09-10T20:56:38.180671+0000","last_active":"2024-09-10T20:56:39.160932+0000","last_peered":"2024-09-10T20:56:39.160932+0000","last_clean":"2024-09-10T20:56:39.160932+0000","last_became_active":"2024-09-10T20:56:38.180388+0000","last_became_peered":"2024-09-10T20:56:38.180388+0000","last_unstale":"2024-09-10T20:56:39.160932+0000","last_undegraded":"2024-09-10T20:56:39.160932+0000","last_fullsized":"2024-09-10T20:56:39.160932+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:51.074302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159545+0000","last_change":"2024-09-10T20:56:38.179102+0000","last_active":"2024-09-10T20:56:39.159545+0000","last_peered":"2024-09-10T20:56:39.159545+0000","last_clean":"2024-09-10T20:56:39.159545+0000","last_became_active":"2024-09-10T20:56:38.178426+0000","last_became_peered":"2024-09-10T20:56:38.178426+0000","last_unstale":"2024-09-10T20:56:39.159545+0000","last_undegraded":"2024-09-10T20:56:39.159545+0000","last_fullsized":"2024-09-10T20:56:39.159545+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:00:54.042716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.637843+0000","last_change":"2024-09-10T20:56:38.176880+0000","last_active":"2024-09-10T20:56:39.637843+0000","last_peered":"2024-09-10T20:56:39.637843+0000","last_clean":"2024-09-10T20:56:39.637843+0000","last_became_active":"2024-09-10T20:56:38.176589+0000","last_became_peered":"2024-09-10T20:56:38.176589+0000","last_unstale":"2024-09-10T20:56:39.637843+0000","last_undegraded":"2024-09-10T20:56:39.637843+0000","last_fullsized":"2024-09-10T20:56:39.637843+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:38.109672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.827739+0000","last_change":"2024-09-10T20:56:38.169154+0000","last_active":"2024-09-10T20:56:39.827739+0000","last_peered":"2024-09-10T20:56:39.827739+0000","last_clean":"2024-09-10T20:56:39.827739+0000","last_became_active":"2024-09-10T20:56:38.166148+0000","last_became_peered":"2024-09-10T20:56:38.166148+0000","last_unstale":"2024-09-10T20:56:39.827739+0000","last_undegraded":"2024-09-10T20:56:39.827739+0000","last_fullsized":"2024-09-10T20:56:39.827739+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:17:07.908211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.160898+0000","last_change":"2024-09-10T20:56:38.177874+0000","last_active":"2024-09-10T20:56:39.160898+0000","last_peered":"2024-09-10T20:56:39.160898+0000","last_clean":"2024-09-10T20:56:39.160898+0000","last_became_active":"2024-09-10T20:56:38.177513+0000","last_became_peered":"2024-09-10T20:56:38.177513+0000","last_unstale":"2024-09-10T20:56:39.160898+0000","last_undegraded":"2024-09-10T20:56:39.160898+0000","last_fullsized":"2024-09-10T20:56:39.160898+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:08:05.011647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159924+0000","last_change":"2024-09-10T20:56:38.163865+0000","last_active":"2024-09-10T20:56:39.159924+0000","last_peered":"2024-09-10T20:56:39.159924+0000","last_clean":"2024-09-10T20:56:39.159924+0000","last_became_active":"2024-09-10T20:56:38.163579+0000","last_became_peered":"2024-09-10T20:56:38.163579+0000","last_unstale":"2024-09-10T20:56:39.159924+0000","last_undegraded":"2024-09-10T20:56:39.159924+0000","last_fullsized":"2024-09-10T20:56:39.159924+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:55.667614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.826322+0000","last_change":"2024-09-10T20:56:38.173448+0000","last_active":"2024-09-10T20:56:39.826322+0000","last_peered":"2024-09-10T20:56:39.826322+0000","last_clean":"2024-09-10T20:56:39.826322+0000","last_became_active":"2024-09-10T20:56:38.173195+0000","last_became_peered":"2024-09-10T20:56:38.173195+0000","last_unstale":"2024-09-10T20:56:39.826322+0000","last_undegraded":"2024-09-10T20:56:39.826322+0000","last_fullsized":"2024-09-10T20:56:39.826322+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:32:51.967432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159409+0000","last_change":"2024-09-10T20:56:38.155556+0000","last_active":"2024-09-10T20:56:39.159409+0000","last_peered":"2024-09-10T20:56:39.159409+0000","last_clean":"2024-09-10T20:56:39.159409+0000","last_became_active":"2024-09-10T20:56:38.155251+0000","last_became_peered":"2024-09-10T20:56:38.155251+0000","last_unstale":"2024-09-10T20:56:39.159409+0000","last_undegraded":"2024-09-10T20:56:39.159409+0000","last_fullsized":"2024-09-10T20:56:39.159409+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:02:08.850930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159560+0000","last_change":"2024-09-10T20:56:38.153485+0000","last_active":"2024-09-10T20:56:39.159560+0000","last_peered":"2024-09-10T20:56:39.159560+0000","last_clean":"2024-09-10T20:56:39.159560+0000","last_became_active":"2024-09-10T20:56:38.153171+0000","last_became_peered":"2024-09-10T20:56:38.153171+0000","last_unstale":"2024-09-10T20:56:39.159560+0000","last_undegraded":"2024-09-10T20:56:39.159560+0000","last_fullsized":"2024-09-10T20:56:39.159560+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:28:45.478675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159861+0000","last_change":"2024-09-10T20:56:38.177749+0000","last_active":"2024-09-10T20:56:39.159861+0000","last_peered":"2024-09-10T20:56:39.159861+0000","last_clean":"2024-09-10T20:56:39.159861+0000","last_became_active":"2024-09-10T20:56:38.177346+0000","last_became_peered":"2024-09-10T20:56:38.177346+0000","last_unstale":"2024-09-10T20:56:39.159861+0000","last_undegraded":"2024-09-10T20:56:39.159861+0000","last_fullsized":"2024-09-10T20:56:39.159861+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:06:05.780968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.161471+0000","last_change":"2024-09-10T20:56:38.180281+0000","last_active":"2024-09-10T20:56:39.161471+0000","last_peered":"2024-09-10T20:56:39.161471+0000","last_clean":"2024-09-10T20:56:39.161471+0000","last_became_active":"2024-09-10T20:56:38.179991+0000","last_became_peered":"2024-09-10T20:56:38.179991+0000","last_unstale":"2024-09-10T20:56:39.161471+0000","last_undegraded":"2024-09-10T20:56:39.161471+0000","last_fullsized":"2024-09-10T20:56:39.161471+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:58:59.841437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159954+0000","last_change":"2024-09-10T20:56:38.166160+0000","last_active":"2024-09-10T20:56:39.159954+0000","last_peered":"2024-09-10T20:56:39.159954+0000","last_clean":"2024-09-10T20:56:39.159954+0000","last_became_active":"2024-09-10T20:56:38.165859+0000","last_became_peered":"2024-09-10T20:56:38.165859+0000","last_unstale":"2024-09-10T20:56:39.159954+0000","last_undegraded":"2024-09-10T20:56:39.159954+0000","last_fullsized":"2024-09-10T20:56:39.159954+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:48.491833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159445+0000","last_change":"2024-09-10T20:56:38.171799+0000","last_active":"2024-09-10T20:56:39.159445+0000","last_peered":"2024-09-10T20:56:39.159445+0000","last_clean":"2024-09-10T20:56:39.159445+0000","last_became_active":"2024-09-10T20:56:38.170480+0000","last_became_peered":"2024-09-10T20:56:38.170480+0000","last_unstale":"2024-09-10T20:56:39.159445+0000","last_undegraded":"2024-09-10T20:56:39.159445+0000","last_fullsized":"2024-09-10T20:56:39.159445+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:13.448693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.826511+0000","last_change":"2024-09-10T20:56:38.170878+0000","last_active":"2024-09-10T20:56:39.826511+0000","last_peered":"2024-09-10T20:56:39.826511+0000","last_clean":"2024-09-10T20:56:39.826511+0000","last_became_active":"2024-09-10T20:56:38.164065+0000","last_became_peered":"2024-09-10T20:56:38.164065+0000","last_unstale":"2024-09-10T20:56:39.826511+0000","last_undegraded":"2024-09-10T20:56:39.826511+0000","last_fullsized":"2024-09-10T20:56:39.826511+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:37:15.457558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.637528+0000","last_change":"2024-09-10T20:56:38.160211+0000","last_active":"2024-09-10T20:56:39.637528+0000","last_peered":"2024-09-10T20:56:39.637528+0000","last_clean":"2024-09-10T20:56:39.637528+0000","last_became_active":"2024-09-10T20:56:38.159934+0000","last_became_peered":"2024-09-10T20:56:38.159934+0000","last_unstale":"2024-09-10T20:56:39.637528+0000","last_undegraded":"2024-09-10T20:56:39.637528+0000","last_fullsized":"2024-09-10T20:56:39.637528+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:58:27.629519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.637570+0000","last_change":"2024-09-10T20:56:38.169611+0000","last_active":"2024-09-10T20:56:39.637570+0000","last_peered":"2024-09-10T20:56:39.637570+0000","last_clean":"2024-09-10T20:56:39.637570+0000","last_became_active":"2024-09-10T20:56:38.168669+0000","last_became_peered":"2024-09-10T20:56:38.168669+0000","last_unstale":"2024-09-10T20:56:39.637570+0000","last_undegraded":"2024-09-10T20:56:39.637570+0000","last_fullsized":"2024-09-10T20:56:39.637570+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:36.229445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895621+0000","last_change":"2024-09-10T20:56:38.171294+0000","last_active":"2024-09-10T20:56:39.895621+0000","last_peered":"2024-09-10T20:56:39.895621+0000","last_clean":"2024-09-10T20:56:39.895621+0000","last_became_active":"2024-09-10T20:56:38.171036+0000","last_became_peered":"2024-09-10T20:56:38.171036+0000","last_unstale":"2024-09-10T20:56:39.895621+0000","last_undegraded":"2024-09-10T20:56:39.895621+0000","last_fullsized":"2024-09-10T20:56:39.895621+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:50.366589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.160295+0000","last_change":"2024-09-10T20:56:38.161533+0000","last_active":"2024-09-10T20:56:39.160295+0000","last_peered":"2024-09-10T20:56:39.160295+0000","last_clean":"2024-09-10T20:56:39.160295+0000","last_became_active":"2024-09-10T20:56:38.160862+0000","last_became_peered":"2024-09-10T20:56:38.160862+0000","last_unstale":"2024-09-10T20:56:39.160295+0000","last_undegraded":"2024-09-10T20:56:39.160295+0000","last_fullsized":"2024-09-10T20:56:39.160295+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:49:12.825733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.827849+0000","last_change":"2024-09-10T20:56:38.168070+0000","last_active":"2024-09-10T20:56:39.827849+0000","last_peered":"2024-09-10T20:56:39.827849+0000","last_clean":"2024-09-10T20:56:39.827849+0000","last_became_active":"2024-09-10T20:56:38.167670+0000","last_became_peered":"2024-09-10T20:56:38.167670+0000","last_unstale":"2024-09-10T20:56:39.827849+0000","last_undegraded":"2024-09-10T20:56:39.827849+0000","last_fullsized":"2024-09-10T20:56:39.827849+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:59.382183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.160054+0000","last_change":"2024-09-10T20:56:38.171776+0000","last_active":"2024-09-10T20:56:39.160054+0000","last_peered":"2024-09-10T20:56:39.160054+0000","last_clean":"2024-09-10T20:56:39.160054+0000","last_became_active":"2024-09-10T20:56:38.171471+0000","last_became_peered":"2024-09-10T20:56:38.171471+0000","last_unstale":"2024-09-10T20:56:39.160054+0000","last_undegraded":"2024-09-10T20:56:39.160054+0000","last_fullsized":"2024-09-10T20:56:39.160054+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:38:19.333053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.827962+0000","last_change":"2024-09-10T20:56:38.174896+0000","last_active":"2024-09-10T20:56:39.827962+0000","last_peered":"2024-09-10T20:56:39.827962+0000","last_clean":"2024-09-10T20:56:39.827962+0000","last_became_active":"2024-09-10T20:56:38.174670+0000","last_became_peered":"2024-09-10T20:56:38.174670+0000","last_unstale":"2024-09-10T20:56:39.827962+0000","last_undegraded":"2024-09-10T20:56:39.827962+0000","last_fullsized":"2024-09-10T20:56:39.827962+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:00:54.042716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.160155+0000","last_change":"2024-09-10T20:56:38.154093+0000","last_active":"2024-09-10T20:56:39.160155+0000","last_peered":"2024-09-10T20:56:39.160155+0000","last_clean":"2024-09-10T20:56:39.160155+0000","last_became_active":"2024-09-10T20:56:38.153777+0000","last_became_peered":"2024-09-10T20:56:38.153777+0000","last_unstale":"2024-09-10T20:56:39.160155+0000","last_undegraded":"2024-09-10T20:56:39.160155+0000","last_fullsized":"2024-09-10T20:56:39.160155+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:59:49.859563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.637662+0000","last_change":"2024-09-10T20:56:38.170234+0000","last_active":"2024-09-10T20:56:39.637662+0000","last_peered":"2024-09-10T20:56:39.637662+0000","last_clean":"2024-09-10T20:56:39.637662+0000","last_became_active":"2024-09-10T20:56:38.169332+0000","last_became_peered":"2024-09-10T20:56:38.169332+0000","last_unstale":"2024-09-10T20:56:39.637662+0000","last_undegraded":"2024-09-10T20:56:39.637662+0000","last_fullsized":"2024-09-10T20:56:39.637662+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:11.752362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.160711+0000","last_change":"2024-09-10T20:56:38.175358+0000","last_active":"2024-09-10T20:56:39.160711+0000","last_peered":"2024-09-10T20:56:39.160711+0000","last_clean":"2024-09-10T20:56:39.160711+0000","last_became_active":"2024-09-10T20:56:38.175060+0000","last_became_peered":"2024-09-10T20:56:38.175060+0000","last_unstale":"2024-09-10T20:56:39.160711+0000","last_undegraded":"2024-09-10T20:56:39.160711+0000","last_fullsized":"2024-09-10T20:56:39.160711+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:59:49.859563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895822+0000","last_change":"2024-09-10T20:56:38.163171+0000","last_active":"2024-09-10T20:56:39.895822+0000","last_peered":"2024-09-10T20:56:39.895822+0000","last_clean":"2024-09-10T20:56:39.895822+0000","last_became_active":"2024-09-10T20:56:38.162550+0000","last_became_peered":"2024-09-10T20:56:38.162550+0000","last_unstale":"2024-09-10T20:56:39.895822+0000","last_undegraded":"2024-09-10T20:56:39.895822+0000","last_fullsized":"2024-09-10T20:56:39.895822+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:58:47.246890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159464+0000","last_change":"2024-09-10T20:56:38.169276+0000","last_active":"2024-09-10T20:56:39.159464+0000","last_peered":"2024-09-10T20:56:39.159464+0000","last_clean":"2024-09-10T20:56:39.159464+0000","last_became_active":"2024-09-10T20:56:38.166792+0000","last_became_peered":"2024-09-10T20:56:38.166792+0000","last_unstale":"2024-09-10T20:56:39.159464+0000","last_undegraded":"2024-09-10T20:56:39.159464+0000","last_fullsized":"2024-09-10T20:56:39.159464+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:38.009983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895822+0000","last_change":"2024-09-10T20:56:38.169453+0000","last_active":"2024-09-10T20:56:39.895822+0000","last_peered":"2024-09-10T20:56:39.895822+0000","last_clean":"2024-09-10T20:56:39.895822+0000","last_became_active":"2024-09-10T20:56:38.169173+0000","last_became_peered":"2024-09-10T20:56:38.169173+0000","last_unstale":"2024-09-10T20:56:39.895822+0000","last_undegraded":"2024-09-10T20:56:39.895822+0000","last_fullsized":"2024-09-10T20:56:39.895822+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:46:19.482863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895993+0000","last_change":"2024-09-10T20:56:37.146191+0000","last_active":"2024-09-10T20:56:39.895993+0000","last_peered":"2024-09-10T20:56:39.895993+0000","last_clean":"2024-09-10T20:56:39.895993+0000","last_became_active":"2024-09-10T20:56:37.145878+0000","last_became_peered":"2024-09-10T20:56:37.145878+0000","last_unstale":"2024-09-10T20:56:39.895993+0000","last_undegraded":"2024-09-10T20:56:39.895993+0000","last_fullsized":"2024-09-10T20:56:39.895993+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:27.004455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895968+0000","last_change":"2024-09-10T20:56:38.168411+0000","last_active":"2024-09-10T20:56:39.895968+0000","last_peered":"2024-09-10T20:56:39.895968+0000","last_clean":"2024-09-10T20:56:39.895968+0000","last_became_active":"2024-09-10T20:56:38.167842+0000","last_became_peered":"2024-09-10T20:56:38.167842+0000","last_unstale":"2024-09-10T20:56:39.895968+0000","last_undegraded":"2024-09-10T20:56:39.895968+0000","last_fullsized":"2024-09-10T20:56:39.895968+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:45.328902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895800+0000","last_change":"2024-09-10T20:56:37.140973+0000","last_active":"2024-09-10T20:56:39.895800+0000","last_peered":"2024-09-10T20:56:39.895800+0000","last_clean":"2024-09-10T20:56:39.895800+0000","last_became_active":"2024-09-10T20:56:37.140621+0000","last_became_peered":"2024-09-10T20:56:37.140621+0000","last_unstale":"2024-09-10T20:56:39.895800+0000","last_undegraded":"2024-09-10T20:56:39.895800+0000","last_fullsized":"2024-09-10T20:56:39.895800+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:38.108076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.637901+0000","last_change":"2024-09-10T20:56:38.169377+0000","last_active":"2024-09-10T20:56:39.637901+0000","last_peered":"2024-09-10T20:56:39.637901+0000","last_clean":"2024-09-10T20:56:39.637901+0000","last_became_active":"2024-09-10T20:56:38.169086+0000","last_became_peered":"2024-09-10T20:56:38.169086+0000","last_unstale":"2024-09-10T20:56:39.637901+0000","last_undegraded":"2024-09-10T20:56:39.637901+0000","last_fullsized":"2024-09-10T20:56:39.637901+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:40.150106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159487+0000","last_change":"2024-09-10T20:56:37.144531+0000","last_active":"2024-09-10T20:56:39.159487+0000","last_peered":"2024-09-10T20:56:39.159487+0000","last_clean":"2024-09-10T20:56:39.159487+0000","last_became_active":"2024-09-10T20:56:37.144184+0000","last_became_peered":"2024-09-10T20:56:37.144184+0000","last_unstale":"2024-09-10T20:56:39.159487+0000","last_undegraded":"2024-09-10T20:56:39.159487+0000","last_fullsized":"2024-09-10T20:56:39.159487+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:27.031518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.828023+0000","last_change":"2024-09-10T20:56:38.169857+0000","last_active":"2024-09-10T20:56:39.828023+0000","last_peered":"2024-09-10T20:56:39.828023+0000","last_clean":"2024-09-10T20:56:39.828023+0000","last_became_active":"2024-09-10T20:56:38.169565+0000","last_became_peered":"2024-09-10T20:56:38.169565+0000","last_unstale":"2024-09-10T20:56:39.828023+0000","last_undegraded":"2024-09-10T20:56:39.828023+0000","last_fullsized":"2024-09-10T20:56:39.828023+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:11.205627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.826464+0000","last_change":"2024-09-10T20:56:37.141690+0000","last_active":"2024-09-10T20:56:39.826464+0000","last_peered":"2024-09-10T20:56:39.826464+0000","last_clean":"2024-09-10T20:56:39.826464+0000","last_became_active":"2024-09-10T20:56:37.141098+0000","last_became_peered":"2024-09-10T20:56:37.141098+0000","last_unstale":"2024-09-10T20:56:39.826464+0000","last_undegraded":"2024-09-10T20:56:39.826464+0000","last_fullsized":"2024-09-10T20:56:39.826464+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:47:59.966545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.160694+0000","last_change":"2024-09-10T20:56:38.174236+0000","last_active":"2024-09-10T20:56:39.160694+0000","last_peered":"2024-09-10T20:56:39.160694+0000","last_clean":"2024-09-10T20:56:39.160694+0000","last_became_active":"2024-09-10T20:56:38.173182+0000","last_became_peered":"2024-09-10T20:56:38.173182+0000","last_unstale":"2024-09-10T20:56:39.160694+0000","last_undegraded":"2024-09-10T20:56:39.160694+0000","last_fullsized":"2024-09-10T20:56:39.160694+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:04:55.129378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.637689+0000","last_change":"2024-09-10T20:56:37.142809+0000","last_active":"2024-09-10T20:56:39.637689+0000","last_peered":"2024-09-10T20:56:39.637689+0000","last_clean":"2024-09-10T20:56:39.637689+0000","last_became_active":"2024-09-10T20:56:37.142502+0000","last_became_peered":"2024-09-10T20:56:37.142502+0000","last_unstale":"2024-09-10T20:56:39.637689+0000","last_undegraded":"2024-09-10T20:56:39.637689+0000","last_fullsized":"2024-09-10T20:56:39.637689+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:05.157672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159627+0000","last_change":"2024-09-10T20:56:38.159186+0000","last_active":"2024-09-10T20:56:39.159627+0000","last_peered":"2024-09-10T20:56:39.159627+0000","last_clean":"2024-09-10T20:56:39.159627+0000","last_became_active":"2024-09-10T20:56:38.157690+0000","last_became_peered":"2024-09-10T20:56:38.157690+0000","last_unstale":"2024-09-10T20:56:39.159627+0000","last_undegraded":"2024-09-10T20:56:39.159627+0000","last_fullsized":"2024-09-10T20:56:39.159627+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:11.205627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.637585+0000","last_change":"2024-09-10T20:56:37.138322+0000","last_active":"2024-09-10T20:56:39.637585+0000","last_peered":"2024-09-10T20:56:39.637585+0000","last_clean":"2024-09-10T20:56:39.637585+0000","last_became_active":"2024-09-10T20:56:37.138056+0000","last_became_peered":"2024-09-10T20:56:37.138056+0000","last_unstale":"2024-09-10T20:56:39.637585+0000","last_undegraded":"2024-09-10T20:56:39.637585+0000","last_fullsized":"2024-09-10T20:56:39.637585+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:54:41.214426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.637832+0000","last_change":"2024-09-10T20:56:38.157572+0000","last_active":"2024-09-10T20:56:39.637832+0000","last_peered":"2024-09-10T20:56:39.637832+0000","last_clean":"2024-09-10T20:56:39.637832+0000","last_became_active":"2024-09-10T20:56:38.156050+0000","last_became_peered":"2024-09-10T20:56:38.156050+0000","last_unstale":"2024-09-10T20:56:39.637832+0000","last_undegraded":"2024-09-10T20:56:39.637832+0000","last_fullsized":"2024-09-10T20:56:39.637832+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:26:40.971161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159051+0000","last_change":"2024-09-10T20:56:37.145395+0000","last_active":"2024-09-10T20:56:39.159051+0000","last_peered":"2024-09-10T20:56:39.159051+0000","last_clean":"2024-09-10T20:56:39.159051+0000","last_became_active":"2024-09-10T20:56:37.145130+0000","last_became_peered":"2024-09-10T20:56:37.145130+0000","last_unstale":"2024-09-10T20:56:39.159051+0000","last_undegraded":"2024-09-10T20:56:39.159051+0000","last_fullsized":"2024-09-10T20:56:39.159051+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:03:46.184293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.827480+0000","last_change":"2024-09-10T20:56:38.158119+0000","last_active":"2024-09-10T20:56:39.827480+0000","last_peered":"2024-09-10T20:56:39.827480+0000","last_clean":"2024-09-10T20:56:39.827480+0000","last_became_active":"2024-09-10T20:56:38.157795+0000","last_became_peered":"2024-09-10T20:56:38.157795+0000","last_unstale":"2024-09-10T20:56:39.827480+0000","last_undegraded":"2024-09-10T20:56:39.827480+0000","last_fullsized":"2024-09-10T20:56:39.827480+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:22:15.010616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.637452+0000","last_change":"2024-09-10T20:56:37.137604+0000","last_active":"2024-09-10T20:56:39.637452+0000","last_peered":"2024-09-10T20:56:39.637452+0000","last_clean":"2024-09-10T20:56:39.637452+0000","last_became_active":"2024-09-10T20:56:37.136277+0000","last_became_peered":"2024-09-10T20:56:37.136277+0000","last_unstale":"2024-09-10T20:56:39.637452+0000","last_undegraded":"2024-09-10T20:56:39.637452+0000","last_fullsized":"2024-09-10T20:56:39.637452+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:45.530317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159719+0000","last_change":"2024-09-10T20:56:38.161102+0000","last_active":"2024-09-10T20:56:39.159719+0000","last_peered":"2024-09-10T20:56:39.159719+0000","last_clean":"2024-09-10T20:56:39.159719+0000","last_became_active":"2024-09-10T20:56:38.160615+0000","last_became_peered":"2024-09-10T20:56:38.160615+0000","last_unstale":"2024-09-10T20:56:39.159719+0000","last_undegraded":"2024-09-10T20:56:39.159719+0000","last_fullsized":"2024-09-10T20:56:39.159719+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:06:05.780968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159557+0000","last_change":"2024-09-10T20:56:37.148316+0000","last_active":"2024-09-10T20:56:39.159557+0000","last_peered":"2024-09-10T20:56:39.159557+0000","last_clean":"2024-09-10T20:56:39.159557+0000","last_became_active":"2024-09-10T20:56:37.148034+0000","last_became_peered":"2024-09-10T20:56:37.148034+0000","last_unstale":"2024-09-10T20:56:39.159557+0000","last_undegraded":"2024-09-10T20:56:39.159557+0000","last_fullsized":"2024-09-10T20:56:39.159557+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:48:35.506758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159491+0000","last_change":"2024-09-10T20:56:38.168062+0000","last_active":"2024-09-10T20:56:39.159491+0000","last_peered":"2024-09-10T20:56:39.159491+0000","last_clean":"2024-09-10T20:56:39.159491+0000","last_became_active":"2024-09-10T20:56:38.166076+0000","last_became_peered":"2024-09-10T20:56:38.166076+0000","last_unstale":"2024-09-10T20:56:39.159491+0000","last_undegraded":"2024-09-10T20:56:39.159491+0000","last_fullsized":"2024-09-10T20:56:39.159491+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:01:46.029373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895916+0000","last_change":"2024-09-10T20:56:37.151835+0000","last_active":"2024-09-10T20:56:39.895916+0000","last_peered":"2024-09-10T20:56:39.895916+0000","last_clean":"2024-09-10T20:56:39.895916+0000","last_became_active":"2024-09-10T20:56:37.151520+0000","last_became_peered":"2024-09-10T20:56:37.151520+0000","last_unstale":"2024-09-10T20:56:39.895916+0000","last_undegraded":"2024-09-10T20:56:39.895916+0000","last_fullsized":"2024-09-10T20:56:39.895916+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:04:37.157796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159839+0000","last_change":"2024-09-10T20:56:38.172457+0000","last_active":"2024-09-10T20:56:39.159839+0000","last_peered":"2024-09-10T20:56:39.159839+0000","last_clean":"2024-09-10T20:56:39.159839+0000","last_became_active":"2024-09-10T20:56:38.172146+0000","last_became_peered":"2024-09-10T20:56:38.172146+0000","last_unstale":"2024-09-10T20:56:39.159839+0000","last_undegraded":"2024-09-10T20:56:39.159839+0000","last_fullsized":"2024-09-10T20:56:39.159839+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:14:03.795634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159712+0000","last_change":"2024-09-10T20:56:37.137553+0000","last_active":"2024-09-10T20:56:39.159712+0000","last_peered":"2024-09-10T20:56:39.159712+0000","last_clean":"2024-09-10T20:56:39.159712+0000","last_became_active":"2024-09-10T20:56:37.137268+0000","last_became_peered":"2024-09-10T20:56:37.137268+0000","last_unstale":"2024-09-10T20:56:39.159712+0000","last_undegraded":"2024-09-10T20:56:39.159712+0000","last_fullsized":"2024-09-10T20:56:39.159712+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:58:46.238344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.161098+0000","last_change":"2024-09-10T20:56:38.176322+0000","last_active":"2024-09-10T20:56:39.161098+0000","last_peered":"2024-09-10T20:56:39.161098+0000","last_clean":"2024-09-10T20:56:39.161098+0000","last_became_active":"2024-09-10T20:56:38.175858+0000","last_became_peered":"2024-09-10T20:56:38.175858+0000","last_unstale":"2024-09-10T20:56:39.161098+0000","last_undegraded":"2024-09-10T20:56:39.161098+0000","last_fullsized":"2024-09-10T20:56:39.161098+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:51.074302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159871+0000","last_change":"2024-09-10T20:56:37.144471+0000","last_active":"2024-09-10T20:56:39.159871+0000","last_peered":"2024-09-10T20:56:39.159871+0000","last_clean":"2024-09-10T20:56:39.159871+0000","last_became_active":"2024-09-10T20:56:37.144170+0000","last_became_peered":"2024-09-10T20:56:37.144170+0000","last_unstale":"2024-09-10T20:56:39.159871+0000","last_undegraded":"2024-09-10T20:56:39.159871+0000","last_fullsized":"2024-09-10T20:56:39.159871+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:24:26.058645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.827521+0000","last_change":"2024-09-10T20:56:38.160855+0000","last_active":"2024-09-10T20:56:39.827521+0000","last_peered":"2024-09-10T20:56:39.827521+0000","last_clean":"2024-09-10T20:56:39.827521+0000","last_became_active":"2024-09-10T20:56:38.160481+0000","last_became_peered":"2024-09-10T20:56:38.160481+0000","last_unstale":"2024-09-10T20:56:39.827521+0000","last_undegraded":"2024-09-10T20:56:39.827521+0000","last_fullsized":"2024-09-10T20:56:39.827521+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:48:49.752855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.637759+0000","last_change":"2024-09-10T20:56:37.137520+0000","last_active":"2024-09-10T20:56:39.637759+0000","last_peered":"2024-09-10T20:56:39.637759+0000","last_clean":"2024-09-10T20:56:39.637759+0000","last_became_active":"2024-09-10T20:56:37.136605+0000","last_became_peered":"2024-09-10T20:56:37.136605+0000","last_unstale":"2024-09-10T20:56:39.637759+0000","last_undegraded":"2024-09-10T20:56:39.637759+0000","last_fullsized":"2024-09-10T20:56:39.637759+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:51:14.065783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159616+0000","last_change":"2024-09-10T20:56:38.161692+0000","last_active":"2024-09-10T20:56:39.159616+0000","last_peered":"2024-09-10T20:56:39.159616+0000","last_clean":"2024-09-10T20:56:39.159616+0000","last_became_active":"2024-09-10T20:56:38.161390+0000","last_became_peered":"2024-09-10T20:56:38.161390+0000","last_unstale":"2024-09-10T20:56:39.159616+0000","last_undegraded":"2024-09-10T20:56:39.159616+0000","last_fullsized":"2024-09-10T20:56:39.159616+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:55:42.667720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.827509+0000","last_change":"2024-09-10T20:56:37.143926+0000","last_active":"2024-09-10T20:56:39.827509+0000","last_peered":"2024-09-10T20:56:39.827509+0000","last_clean":"2024-09-10T20:56:39.827509+0000","last_became_active":"2024-09-10T20:56:37.143615+0000","last_became_peered":"2024-09-10T20:56:37.143615+0000","last_unstale":"2024-09-10T20:56:39.827509+0000","last_undegraded":"2024-09-10T20:56:39.827509+0000","last_fullsized":"2024-09-10T20:56:39.827509+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:27.004455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159672+0000","last_change":"2024-09-10T20:56:38.169797+0000","last_active":"2024-09-10T20:56:39.159672+0000","last_peered":"2024-09-10T20:56:39.159672+0000","last_clean":"2024-09-10T20:56:39.159672+0000","last_became_active":"2024-09-10T20:56:38.166936+0000","last_became_peered":"2024-09-10T20:56:38.166936+0000","last_unstale":"2024-09-10T20:56:39.159672+0000","last_undegraded":"2024-09-10T20:56:39.159672+0000","last_fullsized":"2024-09-10T20:56:39.159672+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:11.205627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.160025+0000","last_change":"2024-09-10T20:56:37.142835+0000","last_active":"2024-09-10T20:56:39.160025+0000","last_peered":"2024-09-10T20:56:39.160025+0000","last_clean":"2024-09-10T20:56:39.160025+0000","last_became_active":"2024-09-10T20:56:37.141132+0000","last_became_peered":"2024-09-10T20:56:37.141132+0000","last_unstale":"2024-09-10T20:56:39.160025+0000","last_undegraded":"2024-09-10T20:56:39.160025+0000","last_fullsized":"2024-09-10T20:56:39.160025+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:32:42.408845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895963+0000","last_change":"2024-09-10T20:56:38.163561+0000","last_active":"2024-09-10T20:56:39.895963+0000","last_peered":"2024-09-10T20:56:39.895963+0000","last_clean":"2024-09-10T20:56:39.895963+0000","last_became_active":"2024-09-10T20:56:38.162903+0000","last_became_peered":"2024-09-10T20:56:38.162903+0000","last_unstale":"2024-09-10T20:56:39.895963+0000","last_undegraded":"2024-09-10T20:56:39.895963+0000","last_fullsized":"2024-09-10T20:56:39.895963+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:11.063733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159095+0000","last_change":"2024-09-10T20:56:37.145061+0000","last_active":"2024-09-10T20:56:39.159095+0000","last_peered":"2024-09-10T20:56:39.159095+0000","last_clean":"2024-09-10T20:56:39.159095+0000","last_became_active":"2024-09-10T20:56:37.144758+0000","last_became_peered":"2024-09-10T20:56:37.144758+0000","last_unstale":"2024-09-10T20:56:39.159095+0000","last_undegraded":"2024-09-10T20:56:39.159095+0000","last_fullsized":"2024-09-10T20:56:39.159095+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:22.395325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.637765+0000","last_change":"2024-09-10T20:56:38.159041+0000","last_active":"2024-09-10T20:56:39.637765+0000","last_peered":"2024-09-10T20:56:39.637765+0000","last_clean":"2024-09-10T20:56:39.637765+0000","last_became_active":"2024-09-10T20:56:38.158749+0000","last_became_peered":"2024-09-10T20:56:38.158749+0000","last_unstale":"2024-09-10T20:56:39.637765+0000","last_undegraded":"2024-09-10T20:56:39.637765+0000","last_fullsized":"2024-09-10T20:56:39.637765+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:28:54.408161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.828097+0000","last_change":"2024-09-10T20:56:37.144780+0000","last_active":"2024-09-10T20:56:39.828097+0000","last_peered":"2024-09-10T20:56:39.828097+0000","last_clean":"2024-09-10T20:56:39.828097+0000","last_became_active":"2024-09-10T20:56:37.144525+0000","last_became_peered":"2024-09-10T20:56:37.144525+0000","last_unstale":"2024-09-10T20:56:39.828097+0000","last_undegraded":"2024-09-10T20:56:39.828097+0000","last_fullsized":"2024-09-10T20:56:39.828097+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:22.559705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.160081+0000","last_change":"2024-09-10T20:56:38.158317+0000","last_active":"2024-09-10T20:56:39.160081+0000","last_peered":"2024-09-10T20:56:39.160081+0000","last_clean":"2024-09-10T20:56:39.160081+0000","last_became_active":"2024-09-10T20:56:38.157842+0000","last_became_peered":"2024-09-10T20:56:38.157842+0000","last_unstale":"2024-09-10T20:56:39.160081+0000","last_undegraded":"2024-09-10T20:56:39.160081+0000","last_fullsized":"2024-09-10T20:56:39.160081+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:04:55.129378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.637932+0000","last_change":"2024-09-10T20:56:37.140328+0000","last_active":"2024-09-10T20:56:39.637932+0000","last_peered":"2024-09-10T20:56:39.637932+0000","last_clean":"2024-09-10T20:56:39.637932+0000","last_became_active":"2024-09-10T20:56:37.139983+0000","last_became_peered":"2024-09-10T20:56:37.139983+0000","last_unstale":"2024-09-10T20:56:39.637932+0000","last_undegraded":"2024-09-10T20:56:39.637932+0000","last_fullsized":"2024-09-10T20:56:39.637932+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:47:52.623998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.827873+0000","last_change":"2024-09-10T20:56:38.172980+0000","last_active":"2024-09-10T20:56:39.827873+0000","last_peered":"2024-09-10T20:56:39.827873+0000","last_clean":"2024-09-10T20:56:39.827873+0000","last_became_active":"2024-09-10T20:56:38.172622+0000","last_became_peered":"2024-09-10T20:56:38.172622+0000","last_unstale":"2024-09-10T20:56:39.827873+0000","last_undegraded":"2024-09-10T20:56:39.827873+0000","last_fullsized":"2024-09-10T20:56:39.827873+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:38.009983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.638136+0000","last_change":"2024-09-10T20:56:37.140465+0000","last_active":"2024-09-10T20:56:39.638136+0000","last_peered":"2024-09-10T20:56:39.638136+0000","last_clean":"2024-09-10T20:56:39.638136+0000","last_became_active":"2024-09-10T20:56:37.139201+0000","last_became_peered":"2024-09-10T20:56:37.139201+0000","last_unstale":"2024-09-10T20:56:39.638136+0000","last_undegraded":"2024-09-10T20:56:39.638136+0000","last_fullsized":"2024-09-10T20:56:39.638136+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:18.812116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.826391+0000","last_change":"2024-09-10T20:56:38.178486+0000","last_active":"2024-09-10T20:56:39.826391+0000","last_peered":"2024-09-10T20:56:39.826391+0000","last_clean":"2024-09-10T20:56:39.826391+0000","last_became_active":"2024-09-10T20:56:38.178188+0000","last_became_peered":"2024-09-10T20:56:38.178188+0000","last_unstale":"2024-09-10T20:56:39.826391+0000","last_undegraded":"2024-09-10T20:56:39.826391+0000","last_fullsized":"2024-09-10T20:56:39.826391+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:57.614688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.637936+0000","last_change":"2024-09-10T20:56:37.142632+0000","last_active":"2024-09-10T20:56:39.637936+0000","last_peered":"2024-09-10T20:56:39.637936+0000","last_clean":"2024-09-10T20:56:39.637936+0000","last_became_active":"2024-09-10T20:56:37.141122+0000","last_became_peered":"2024-09-10T20:56:37.141122+0000","last_unstale":"2024-09-10T20:56:39.637936+0000","last_undegraded":"2024-09-10T20:56:39.637936+0000","last_fullsized":"2024-09-10T20:56:39.637936+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:01:18.539787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.826269+0000","last_change":"2024-09-10T20:56:38.153799+0000","last_active":"2024-09-10T20:56:39.826269+0000","last_peered":"2024-09-10T20:56:39.826269+0000","last_clean":"2024-09-10T20:56:39.826269+0000","last_became_active":"2024-09-10T20:56:38.153529+0000","last_became_peered":"2024-09-10T20:56:38.153529+0000","last_unstale":"2024-09-10T20:56:39.826269+0000","last_undegraded":"2024-09-10T20:56:39.826269+0000","last_fullsized":"2024-09-10T20:56:39.826269+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:56:36.383679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895790+0000","last_change":"2024-09-10T20:56:37.149392+0000","last_active":"2024-09-10T20:56:39.895790+0000","last_peered":"2024-09-10T20:56:39.895790+0000","last_clean":"2024-09-10T20:56:39.895790+0000","last_became_active":"2024-09-10T20:56:37.148872+0000","last_became_peered":"2024-09-10T20:56:37.148872+0000","last_unstale":"2024-09-10T20:56:39.895790+0000","last_undegraded":"2024-09-10T20:56:39.895790+0000","last_fullsized":"2024-09-10T20:56:39.895790+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:50:29.602715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.826588+0000","last_change":"2024-09-10T20:56:38.159089+0000","last_active":"2024-09-10T20:56:39.826588+0000","last_peered":"2024-09-10T20:56:39.826588+0000","last_clean":"2024-09-10T20:56:39.826588+0000","last_became_active":"2024-09-10T20:56:38.158741+0000","last_became_peered":"2024-09-10T20:56:38.158741+0000","last_unstale":"2024-09-10T20:56:39.826588+0000","last_undegraded":"2024-09-10T20:56:39.826588+0000","last_fullsized":"2024-09-10T20:56:39.826588+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:27:53.250076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895831+0000","last_change":"2024-09-10T20:56:37.147505+0000","last_active":"2024-09-10T20:56:39.895831+0000","last_peered":"2024-09-10T20:56:39.895831+0000","last_clean":"2024-09-10T20:56:39.895831+0000","last_became_active":"2024-09-10T20:56:37.147242+0000","last_became_peered":"2024-09-10T20:56:37.147242+0000","last_unstale":"2024-09-10T20:56:39.895831+0000","last_undegraded":"2024-09-10T20:56:39.895831+0000","last_fullsized":"2024-09-10T20:56:39.895831+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:12.264819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.825928+0000","last_change":"2024-09-10T20:56:38.158162+0000","last_active":"2024-09-10T20:56:39.825928+0000","last_peered":"2024-09-10T20:56:39.825928+0000","last_clean":"2024-09-10T20:56:39.825928+0000","last_became_active":"2024-09-10T20:56:38.157889+0000","last_became_peered":"2024-09-10T20:56:38.157889+0000","last_unstale":"2024-09-10T20:56:39.825928+0000","last_undegraded":"2024-09-10T20:56:39.825928+0000","last_fullsized":"2024-09-10T20:56:39.825928+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:46:00.932827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.637450+0000","last_change":"2024-09-10T20:56:37.142604+0000","last_active":"2024-09-10T20:56:39.637450+0000","last_peered":"2024-09-10T20:56:39.637450+0000","last_clean":"2024-09-10T20:56:39.637450+0000","last_became_active":"2024-09-10T20:56:37.142340+0000","last_became_peered":"2024-09-10T20:56:37.142340+0000","last_unstale":"2024-09-10T20:56:39.637450+0000","last_undegraded":"2024-09-10T20:56:39.637450+0000","last_fullsized":"2024-09-10T20:56:39.637450+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:57.416321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.160756+0000","last_change":"2024-09-10T20:56:38.181525+0000","last_active":"2024-09-10T20:56:39.160756+0000","last_peered":"2024-09-10T20:56:39.160756+0000","last_clean":"2024-09-10T20:56:39.160756+0000","last_became_active":"2024-09-10T20:56:38.178525+0000","last_became_peered":"2024-09-10T20:56:38.178525+0000","last_unstale":"2024-09-10T20:56:39.160756+0000","last_undegraded":"2024-09-10T20:56:39.160756+0000","last_fullsized":"2024-09-10T20:56:39.160756+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:49:12.825733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.160361+0000","last_change":"2024-09-10T20:56:37.141051+0000","last_active":"2024-09-10T20:56:39.160361+0000","last_peered":"2024-09-10T20:56:39.160361+0000","last_clean":"2024-09-10T20:56:39.160361+0000","last_became_active":"2024-09-10T20:56:37.140705+0000","last_became_peered":"2024-09-10T20:56:37.140705+0000","last_unstale":"2024-09-10T20:56:39.160361+0000","last_undegraded":"2024-09-10T20:56:39.160361+0000","last_fullsized":"2024-09-10T20:56:39.160361+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:10:06.780644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.826542+0000","last_change":"2024-09-10T20:56:38.165637+0000","last_active":"2024-09-10T20:56:39.826542+0000","last_peered":"2024-09-10T20:56:39.826542+0000","last_clean":"2024-09-10T20:56:39.826542+0000","last_became_active":"2024-09-10T20:56:38.165344+0000","last_became_peered":"2024-09-10T20:56:38.165344+0000","last_unstale":"2024-09-10T20:56:39.826542+0000","last_undegraded":"2024-09-10T20:56:39.826542+0000","last_fullsized":"2024-09-10T20:56:39.826542+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:28.013002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.828127+0000","last_change":"2024-09-10T20:56:37.150166+0000","last_active":"2024-09-10T20:56:39.828127+0000","last_peered":"2024-09-10T20:56:39.828127+0000","last_clean":"2024-09-10T20:56:39.828127+0000","last_became_active":"2024-09-10T20:56:37.149784+0000","last_became_peered":"2024-09-10T20:56:37.149784+0000","last_unstale":"2024-09-10T20:56:39.828127+0000","last_undegraded":"2024-09-10T20:56:39.828127+0000","last_fullsized":"2024-09-10T20:56:39.828127+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:11:22.203970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.160456+0000","last_change":"2024-09-10T20:56:38.179086+0000","last_active":"2024-09-10T20:56:39.160456+0000","last_peered":"2024-09-10T20:56:39.160456+0000","last_clean":"2024-09-10T20:56:39.160456+0000","last_became_active":"2024-09-10T20:56:38.176381+0000","last_became_peered":"2024-09-10T20:56:38.176381+0000","last_unstale":"2024-09-10T20:56:39.160456+0000","last_undegraded":"2024-09-10T20:56:39.160456+0000","last_fullsized":"2024-09-10T20:56:39.160456+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:08:05.011647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.896012+0000","last_change":"2024-09-10T20:56:37.144142+0000","last_active":"2024-09-10T20:56:39.896012+0000","last_peered":"2024-09-10T20:56:39.896012+0000","last_clean":"2024-09-10T20:56:39.896012+0000","last_became_active":"2024-09-10T20:56:37.143835+0000","last_became_peered":"2024-09-10T20:56:37.143835+0000","last_unstale":"2024-09-10T20:56:39.896012+0000","last_undegraded":"2024-09-10T20:56:39.896012+0000","last_fullsized":"2024-09-10T20:56:39.896012+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:51:50.869361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895723+0000","last_change":"2024-09-10T20:56:38.177166+0000","last_active":"2024-09-10T20:56:39.895723+0000","last_peered":"2024-09-10T20:56:39.895723+0000","last_clean":"2024-09-10T20:56:39.895723+0000","last_became_active":"2024-09-10T20:56:38.176862+0000","last_became_peered":"2024-09-10T20:56:38.176862+0000","last_unstale":"2024-09-10T20:56:39.895723+0000","last_undegraded":"2024-09-10T20:56:39.895723+0000","last_fullsized":"2024-09-10T20:56:39.895723+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:11.063733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.827981+0000","last_change":"2024-09-10T20:56:37.141713+0000","last_active":"2024-09-10T20:56:39.827981+0000","last_peered":"2024-09-10T20:56:39.827981+0000","last_clean":"2024-09-10T20:56:39.827981+0000","last_became_active":"2024-09-10T20:56:37.141385+0000","last_became_peered":"2024-09-10T20:56:37.141385+0000","last_unstale":"2024-09-10T20:56:39.827981+0000","last_undegraded":"2024-09-10T20:56:39.827981+0000","last_fullsized":"2024-09-10T20:56:39.827981+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:45:54.051740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895806+0000","last_change":"2024-09-10T20:56:38.166177+0000","last_active":"2024-09-10T20:56:39.895806+0000","last_peered":"2024-09-10T20:56:39.895806+0000","last_clean":"2024-09-10T20:56:39.895806+0000","last_became_active":"2024-09-10T20:56:38.165844+0000","last_became_peered":"2024-09-10T20:56:38.165844+0000","last_unstale":"2024-09-10T20:56:39.895806+0000","last_undegraded":"2024-09-10T20:56:39.895806+0000","last_fullsized":"2024-09-10T20:56:39.895806+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:55:02.168176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895935+0000","last_change":"2024-09-10T20:56:37.147085+0000","last_active":"2024-09-10T20:56:39.895935+0000","last_peered":"2024-09-10T20:56:39.895935+0000","last_clean":"2024-09-10T20:56:39.895935+0000","last_became_active":"2024-09-10T20:56:37.146431+0000","last_became_peered":"2024-09-10T20:56:37.146431+0000","last_unstale":"2024-09-10T20:56:39.895935+0000","last_undegraded":"2024-09-10T20:56:39.895935+0000","last_fullsized":"2024-09-10T20:56:39.895935+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:41:31.782397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895850+0000","last_change":"2024-09-10T20:56:38.154317+0000","last_active":"2024-09-10T20:56:39.895850+0000","last_peered":"2024-09-10T20:56:39.895850+0000","last_clean":"2024-09-10T20:56:39.895850+0000","last_became_active":"2024-09-10T20:56:38.154012+0000","last_became_peered":"2024-09-10T20:56:38.154012+0000","last_unstale":"2024-09-10T20:56:39.895850+0000","last_undegraded":"2024-09-10T20:56:39.895850+0000","last_fullsized":"2024-09-10T20:56:39.895850+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:45.328902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.827631+0000","last_change":"2024-09-10T20:56:37.150585+0000","last_active":"2024-09-10T20:56:39.827631+0000","last_peered":"2024-09-10T20:56:39.827631+0000","last_clean":"2024-09-10T20:56:39.827631+0000","last_became_active":"2024-09-10T20:56:37.149813+0000","last_became_peered":"2024-09-10T20:56:37.149813+0000","last_unstale":"2024-09-10T20:56:39.827631+0000","last_undegraded":"2024-09-10T20:56:39.827631+0000","last_fullsized":"2024-09-10T20:56:39.827631+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:27:52.241529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159186+0000","last_change":"2024-09-10T20:56:38.171350+0000","last_active":"2024-09-10T20:56:39.159186+0000","last_peered":"2024-09-10T20:56:39.159186+0000","last_clean":"2024-09-10T20:56:39.159186+0000","last_became_active":"2024-09-10T20:56:38.166604+0000","last_became_peered":"2024-09-10T20:56:38.166604+0000","last_unstale":"2024-09-10T20:56:39.159186+0000","last_undegraded":"2024-09-10T20:56:39.159186+0000","last_fullsized":"2024-09-10T20:56:39.159186+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:04:41.603241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.638068+0000","last_change":"2024-09-10T20:56:37.132028+0000","last_active":"2024-09-10T20:56:39.638068+0000","last_peered":"2024-09-10T20:56:39.638068+0000","last_clean":"2024-09-10T20:56:39.638068+0000","last_became_active":"2024-09-10T20:56:37.131705+0000","last_became_peered":"2024-09-10T20:56:37.131705+0000","last_unstale":"2024-09-10T20:56:39.638068+0000","last_undegraded":"2024-09-10T20:56:39.638068+0000","last_fullsized":"2024-09-10T20:56:39.638068+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:17:42.504437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.637465+0000","last_change":"2024-09-10T20:56:38.163061+0000","last_active":"2024-09-10T20:56:39.637465+0000","last_peered":"2024-09-10T20:56:39.637465+0000","last_clean":"2024-09-10T20:56:39.637465+0000","last_became_active":"2024-09-10T20:56:38.162746+0000","last_became_peered":"2024-09-10T20:56:38.162746+0000","last_unstale":"2024-09-10T20:56:39.637465+0000","last_undegraded":"2024-09-10T20:56:39.637465+0000","last_fullsized":"2024-09-10T20:56:39.637465+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:52:08.011169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159202+0000","last_change":"2024-09-10T20:56:37.148385+0000","last_active":"2024-09-10T20:56:39.159202+0000","last_peered":"2024-09-10T20:56:39.159202+0000","last_clean":"2024-09-10T20:56:39.159202+0000","last_became_active":"2024-09-10T20:56:37.148079+0000","last_became_peered":"2024-09-10T20:56:37.148079+0000","last_unstale":"2024-09-10T20:56:39.159202+0000","last_undegraded":"2024-09-10T20:56:39.159202+0000","last_fullsized":"2024-09-10T20:56:39.159202+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:46:05.846818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.160626+0000","last_change":"2024-09-10T20:56:38.179549+0000","last_active":"2024-09-10T20:56:39.160626+0000","last_peered":"2024-09-10T20:56:39.160626+0000","last_clean":"2024-09-10T20:56:39.160626+0000","last_became_active":"2024-09-10T20:56:38.179259+0000","last_became_peered":"2024-09-10T20:56:38.179259+0000","last_unstale":"2024-09-10T20:56:39.160626+0000","last_undegraded":"2024-09-10T20:56:39.160626+0000","last_fullsized":"2024-09-10T20:56:39.160626+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:37.116004+0000","last_clean_scrub_stamp":"2024-09-10T20:56:37.116004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:55.667614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.895736+0000","last_change":"2024-09-10T20:56:37.139551+0000","last_active":"2024-09-10T20:56:39.895736+0000","last_peered":"2024-09-10T20:56:39.895736+0000","last_clean":"2024-09-10T20:56:39.895736+0000","last_became_active":"2024-09-10T20:56:37.139252+0000","last_became_peered":"2024-09-10T20:56:37.139252+0000","last_unstale":"2024-09-10T20:56:39.895736+0000","last_undegraded":"2024-09-10T20:56:39.895736+0000","last_fullsized":"2024-09-10T20:56:39.895736+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:56:36.107458+0000","last_clean_scrub_stamp":"2024-09-10T20:56:36.107458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:37:14.449011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":134,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T20:56:39.159985+0000","last_change":"2024-09-10T20:55:34.718784+0000","last_active":"2024-09-10T20:56:39.159985+0000","last_peered":"2024-09-10T20:56:39.159985+0000","last_clean":"2024-09-10T20:56:39.159985+0000","last_became_active":"2024-09-10T20:55:34.717616+0000","last_became_peered":"2024-09-10T20:55:34.717616+0000","last_unstale":"2024-09-10T20:56:39.159985+0000","last_undegraded":"2024-09-10T20:56:39.159985+0000","last_fullsized":"2024-09-10T20:56:39.159985+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:33.618098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:33.618098+0000","last_clean_scrub_stamp":"2024-09-10T20:55:33.618098+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:17.442729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":987136,"data_stored":743296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":397312,"data_stored":153454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":397312,"data_stored":153510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509456,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":397312,"data_stored":152942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":393216,"data_stored":152908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":154472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":983040,"data_stored":743206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542162,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":154472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T20:56:47.724 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T20:56:47.724 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T20:56:47.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.922+0000 7f98ad800640 1 -- 172.21.15.6:0/1527696273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98a815c170 msgr2=0x7f98a80cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:47.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.922+0000 7f98ad800640 1 --2- 172.21.15.6:0/1527696273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98a815c170 0x7f98a80cd920 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9894005fd0 tx=0x7f989402a4b0 comp rx=0 tx=0).stop 2024-09-10T20:56:47.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.923+0000 7f98ad800640 1 -- 172.21.15.6:0/1527696273 shutdown_connections 2024-09-10T20:56:47.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.923+0000 7f98ad800640 1 --2- 172.21.15.6:0/1527696273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98a815c170 0x7f98a80cd920 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:47.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.923+0000 7f98ad800640 1 --2- 172.21.15.6:0/1527696273 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98a8159670 0x7f98a80743b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:47.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.923+0000 7f98ad800640 1 -- 172.21.15.6:0/1527696273 >> 172.21.15.6:0/1527696273 conn(0x7f98a80cfa20 msgr2=0x7f98a80cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:47.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.923+0000 7f98ad800640 1 -- 172.21.15.6:0/1527696273 shutdown_connections 2024-09-10T20:56:47.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.923+0000 7f98ad800640 1 -- 172.21.15.6:0/1527696273 wait complete. 2024-09-10T20:56:47.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.924+0000 7f98ad800640 1 Processor -- start 2024-09-10T20:56:47.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.924+0000 7f98ad800640 1 -- start start 2024-09-10T20:56:47.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.925+0000 7f98ad800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98a806fd40 0x7f98a8157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:47.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.926+0000 7f98ad800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98a8159670 0x7f98a80adaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:47.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.926+0000 7f98ad800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98a815c170 0x7f98a81f8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:47.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.926+0000 7f98ad800640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f98a80b4ca0 con 0x7f98a8159670 2024-09-10T20:56:47.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.926+0000 7f98ad800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f98a80b4b20 con 0x7f98a815c170 2024-09-10T20:56:47.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.926+0000 7f98ad800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f98a80b4e20 con 0x7f98a806fd40 2024-09-10T20:56:47.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.926+0000 7f98a6000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98a8159670 0x7f98a80adaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:47.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.926+0000 7f98a6000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98a8159670 0x7f98a80adaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53264/0 (socket says 172.21.15.6:53264) 2024-09-10T20:56:47.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.926+0000 7f98a6000640 1 -- 172.21.15.6:0/4290332885 learned_addr learned my addr 172.21.15.6:0/4290332885 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:47.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.926+0000 7f98a6a00640 1 --2- 172.21.15.6:0/4290332885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98a806fd40 0x7f98a8157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:47.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.926+0000 7f98a7400640 1 --2- 172.21.15.6:0/4290332885 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98a815c170 0x7f98a81f8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:47.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.926+0000 7f98a6000640 1 -- 172.21.15.6:0/4290332885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98a806fd40 msgr2=0x7f98a8157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:47.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.926+0000 7f98a6000640 1 --2- 172.21.15.6:0/4290332885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98a806fd40 0x7f98a8157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:47.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.926+0000 7f98a6000640 1 -- 172.21.15.6:0/4290332885 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98a815c170 msgr2=0x7f98a81f8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:47.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.926+0000 7f98a6000640 1 --2- 172.21.15.6:0/4290332885 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98a815c170 0x7f98a81f8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:47.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.926+0000 7f98a6000640 1 -- 172.21.15.6:0/4290332885 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98a81f54a0 con 0x7f98a8159670 2024-09-10T20:56:47.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.926+0000 7f98a7400640 1 --2- 172.21.15.6:0/4290332885 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98a815c170 0x7f98a81f8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:56:47.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.927+0000 7f98a6000640 1 --2- 172.21.15.6:0/4290332885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98a8159670 0x7f98a80adaf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9894009850 tx=0x7f98940039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:47.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.927+0000 7f989ea00640 1 -- 172.21.15.6:0/4290332885 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f989403f070 con 0x7f98a8159670 2024-09-10T20:56:47.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.927+0000 7f989ea00640 1 -- 172.21.15.6:0/4290332885 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9894004890 con 0x7f98a8159670 2024-09-10T20:56:47.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.927+0000 7f98ad800640 1 -- 172.21.15.6:0/4290332885 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98a81f9550 con 0x7f98a8159670 2024-09-10T20:56:47.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.927+0000 7f989ea00640 1 -- 172.21.15.6:0/4290332885 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9894035030 con 0x7f98a8159670 2024-09-10T20:56:47.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.927+0000 7f98ad800640 1 -- 172.21.15.6:0/4290332885 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98a81574f0 con 0x7f98a8159670 2024-09-10T20:56:47.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.928+0000 7f98ad800640 1 -- 172.21.15.6:0/4290332885 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98a80b5340 con 0x7f98a8159670 2024-09-10T20:56:47.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.929+0000 7f989ea00640 1 -- 172.21.15.6:0/4290332885 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f9894004c60 con 0x7f98a8159670 2024-09-10T20:56:47.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.930+0000 7f989ea00640 1 --2- 172.21.15.6:0/4290332885 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f9888077f70 0x7f988807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:47.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.930+0000 7f989ea00640 1 -- 172.21.15.6:0/4290332885 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f98940bb050 con 0x7f98a8159670 2024-09-10T20:56:47.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.931+0000 7f98a6a00640 1 --2- 172.21.15.6:0/4290332885 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f9888077f70 0x7f988807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:47.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.931+0000 7f98a6a00640 1 --2- 172.21.15.6:0/4290332885 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f9888077f70 0x7f988807a430 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f989800abe0 tx=0x7f989800a2d0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:47.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:47.934+0000 7f989ea00640 1 -- 172.21.15.6:0/4290332885 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f9894083ab0 con 0x7f98a8159670 2024-09-10T20:56:48.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.201+0000 7f98ad800640 1 -- 172.21.15.6:0/4290332885 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f98a8069d20 con 0x7f98a8159670 2024-09-10T20:56:48.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.203+0000 7f989ea00640 1 -- 172.21.15.6:0/4290332885 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7f98940833b0 con 0x7f98a8159670 2024-09-10T20:56:48.207 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2024-09-10T20:56:48.207 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQASsuBmdMMgEBAAKC0NFMDWd/XK9Za4e+RV8g== 2024-09-10T20:56:48.207 INFO:teuthology.orchestra.run.smithi006.stdout: caps mds = "allow" 2024-09-10T20:56:48.208 INFO:teuthology.orchestra.run.smithi006.stdout: caps mon = "allow r" 2024-09-10T20:56:48.208 INFO:teuthology.orchestra.run.smithi006.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T20:56:48.208 INFO:teuthology.orchestra.run.smithi006.stderr:updated caps for client.0 2024-09-10T20:56:48.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.206+0000 7f98ad800640 1 -- 172.21.15.6:0/4290332885 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f9888077f70 msgr2=0x7f988807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:48.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.206+0000 7f98ad800640 1 --2- 172.21.15.6:0/4290332885 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f9888077f70 0x7f988807a430 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f989800abe0 tx=0x7f989800a2d0 comp rx=0 tx=0).stop 2024-09-10T20:56:48.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.206+0000 7f98ad800640 1 -- 172.21.15.6:0/4290332885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98a8159670 msgr2=0x7f98a80adaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:48.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.206+0000 7f98ad800640 1 --2- 172.21.15.6:0/4290332885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98a8159670 0x7f98a80adaf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9894009850 tx=0x7f98940039e0 comp rx=0 tx=0).stop 2024-09-10T20:56:48.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.206+0000 7f98ad800640 1 -- 172.21.15.6:0/4290332885 shutdown_connections 2024-09-10T20:56:48.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.206+0000 7f98ad800640 1 --2- 172.21.15.6:0/4290332885 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f9888077f70 0x7f988807a430 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:48.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.206+0000 7f98ad800640 1 --2- 172.21.15.6:0/4290332885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98a8159670 0x7f98a80adaf0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:48.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.206+0000 7f98ad800640 1 --2- 172.21.15.6:0/4290332885 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98a815c170 0x7f98a81f8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:48.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.206+0000 7f98ad800640 1 --2- 172.21.15.6:0/4290332885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98a806fd40 0x7f98a8157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:48.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.206+0000 7f98ad800640 1 -- 172.21.15.6:0/4290332885 >> 172.21.15.6:0/4290332885 conn(0x7f98a80cfa20 msgr2=0x7f98a8074100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:48.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.206+0000 7f98ad800640 1 -- 172.21.15.6:0/4290332885 shutdown_connections 2024-09-10T20:56:48.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.206+0000 7f98ad800640 1 -- 172.21.15.6:0/4290332885 wait complete. 2024-09-10T20:56:48.228 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:56:48.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.385+0000 7f3c83200640 1 -- 172.21.15.6:0/75300694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c7c159670 msgr2=0x7f3c7c0743b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:48.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.385+0000 7f3c83200640 1 --2- 172.21.15.6:0/75300694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c7c159670 0x7f3c7c0743b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c051860 tx=0x7f3c6c02a4a0 comp rx=0 tx=0).stop 2024-09-10T20:56:48.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.385+0000 7f3c83200640 1 -- 172.21.15.6:0/75300694 shutdown_connections 2024-09-10T20:56:48.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.385+0000 7f3c83200640 1 --2- 172.21.15.6:0/75300694 >> v2:172.21.15.150:3300/0 conn(0x7f3c7c15c170 0x7f3c7c0cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:48.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.385+0000 7f3c83200640 1 --2- 172.21.15.6:0/75300694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c7c159670 0x7f3c7c0743b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:48.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.385+0000 7f3c83200640 1 -- 172.21.15.6:0/75300694 >> 172.21.15.6:0/75300694 conn(0x7f3c7c0cfa20 msgr2=0x7f3c7c0cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:48.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.385+0000 7f3c83200640 1 -- 172.21.15.6:0/75300694 shutdown_connections 2024-09-10T20:56:48.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.385+0000 7f3c83200640 1 -- 172.21.15.6:0/75300694 wait complete. 2024-09-10T20:56:48.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.387+0000 7f3c83200640 1 Processor -- start 2024-09-10T20:56:48.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.387+0000 7f3c83200640 1 -- start start 2024-09-10T20:56:48.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.388+0000 7f3c83200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c7c06fd40 0x7f3c7c150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:48.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.388+0000 7f3c83200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c7c159670 0x7f3c7c0c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:48.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.388+0000 7f3c83200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c7c15c170 0x7f3c7c0cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:48.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.388+0000 7f3c83200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3c7c0b4a90 con 0x7f3c7c06fd40 2024-09-10T20:56:48.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.388+0000 7f3c83200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3c7c0b4910 con 0x7f3c7c15c170 2024-09-10T20:56:48.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.388+0000 7f3c83200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3c7c0b4c10 con 0x7f3c7c159670 2024-09-10T20:56:48.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.388+0000 7f3c7be00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c7c06fd40 0x7f3c7c150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:48.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.388+0000 7f3c7be00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c7c06fd40 0x7f3c7c150fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53286/0 (socket says 172.21.15.6:53286) 2024-09-10T20:56:48.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.388+0000 7f3c7be00640 1 -- 172.21.15.6:0/3847485435 learned_addr learned my addr 172.21.15.6:0/3847485435 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:48.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.388+0000 7f3c81200640 1 --2- 172.21.15.6:0/3847485435 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c7c15c170 0x7f3c7c0cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:48.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.388+0000 7f3c7b400640 1 --2- 172.21.15.6:0/3847485435 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c7c159670 0x7f3c7c0c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:48.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.388+0000 7f3c7be00640 1 -- 172.21.15.6:0/3847485435 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c7c159670 msgr2=0x7f3c7c0c6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:48.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.388+0000 7f3c7be00640 1 --2- 172.21.15.6:0/3847485435 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c7c159670 0x7f3c7c0c6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:48.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.389+0000 7f3c7be00640 1 -- 172.21.15.6:0/3847485435 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c7c15c170 msgr2=0x7f3c7c0cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:48.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.389+0000 7f3c7be00640 1 --2- 172.21.15.6:0/3847485435 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c7c15c170 0x7f3c7c0cabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:48.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.389+0000 7f3c7be00640 1 -- 172.21.15.6:0/3847485435 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c7c0cbd30 con 0x7f3c7c06fd40 2024-09-10T20:56:48.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.389+0000 7f3c81200640 1 --2- 172.21.15.6:0/3847485435 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c7c15c170 0x7f3c7c0cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:56:48.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.389+0000 7f3c7be00640 1 --2- 172.21.15.6:0/3847485435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c7c06fd40 0x7f3c7c150fd0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c009850 tx=0x7f3c6c0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:48.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.389+0000 7f3c73e00640 1 -- 172.21.15.6:0/3847485435 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c03f070 con 0x7f3c7c06fd40 2024-09-10T20:56:48.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.389+0000 7f3c73e00640 1 -- 172.21.15.6:0/3847485435 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3c6c004890 con 0x7f3c7c06fd40 2024-09-10T20:56:48.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.389+0000 7f3c73e00640 1 -- 172.21.15.6:0/3847485435 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c035030 con 0x7f3c7c06fd40 2024-09-10T20:56:48.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.389+0000 7f3c83200640 1 -- 172.21.15.6:0/3847485435 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c7c0cc010 con 0x7f3c7c06fd40 2024-09-10T20:56:48.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.389+0000 7f3c83200640 1 -- 172.21.15.6:0/3847485435 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c7c0ca3f0 con 0x7f3c7c06fd40 2024-09-10T20:56:48.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.390+0000 7f3c83200640 1 -- 172.21.15.6:0/3847485435 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c7c0b50e0 con 0x7f3c7c06fd40 2024-09-10T20:56:48.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.392+0000 7f3c73e00640 1 -- 172.21.15.6:0/3847485435 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3c6c004ca0 con 0x7f3c7c06fd40 2024-09-10T20:56:48.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.392+0000 7f3c73e00640 1 --2- 172.21.15.6:0/3847485435 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3c5c077f70 0x7f3c5c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:48.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.393+0000 7f3c73e00640 1 -- 172.21.15.6:0/3847485435 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f3c6c0bb110 con 0x7f3c7c06fd40 2024-09-10T20:56:48.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.393+0000 7f3c7b400640 1 --2- 172.21.15.6:0/3847485435 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3c5c077f70 0x7f3c5c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:48.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.394+0000 7f3c7b400640 1 --2- 172.21.15.6:0/3847485435 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3c5c077f70 0x7f3c5c07a430 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3c68005e10 tx=0x7f3c68005da0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:48.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.397+0000 7f3c73e00640 1 -- 172.21.15.6:0/3847485435 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f3c6c083ae0 con 0x7f3c7c06fd40 2024-09-10T20:56:48.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.625+0000 7f3c83200640 1 -- 172.21.15.6:0/3847485435 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3c7c069d20 con 0x7f3c7c06fd40 2024-09-10T20:56:48.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.625+0000 7f3c73e00640 1 -- 172.21.15.6:0/3847485435 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5220 (secure 0 0 0) 0x7f3c6c0833e0 con 0x7f3c7c06fd40 2024-09-10T20:56:48.629 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:56:48.629 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":17,"btime":"2024-09-10T20:56:41:162013+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1675451102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1675451102},{"type":"v1","addr":"172.21.15.6:6834","nonce":1675451102}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4924,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/676153174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":676153174},{"type":"v1","addr":"172.21.15.150:6836","nonce":676153174}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4950,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4072260905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":4072260905},{"type":"v1","addr":"172.21.15.150:6837","nonce":4072260905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:56:37.566072+0000","modified":"2024-09-10T20:56:40.597848+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4956":{"gid":4956,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/1598644433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1598644433},{"type":"v1","addr":"172.21.15.6:6835","nonce":1598644433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4956,"qdb_cluster":[4956]},"id":2}]} 2024-09-10T20:56:48.630 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 17 2024-09-10T20:56:48.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.628+0000 7f3c83200640 1 -- 172.21.15.6:0/3847485435 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3c5c077f70 msgr2=0x7f3c5c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:48.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.628+0000 7f3c83200640 1 --2- 172.21.15.6:0/3847485435 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3c5c077f70 0x7f3c5c07a430 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3c68005e10 tx=0x7f3c68005da0 comp rx=0 tx=0).stop 2024-09-10T20:56:48.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.628+0000 7f3c83200640 1 -- 172.21.15.6:0/3847485435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c7c06fd40 msgr2=0x7f3c7c150fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:48.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.628+0000 7f3c83200640 1 --2- 172.21.15.6:0/3847485435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c7c06fd40 0x7f3c7c150fd0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c009850 tx=0x7f3c6c0039e0 comp rx=0 tx=0).stop 2024-09-10T20:56:48.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.628+0000 7f3c83200640 1 -- 172.21.15.6:0/3847485435 shutdown_connections 2024-09-10T20:56:48.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.628+0000 7f3c83200640 1 --2- 172.21.15.6:0/3847485435 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3c5c077f70 0x7f3c5c07a430 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:48.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.628+0000 7f3c83200640 1 --2- 172.21.15.6:0/3847485435 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c7c15c170 0x7f3c7c0cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:48.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.628+0000 7f3c83200640 1 --2- 172.21.15.6:0/3847485435 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c7c159670 0x7f3c7c0c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:48.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.628+0000 7f3c83200640 1 --2- 172.21.15.6:0/3847485435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c7c06fd40 0x7f3c7c150fd0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:48.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.628+0000 7f3c83200640 1 -- 172.21.15.6:0/3847485435 >> 172.21.15.6:0/3847485435 conn(0x7f3c7c0cfa20 msgr2=0x7f3c7c073430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:48.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.628+0000 7f3c83200640 1 -- 172.21.15.6:0/3847485435 shutdown_connections 2024-09-10T20:56:48.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:48.628+0000 7f3c83200640 1 -- 172.21.15.6:0/3847485435 wait complete. 2024-09-10T20:56:49.050 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T20:56:37.566072+0000', 'modified': '2024-09-10T20:56:40.597848+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4956}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4956': {'gid': 4956, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6835/1598644433', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6833', 'nonce': 1598644433}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 1598644433}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4956, 'qdb_cluster': [4956]} 2024-09-10T20:56:49.051 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T20:56:49.051 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-10T20:56:49.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.213+0000 7fd80c800640 1 -- 172.21.15.6:0/1261933774 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd804159670 msgr2=0x7fd8040743b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:49.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.213+0000 7fd80c800640 1 --2- 172.21.15.6:0/1261933774 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd804159670 0x7fd8040743b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8005fd0 tx=0x7fd7f802a540 comp rx=0 tx=0).stop 2024-09-10T20:56:49.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.213+0000 7fd80c800640 1 -- 172.21.15.6:0/1261933774 shutdown_connections 2024-09-10T20:56:49.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.213+0000 7fd80c800640 1 --2- 172.21.15.6:0/1261933774 >> v2:172.21.15.150:3300/0 conn(0x7fd804070450 0x7fd8040cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:49.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.213+0000 7fd80c800640 1 --2- 172.21.15.6:0/1261933774 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd804159670 0x7fd8040743b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:49.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.213+0000 7fd80c800640 1 -- 172.21.15.6:0/1261933774 >> 172.21.15.6:0/1261933774 conn(0x7fd8040cfa20 msgr2=0x7fd8040cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:49.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.213+0000 7fd80c800640 1 -- 172.21.15.6:0/1261933774 shutdown_connections 2024-09-10T20:56:49.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.213+0000 7fd80c800640 1 -- 172.21.15.6:0/1261933774 wait complete. 2024-09-10T20:56:49.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.215+0000 7fd80c800640 1 Processor -- start 2024-09-10T20:56:49.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.215+0000 7fd80c800640 1 -- start start 2024-09-10T20:56:49.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.216+0000 7fd80c800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd804070450 0x7fd804156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:49.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.216+0000 7fd80c800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd804159670 0x7fd8041f6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:49.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.216+0000 7fd80c800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd80415c170 0x7fd80415e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:49.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.216+0000 7fd80c800640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd8040b4ca0 con 0x7fd804070450 2024-09-10T20:56:49.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.216+0000 7fd80c800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd8040b4b20 con 0x7fd80415c170 2024-09-10T20:56:49.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.216+0000 7fd80c800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd8040b4e20 con 0x7fd804159670 2024-09-10T20:56:49.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.216+0000 7fd809e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd804070450 0x7fd804156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:49.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.216+0000 7fd809e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd804070450 0x7fd804156020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53298/0 (socket says 172.21.15.6:53298) 2024-09-10T20:56:49.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.216+0000 7fd809e00640 1 -- 172.21.15.6:0/3393895404 learned_addr learned my addr 172.21.15.6:0/3393895404 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:49.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.216+0000 7fd809400640 1 --2- 172.21.15.6:0/3393895404 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd804159670 0x7fd8041f6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:49.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.216+0000 7fd80a800640 1 --2- 172.21.15.6:0/3393895404 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd80415c170 0x7fd80415e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:49.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.217+0000 7fd809e00640 1 -- 172.21.15.6:0/3393895404 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd804159670 msgr2=0x7fd8041f6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:49.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.217+0000 7fd809e00640 1 --2- 172.21.15.6:0/3393895404 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd804159670 0x7fd8041f6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:49.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.217+0000 7fd809e00640 1 -- 172.21.15.6:0/3393895404 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd80415c170 msgr2=0x7fd80415e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:49.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.217+0000 7fd809e00640 1 --2- 172.21.15.6:0/3393895404 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd80415c170 0x7fd80415e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:49.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.217+0000 7fd809e00640 1 -- 172.21.15.6:0/3393895404 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8041f6b40 con 0x7fd804070450 2024-09-10T20:56:49.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.217+0000 7fd809e00640 1 --2- 172.21.15.6:0/3393895404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd804070450 0x7fd804156020 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8009850 tx=0x7fd7f80038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:49.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.217+0000 7fd7fe000640 1 -- 172.21.15.6:0/3393895404 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f803f070 con 0x7fd804070450 2024-09-10T20:56:49.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.217+0000 7fd7fe000640 1 -- 172.21.15.6:0/3393895404 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd7f80047a0 con 0x7fd804070450 2024-09-10T20:56:49.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.217+0000 7fd7fe000640 1 -- 172.21.15.6:0/3393895404 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f8035030 con 0x7fd804070450 2024-09-10T20:56:49.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.217+0000 7fd80c800640 1 -- 172.21.15.6:0/3393895404 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8040c4470 con 0x7fd804070450 2024-09-10T20:56:49.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.218+0000 7fd80c800640 1 -- 172.21.15.6:0/3393895404 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8040c6190 con 0x7fd804070450 2024-09-10T20:56:49.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.221+0000 7fd7fe000640 1 -- 172.21.15.6:0/3393895404 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd7f8004b90 con 0x7fd804070450 2024-09-10T20:56:49.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.222+0000 7fd7fe000640 1 --2- 172.21.15.6:0/3393895404 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd7e8077f70 0x7fd7e807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:49.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.222+0000 7fd80f671740 1 Processor -- start 2024-09-10T20:56:49.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.222+0000 7fd7fe000640 1 -- 172.21.15.6:0/3393895404 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fd7f80bad70 con 0x7fd804070450 2024-09-10T20:56:49.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.222+0000 7fd80f671740 1 -- start start 2024-09-10T20:56:49.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.222+0000 7fd809400640 1 --2- 172.21.15.6:0/3393895404 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd7e8077f70 0x7fd7e807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:49.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.223+0000 7fd80f671740 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561d60e3d8b0 0x561d60e3dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:49.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.223+0000 7fd80f671740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d60df8a20 0x561d60e3c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:49.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.223+0000 7fd80f671740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561d60df8fa0 0x561d60e3c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:49.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.223+0000 7fd80f671740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x561d60d7b430 con 0x561d60df8a20 2024-09-10T20:56:49.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.223+0000 7fd80f671740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x561d60d6b5d0 con 0x561d60df8fa0 2024-09-10T20:56:49.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.223+0000 7fd80f671740 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x561d60d5aa00 con 0x561d60e3d8b0 2024-09-10T20:56:49.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.223+0000 7fd809400640 1 --2- 172.21.15.6:0/3393895404 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd7e8077f70 0x7fd7e807a430 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd8040cf4e0 tx=0x7fd7f4009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:49.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.223+0000 7fd809400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d60df8a20 0x561d60e3c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:49.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.223+0000 7fd809e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561d60e3d8b0 0x561d60e3dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:49.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.223+0000 7fd809e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561d60e3d8b0 0x561d60e3dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.6:54424/0 (socket says 172.21.15.6:54424) 2024-09-10T20:56:49.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.223+0000 7fd809e00640 1 -- 172.21.15.6:0/908023458 learned_addr learned my addr 172.21.15.6:0/908023458 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:49.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.223+0000 7fd80a800640 1 --2- 172.21.15.6:0/908023458 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561d60df8fa0 0x561d60e3c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:49.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.224+0000 7fd809400640 1 -- 172.21.15.6:0/908023458 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561d60e3d8b0 msgr2=0x561d60e3dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:49.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.224+0000 7fd809400640 1 --2- 172.21.15.6:0/908023458 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561d60e3d8b0 0x561d60e3dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:49.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.224+0000 7fd809400640 1 -- 172.21.15.6:0/908023458 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561d60df8fa0 msgr2=0x561d60e3c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:49.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.224+0000 7fd809400640 1 --2- 172.21.15.6:0/908023458 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561d60df8fa0 0x561d60e3c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:49.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.224+0000 7fd809400640 1 -- 172.21.15.6:0/908023458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d60d23520 con 0x561d60df8a20 2024-09-10T20:56:49.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.224+0000 7fd809e00640 1 --2- 172.21.15.6:0/908023458 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561d60e3d8b0 0x561d60e3dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:56:49.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.224+0000 7fd809400640 1 --2- 172.21.15.6:0/908023458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d60df8a20 0x561d60e3c390 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd7f40015f0 tx=0x7fd7f4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ec83ffebeb819b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:49.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.224+0000 7fd7f2600640 1 -- 172.21.15.6:0/908023458 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f4025070 con 0x561d60df8a20 2024-09-10T20:56:49.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.224+0000 7fd7f2600640 1 -- 172.21.15.6:0/908023458 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd7f401b050 con 0x561d60df8a20 2024-09-10T20:56:49.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.224+0000 7fd7f2600640 1 -- 172.21.15.6:0/908023458 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f4014de0 con 0x561d60df8a20 2024-09-10T20:56:49.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.225+0000 7fd80f671740 1 -- 172.21.15.6:0/908023458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d60df8a20 msgr2=0x561d60e3c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:49.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.225+0000 7fd80f671740 1 --2- 172.21.15.6:0/908023458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d60df8a20 0x561d60e3c390 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd7f40015f0 tx=0x7fd7f4012000 comp rx=0 tx=0).stop 2024-09-10T20:56:49.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.225+0000 7fd80f671740 1 -- 172.21.15.6:0/908023458 shutdown_connections 2024-09-10T20:56:49.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.225+0000 7fd80f671740 1 --2- 172.21.15.6:0/908023458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d60df8a20 0x561d60e3c390 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:49.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.225+0000 7fd80f671740 1 --2- 172.21.15.6:0/908023458 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561d60df8fa0 0x561d60e3c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:49.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.225+0000 7fd80f671740 1 --2- 172.21.15.6:0/908023458 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561d60e3d8b0 0x561d60e3dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:49.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.225+0000 7fd80f671740 1 -- 172.21.15.6:0/908023458 >> 172.21.15.6:0/908023458 conn(0x561d60df3ff0 msgr2=0x561d60df7a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:49.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.225+0000 7fd80f671740 1 -- 172.21.15.6:0/908023458 shutdown_connections 2024-09-10T20:56:49.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.225+0000 7fd80f671740 1 -- 172.21.15.6:0/908023458 wait complete. 2024-09-10T20:56:49.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.226+0000 7fd80f671740 1 -- start start 2024-09-10T20:56:49.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.226+0000 7fd80f671740 1 Processor -- start 2024-09-10T20:56:49.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.227+0000 7fd80f671740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561d60df8fa0 0x561d60e1e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:49.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.227+0000 7fd80f671740 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561d60e3d8b0 0x561d60e21360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:49.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.227+0000 7fd80f671740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d60e1d800 0x561d60e218a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:49.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.227+0000 7fd80f671740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x561d60d01330 con 0x561d60e1d800 2024-09-10T20:56:49.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.227+0000 7fd80f671740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x561d60d5e810 con 0x561d60df8fa0 2024-09-10T20:56:49.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.227+0000 7fd80f671740 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x561d60acb620 con 0x561d60e3d8b0 2024-09-10T20:56:49.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.227+0000 7fd80f671740 10 client.0 _ll_register_callbacks cb 0x561d60d06420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:56:49.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.227+0000 7fd80a800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d60e1d800 0x561d60e218a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:49.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.227+0000 7fd80a800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d60e1d800 0x561d60e218a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53312/0 (socket says 172.21.15.6:53312) 2024-09-10T20:56:49.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.227+0000 7fd80a800640 1 -- 172.21.15.6:0/2206542560 learned_addr learned my addr 172.21.15.6:0/2206542560 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:49.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.227+0000 7fd809e00640 1 --2- 172.21.15.6:0/2206542560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561d60df8fa0 0x561d60e1e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:49.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.227+0000 7fd809400640 1 --2- 172.21.15.6:0/2206542560 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561d60e3d8b0 0x561d60e21360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:49.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.228+0000 7fd80a800640 1 -- 172.21.15.6:0/2206542560 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561d60e3d8b0 msgr2=0x561d60e21360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:49.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.228+0000 7fd80a800640 1 --2- 172.21.15.6:0/2206542560 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561d60e3d8b0 0x561d60e21360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:49.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.228+0000 7fd80a800640 1 -- 172.21.15.6:0/2206542560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561d60df8fa0 msgr2=0x561d60e1e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:49.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.228+0000 7fd80a800640 1 --2- 172.21.15.6:0/2206542560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561d60df8fa0 0x561d60e1e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:49.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.228+0000 7fd80a800640 1 -- 172.21.15.6:0/2206542560 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d60abc850 con 0x561d60e1d800 2024-09-10T20:56:49.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.228+0000 7fd80a800640 1 --2- 172.21.15.6:0/2206542560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d60e1d800 0x561d60e218a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd800011a10 tx=0x7fd800011e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21f466cbe1407f73 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:49.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.228+0000 7fd7e6a00640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-10T20:56:49.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.228+0000 7fd7e6a00640 1 -- 172.21.15.6:0/2206542560 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd800010a60 con 0x561d60e1d800 2024-09-10T20:56:49.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.228+0000 7fd7e6a00640 1 -- 172.21.15.6:0/2206542560 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fd800010c00 con 0x561d60e1d800 2024-09-10T20:56:49.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.228+0000 7fd80f671740 1 -- 172.21.15.6:0/2206542560 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7f401b050 con 0x561d60e1d800 2024-09-10T20:56:49.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.228+0000 7fd7e6a00640 1 -- 172.21.15.6:0/2206542560 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fd800024050 con 0x561d60e1d800 2024-09-10T20:56:49.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.228+0000 7fd80f671740 10 client.5127 fetch_fsmap learned FSMap version 17 2024-09-10T20:56:49.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.228+0000 7fd80f671740 1 -- 172.21.15.6:0/2206542560 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x561d60b336b0 con 0x561d60e1d800 2024-09-10T20:56:49.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.229+0000 7fd7e6a00640 1 -- 172.21.15.6:0/2206542560 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd7f401b050 con 0x561d60e1d800 2024-09-10T20:56:49.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.229+0000 7fd7e6a00640 1 -- 172.21.15.6:0/2206542560 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 17) ==== 3502+0+0 (secure 0 0 0) 0x7fd800027020 con 0x561d60e1d800 2024-09-10T20:56:49.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.229+0000 7fd80f671740 10 client.5127 fetch_fsmap finished waiting for FSMap version 17 2024-09-10T20:56:49.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.229+0000 7fd80f671740 10 client.5127 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T20:56:49.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.229+0000 7fd80f671740 20 client.5127 populate_metadata read hostname 'smithi006' 2024-09-10T20:56:49.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.229+0000 7fd80f671740 1 --2- 172.21.15.6:0/2206542560 >> [v2:172.21.15.6:6833/1598644433,v1:172.21.15.6:6835/1598644433] conn(0x561d60e36f70 0x561d60e18a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:49.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.229+0000 7fd80f671740 4 client.5127 mds_command: new command op to 4956 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:56:49.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.229+0000 7fd80f671740 1 -- 172.21.15.6:0/2206542560 --> [v2:172.21.15.6:6833/1598644433,v1:172.21.15.6:6835/1598644433] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561d60d6d520 con 0x561d60e36f70 2024-09-10T20:56:49.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.229+0000 7fd809e00640 1 --2- 172.21.15.6:0/2206542560 >> [v2:172.21.15.6:6833/1598644433,v1:172.21.15.6:6835/1598644433] conn(0x561d60e36f70 0x561d60e18a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:49.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.230+0000 7fd809e00640 1 --2- 172.21.15.6:0/2206542560 >> [v2:172.21.15.6:6833/1598644433,v1:172.21.15.6:6835/1598644433] conn(0x561d60e36f70 0x561d60e18a90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b3d5ce566480116 server_cookie=f1c8fe23be29ac8e in_seq=0 out_seq=0 2024-09-10T20:56:49.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.230+0000 7fd7e6a00640 10 client.5127 ms_handle_connect on v2:172.21.15.6:6833/1598644433 2024-09-10T20:56:49.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.230+0000 7fd7e6a00640 1 -- 172.21.15.6:0/2206542560 <== mds.0 v2:172.21.15.6:6833/1598644433 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561d60d6d520 con 0x561d60e36f70 2024-09-10T20:56:49.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.230+0000 7fd7e6a00640 10 client.5127 handle_command_reply: tid=0 2024-09-10T20:56:49.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.231+0000 7fd80f671740 1 client.5127 shutdown 2024-09-10T20:56:49.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.231+0000 7fd80f671740 1 -- 172.21.15.6:0/2206542560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d60e1d800 msgr2=0x561d60e218a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:49.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.231+0000 7fd80f671740 1 --2- 172.21.15.6:0/2206542560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d60e1d800 0x561d60e218a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd800011a10 tx=0x7fd800011e10 comp rx=0 tx=0).stop 2024-09-10T20:56:49.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.231+0000 7fd80f671740 1 -- 172.21.15.6:0/2206542560 shutdown_connections 2024-09-10T20:56:49.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.231+0000 7fd80f671740 1 --2- 172.21.15.6:0/2206542560 >> [v2:172.21.15.6:6833/1598644433,v1:172.21.15.6:6835/1598644433] conn(0x561d60e36f70 0x561d60e18a90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:49.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.231+0000 7fd80f671740 1 --2- 172.21.15.6:0/2206542560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d60e1d800 0x561d60e218a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:49.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.231+0000 7fd80f671740 1 --2- 172.21.15.6:0/2206542560 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561d60e3d8b0 0x561d60e21360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:49.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.231+0000 7fd80f671740 1 --2- 172.21.15.6:0/2206542560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561d60df8fa0 0x561d60e1e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:49.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.231+0000 7fd80f671740 1 -- 172.21.15.6:0/2206542560 >> 172.21.15.6:0/2206542560 conn(0x561d60df8a20 msgr2=0x561d60df2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:49.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.231+0000 7fd7e6a00640 0 client.5127 ms_handle_reset on v2:172.21.15.6:6833/1598644433 2024-09-10T20:56:49.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.231+0000 7fd80f671740 1 -- 172.21.15.6:0/2206542560 shutdown_connections 2024-09-10T20:56:49.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.231+0000 7fd80f671740 1 -- 172.21.15.6:0/2206542560 wait complete. 2024-09-10T20:56:49.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.231+0000 7fd80f671740 20 client.5127 trim_cache size 0 max 16384 2024-09-10T20:56:49.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.251+0000 7fd80f671740 1 Processor -- start 2024-09-10T20:56:49.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.251+0000 7fd80f671740 1 -- start start 2024-09-10T20:56:49.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.252+0000 7fd80f671740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d60df8fa0 0x561d60e1d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:49.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.252+0000 7fd80f671740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561d60e1d800 0x561d60df7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:49.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.252+0000 7fd80f671740 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561d60e3d8b0 0x561d60df2b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:49.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.252+0000 7fd80f671740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd8040cb350 con 0x561d60df8fa0 2024-09-10T20:56:49.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.252+0000 7fd80f671740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd804157990 con 0x561d60e1d800 2024-09-10T20:56:49.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.252+0000 7fd80f671740 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd804157fe0 con 0x561d60e3d8b0 2024-09-10T20:56:49.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.252+0000 7fd809e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d60df8fa0 0x561d60e1d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:49.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.252+0000 7fd809e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d60df8fa0 0x561d60e1d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53322/0 (socket says 172.21.15.6:53322) 2024-09-10T20:56:49.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.252+0000 7fd809e00640 1 -- 172.21.15.6:0/3547156816 learned_addr learned my addr 172.21.15.6:0/3547156816 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:49.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.252+0000 7fd809400640 1 --2- 172.21.15.6:0/3547156816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561d60e1d800 0x561d60df7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:49.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.252+0000 7fd80a800640 1 --2- 172.21.15.6:0/3547156816 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561d60e3d8b0 0x561d60df2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:49.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.252+0000 7fd809e00640 1 -- 172.21.15.6:0/3547156816 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561d60e3d8b0 msgr2=0x561d60df2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:49.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.252+0000 7fd809e00640 1 --2- 172.21.15.6:0/3547156816 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561d60e3d8b0 0x561d60df2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:49.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.252+0000 7fd809e00640 1 -- 172.21.15.6:0/3547156816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561d60e1d800 msgr2=0x561d60df7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:49.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.252+0000 7fd809e00640 1 --2- 172.21.15.6:0/3547156816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561d60e1d800 0x561d60df7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:49.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.252+0000 7fd809e00640 1 -- 172.21.15.6:0/3547156816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d60e16b00 con 0x561d60df8fa0 2024-09-10T20:56:49.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.253+0000 7fd809e00640 1 --2- 172.21.15.6:0/3547156816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d60df8fa0 0x561d60e1d290 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd7f802ab30 tx=0x7fd7f808a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=237b74c2ee6fef6a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:49.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.253+0000 7fd7f1c00640 1 -- 172.21.15.6:0/3547156816 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f8049040 con 0x561d60df8fa0 2024-09-10T20:56:49.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.253+0000 7fd7f1c00640 1 -- 172.21.15.6:0/3547156816 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd7f8083210 con 0x561d60df8fa0 2024-09-10T20:56:49.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.253+0000 7fd7f1c00640 1 -- 172.21.15.6:0/3547156816 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f8087c40 con 0x561d60df8fa0 2024-09-10T20:56:49.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.254+0000 7fd80f671740 1 -- 172.21.15.6:0/3547156816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d60df8fa0 msgr2=0x561d60e1d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:49.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.254+0000 7fd80f671740 1 --2- 172.21.15.6:0/3547156816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d60df8fa0 0x561d60e1d290 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd7f802ab30 tx=0x7fd7f808a040 comp rx=0 tx=0).stop 2024-09-10T20:56:49.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.254+0000 7fd80f671740 1 -- 172.21.15.6:0/3547156816 shutdown_connections 2024-09-10T20:56:49.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.254+0000 7fd80f671740 1 --2- 172.21.15.6:0/3547156816 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561d60e3d8b0 0x561d60df2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:49.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.254+0000 7fd80f671740 1 --2- 172.21.15.6:0/3547156816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561d60e1d800 0x561d60df7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:49.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.254+0000 7fd80f671740 1 --2- 172.21.15.6:0/3547156816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d60df8fa0 0x561d60e1d290 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:49.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.254+0000 7fd80f671740 1 -- 172.21.15.6:0/3547156816 >> 172.21.15.6:0/3547156816 conn(0x561d60df8a20 msgr2=0x561d60df2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:49.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.254+0000 7fd80f671740 1 -- 172.21.15.6:0/3547156816 shutdown_connections 2024-09-10T20:56:49.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.254+0000 7fd80f671740 1 -- 172.21.15.6:0/3547156816 wait complete. 2024-09-10T20:56:49.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.254+0000 7fd80f671740 1 -- start start 2024-09-10T20:56:49.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.255+0000 7fd80f671740 1 Processor -- start 2024-09-10T20:56:49.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.256+0000 7fd80f671740 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561d60df8fa0 0x561d60ec1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:49.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.256+0000 7fd80f671740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d60e1d800 0x561d60ec5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:49.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.256+0000 7fd80f671740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561d60e3d8b0 0x561d60df2b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:49.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.256+0000 7fd80f671740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x561d60e36df0 con 0x561d60e1d800 2024-09-10T20:56:49.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.256+0000 7fd80f671740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x561d60e194b0 con 0x561d60e3d8b0 2024-09-10T20:56:49.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.256+0000 7fd80f671740 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x561d60e37440 con 0x561d60df8fa0 2024-09-10T20:56:49.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.256+0000 7fd80f671740 10 client.0 _ll_register_callbacks cb 0x7fd800011610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:56:49.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.256+0000 7fd809400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d60e1d800 0x561d60ec5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:49.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.256+0000 7fd809400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d60e1d800 0x561d60ec5780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53330/0 (socket says 172.21.15.6:53330) 2024-09-10T20:56:49.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.256+0000 7fd809400640 1 -- 172.21.15.6:0/148874164 learned_addr learned my addr 172.21.15.6:0/148874164 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:49.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.256+0000 7fd809e00640 1 --2- 172.21.15.6:0/148874164 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561d60df8fa0 0x561d60ec1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:49.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.256+0000 7fd80a800640 1 --2- 172.21.15.6:0/148874164 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561d60e3d8b0 0x561d60df2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:49.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.256+0000 7fd809400640 1 -- 172.21.15.6:0/148874164 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561d60df8fa0 msgr2=0x561d60ec1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:49.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.256+0000 7fd809400640 1 --2- 172.21.15.6:0/148874164 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561d60df8fa0 0x561d60ec1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:49.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.256+0000 7fd809400640 1 -- 172.21.15.6:0/148874164 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561d60e3d8b0 msgr2=0x561d60df2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:49.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.256+0000 7fd809400640 1 --2- 172.21.15.6:0/148874164 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561d60e3d8b0 0x561d60df2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:49.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.256+0000 7fd809400640 1 -- 172.21.15.6:0/148874164 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d60e35df0 con 0x561d60e1d800 2024-09-10T20:56:49.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.257+0000 7fd809400640 1 --2- 172.21.15.6:0/148874164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d60e1d800 0x561d60ec5780 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4014820 tx=0x7fd7f400f620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b019218fc3859c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:49.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.257+0000 7fd7e6a00640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-09-10T20:56:49.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.257+0000 7fd7e6a00640 1 -- 172.21.15.6:0/148874164 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f4030060 con 0x561d60e1d800 2024-09-10T20:56:49.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.257+0000 7fd7e6a00640 1 -- 172.21.15.6:0/148874164 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fd7f4020820 con 0x561d60e1d800 2024-09-10T20:56:49.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.257+0000 7fd80f671740 1 -- 172.21.15.6:0/148874164 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7f8083210 con 0x561d60e1d800 2024-09-10T20:56:49.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.257+0000 7fd7e6a00640 1 -- 172.21.15.6:0/148874164 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fd7f4025040 con 0x561d60e1d800 2024-09-10T20:56:49.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.257+0000 7fd80f671740 10 client.5133 fetch_fsmap learned FSMap version 17 2024-09-10T20:56:49.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.257+0000 7fd80f671740 1 -- 172.21.15.6:0/148874164 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x561d60e40160 con 0x561d60e1d800 2024-09-10T20:56:49.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.257+0000 7fd7e6a00640 1 -- 172.21.15.6:0/148874164 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd7f8083210 con 0x561d60e1d800 2024-09-10T20:56:49.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.258+0000 7fd7e6a00640 1 -- 172.21.15.6:0/148874164 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 17) ==== 3502+0+0 (secure 0 0 0) 0x7fd7f4020a20 con 0x561d60e1d800 2024-09-10T20:56:49.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.258+0000 7fd80f671740 10 client.5133 fetch_fsmap finished waiting for FSMap version 17 2024-09-10T20:56:49.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.258+0000 7fd80f671740 10 client.5133 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T20:56:49.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.258+0000 7fd80f671740 20 client.5133 populate_metadata read hostname 'smithi006' 2024-09-10T20:56:49.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.258+0000 7fd80f671740 1 --2- 172.21.15.6:0/148874164 >> [v2:172.21.15.6:6833/1598644433,v1:172.21.15.6:6835/1598644433] conn(0x561d60df3110 0x561d60df59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:49.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.258+0000 7fd80f671740 4 client.5133 mds_command: new command op to 4956 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T20:56:49.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.258+0000 7fd80f671740 1 -- 172.21.15.6:0/148874164 --> [v2:172.21.15.6:6833/1598644433,v1:172.21.15.6:6835/1598644433] -- command(tid 0: {"prefix": "status"}) -- 0x561d60d68fd0 con 0x561d60df3110 2024-09-10T20:56:49.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.258+0000 7fd809e00640 1 --2- 172.21.15.6:0/148874164 >> [v2:172.21.15.6:6833/1598644433,v1:172.21.15.6:6835/1598644433] conn(0x561d60df3110 0x561d60df59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:49.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.258+0000 7fd809e00640 1 --2- 172.21.15.6:0/148874164 >> [v2:172.21.15.6:6833/1598644433,v1:172.21.15.6:6835/1598644433] conn(0x561d60df3110 0x561d60df59d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=390a9900e95f8ef server_cookie=747f85a5ee4253ba in_seq=0 out_seq=0 2024-09-10T20:56:49.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.258+0000 7fd7e6a00640 10 client.5133 ms_handle_connect on v2:172.21.15.6:6833/1598644433 2024-09-10T20:56:49.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.259+0000 7fd7e6a00640 1 -- 172.21.15.6:0/148874164 <== mds.0 v2:172.21.15.6:6833/1598644433 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x561d60d68fd0 con 0x561d60df3110 2024-09-10T20:56:49.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.259+0000 7fd7e6a00640 10 client.5133 handle_command_reply: tid=0 2024-09-10T20:56:49.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.259+0000 7fd80f671740 1 client.5133 shutdown 2024-09-10T20:56:49.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.259+0000 7fd80f671740 1 -- 172.21.15.6:0/148874164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d60e1d800 msgr2=0x561d60ec5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:49.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.259+0000 7fd80f671740 1 --2- 172.21.15.6:0/148874164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d60e1d800 0x561d60ec5780 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4014820 tx=0x7fd7f400f620 comp rx=0 tx=0).stop 2024-09-10T20:56:49.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.259+0000 7fd80f671740 1 -- 172.21.15.6:0/148874164 shutdown_connections 2024-09-10T20:56:49.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.259+0000 7fd80f671740 1 --2- 172.21.15.6:0/148874164 >> [v2:172.21.15.6:6833/1598644433,v1:172.21.15.6:6835/1598644433] conn(0x561d60df3110 0x561d60df59d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:49.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.259+0000 7fd80f671740 1 --2- 172.21.15.6:0/148874164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d60e1d800 0x561d60ec5780 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:49.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.259+0000 7fd80f671740 1 --2- 172.21.15.6:0/148874164 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561d60e3d8b0 0x561d60df2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:49.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.259+0000 7fd80f671740 1 --2- 172.21.15.6:0/148874164 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561d60df8fa0 0x561d60ec1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:49.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.259+0000 7fd7e6a00640 0 client.5133 ms_handle_reset on v2:172.21.15.6:6833/1598644433 2024-09-10T20:56:49.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.259+0000 7fd80f671740 1 -- 172.21.15.6:0/148874164 >> 172.21.15.6:0/148874164 conn(0x561d60df8a20 msgr2=0x561d60df2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:49.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.259+0000 7fd80f671740 1 -- 172.21.15.6:0/148874164 shutdown_connections 2024-09-10T20:56:49.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.259+0000 7fd80f671740 1 -- 172.21.15.6:0/148874164 wait complete. 2024-09-10T20:56:49.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.259+0000 7fd80f671740 20 client.5133 trim_cache size 0 max 16384 2024-09-10T20:56:49.268 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-10T20:56:49.269 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "9e04309e-61c3-4c78-82db-9576e465d98a", 2024-09-10T20:56:49.269 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2024-09-10T20:56:49.269 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 4956, 2024-09-10T20:56:49.269 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-09-10T20:56:49.269 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-09-10T20:56:49.269 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-09-10T20:56:49.269 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 11.123443283, 2024-09-10T20:56:49.269 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 17, 2024-09-10T20:56:49.269 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 35, 2024-09-10T20:56:49.269 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 35, 2024-09-10T20:56:49.269 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 18.947278091000001 2024-09-10T20:56:49.269 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-10T20:56:49.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.260+0000 7fd80c800640 1 -- 172.21.15.6:0/3393895404 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd7e8077f70 msgr2=0x7fd7e807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:49.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.260+0000 7fd80c800640 1 --2- 172.21.15.6:0/3393895404 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd7e8077f70 0x7fd7e807a430 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd8040cf4e0 tx=0x7fd7f4009040 comp rx=0 tx=0).stop 2024-09-10T20:56:49.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.260+0000 7fd80c800640 1 -- 172.21.15.6:0/3393895404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd804070450 msgr2=0x7fd804156020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:49.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.260+0000 7fd80c800640 1 --2- 172.21.15.6:0/3393895404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd804070450 0x7fd804156020 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8009850 tx=0x7fd7f80038a0 comp rx=0 tx=0).stop 2024-09-10T20:56:49.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.260+0000 7fd80c800640 1 -- 172.21.15.6:0/3393895404 shutdown_connections 2024-09-10T20:56:49.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.260+0000 7fd80c800640 1 --2- 172.21.15.6:0/3393895404 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd7e8077f70 0x7fd7e807a430 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:49.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.260+0000 7fd80c800640 1 --2- 172.21.15.6:0/3393895404 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd80415c170 0x7fd80415e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:49.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.260+0000 7fd80c800640 1 --2- 172.21.15.6:0/3393895404 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd804159670 0x7fd8041f6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:49.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.260+0000 7fd80c800640 1 --2- 172.21.15.6:0/3393895404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd804070450 0x7fd804156020 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:49.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.260+0000 7fd80c800640 1 -- 172.21.15.6:0/3393895404 >> 172.21.15.6:0/3393895404 conn(0x7fd8040cfa20 msgr2=0x7fd804073be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:49.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.260+0000 7fd80c800640 1 -- 172.21.15.6:0/3393895404 shutdown_connections 2024-09-10T20:56:49.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.260+0000 7fd80c800640 1 -- 172.21.15.6:0/3393895404 wait complete. 2024-09-10T20:56:49.280 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T20:56:49.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.435+0000 7f1ab3e00640 1 -- 172.21.15.6:0/4261038434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1aac15c170 msgr2=0x7f1aac0cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:49.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.435+0000 7f1ab3e00640 1 --2- 172.21.15.6:0/4261038434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1aac15c170 0x7f1aac0cd920 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1a98005fd0 tx=0x7f1a9802a540 comp rx=0 tx=0).stop 2024-09-10T20:56:49.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.435+0000 7f1ab3e00640 1 -- 172.21.15.6:0/4261038434 shutdown_connections 2024-09-10T20:56:49.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.435+0000 7f1ab3e00640 1 --2- 172.21.15.6:0/4261038434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1aac15c170 0x7f1aac0cd920 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:49.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.435+0000 7f1ab3e00640 1 --2- 172.21.15.6:0/4261038434 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1aac159670 0x7f1aac0743b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:49.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.435+0000 7f1ab3e00640 1 -- 172.21.15.6:0/4261038434 >> 172.21.15.6:0/4261038434 conn(0x7f1aac0cfa20 msgr2=0x7f1aac0cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:49.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.435+0000 7f1ab3e00640 1 -- 172.21.15.6:0/4261038434 shutdown_connections 2024-09-10T20:56:49.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.435+0000 7f1ab3e00640 1 -- 172.21.15.6:0/4261038434 wait complete. 2024-09-10T20:56:49.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.437+0000 7f1ab3e00640 1 Processor -- start 2024-09-10T20:56:49.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.437+0000 7f1ab3e00640 1 -- start start 2024-09-10T20:56:49.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.438+0000 7f1ab3e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1aac06fd40 0x7f1aac0cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:49.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.438+0000 7f1ab3e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1aac159670 0x7f1aac1f4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:49.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.438+0000 7f1ab3e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1aac15c170 0x7f1aac0c3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:49.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.438+0000 7f1ab3e00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1aac0b4ca0 con 0x7f1aac159670 2024-09-10T20:56:49.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.438+0000 7f1ab3e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f1aac0b4b20 con 0x7f1aac15c170 2024-09-10T20:56:49.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.438+0000 7f1ab3e00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f1aac0b4e20 con 0x7f1aac06fd40 2024-09-10T20:56:49.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.438+0000 7f1ab0a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1aac159670 0x7f1aac1f4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:49.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.438+0000 7f1ab0a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1aac159670 0x7f1aac1f4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53352/0 (socket says 172.21.15.6:53352) 2024-09-10T20:56:49.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.438+0000 7f1ab0a00640 1 -- 172.21.15.6:0/3786329893 learned_addr learned my addr 172.21.15.6:0/3786329893 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:49.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.438+0000 7f1ab1e00640 1 --2- 172.21.15.6:0/3786329893 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1aac15c170 0x7f1aac0c3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:49.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.438+0000 7f1ab1400640 1 --2- 172.21.15.6:0/3786329893 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1aac06fd40 0x7f1aac0cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:49.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.438+0000 7f1ab0a00640 1 -- 172.21.15.6:0/3786329893 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1aac06fd40 msgr2=0x7f1aac0cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:49.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.438+0000 7f1ab0a00640 1 --2- 172.21.15.6:0/3786329893 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1aac06fd40 0x7f1aac0cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:49.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.438+0000 7f1ab0a00640 1 -- 172.21.15.6:0/3786329893 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1aac15c170 msgr2=0x7f1aac0c3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:49.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.438+0000 7f1ab0a00640 1 --2- 172.21.15.6:0/3786329893 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1aac15c170 0x7f1aac0c3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:49.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.438+0000 7f1ab0a00640 1 -- 172.21.15.6:0/3786329893 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aac1f50b0 con 0x7f1aac159670 2024-09-10T20:56:49.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.439+0000 7f1ab0a00640 1 --2- 172.21.15.6:0/3786329893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1aac159670 0x7f1aac1f4b70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1a98009850 tx=0x7f1a980038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:49.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.439+0000 7f1aa9600640 1 -- 172.21.15.6:0/3786329893 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9803f070 con 0x7f1aac159670 2024-09-10T20:56:49.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.439+0000 7f1aa9600640 1 -- 172.21.15.6:0/3786329893 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1a980047a0 con 0x7f1aac159670 2024-09-10T20:56:49.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.439+0000 7f1aa9600640 1 -- 172.21.15.6:0/3786329893 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a98035030 con 0x7f1aac159670 2024-09-10T20:56:49.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.439+0000 7f1ab3e00640 1 -- 172.21.15.6:0/3786329893 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1aac1f5330 con 0x7f1aac159670 2024-09-10T20:56:49.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.439+0000 7f1ab3e00640 1 -- 172.21.15.6:0/3786329893 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1aac1f58f0 con 0x7f1aac159670 2024-09-10T20:56:49.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.440+0000 7f1ab3e00640 1 -- 172.21.15.6:0/3786329893 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1aac0b5340 con 0x7f1aac159670 2024-09-10T20:56:49.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.441+0000 7f1aa9600640 1 -- 172.21.15.6:0/3786329893 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f1a98004b90 con 0x7f1aac159670 2024-09-10T20:56:49.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.442+0000 7f1aa9600640 1 --2- 172.21.15.6:0/3786329893 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f1a8c077fa0 0x7f1a8c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:49.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.442+0000 7f1aa9600640 1 -- 172.21.15.6:0/3786329893 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f1a980bae20 con 0x7f1aac159670 2024-09-10T20:56:49.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.443+0000 7f1ab1400640 1 --2- 172.21.15.6:0/3786329893 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f1a8c077fa0 0x7f1a8c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:49.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.443+0000 7f1ab1400640 1 --2- 172.21.15.6:0/3786329893 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f1a8c077fa0 0x7f1a8c07a460 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0009bd0 tx=0x7f1aa0005f90 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:49.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.447+0000 7f1aa9600640 1 -- 172.21.15.6:0/3786329893 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f1aac1f50b0 con 0x7f1aac159670 2024-09-10T20:56:49.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.676+0000 7f1ab3e00640 1 -- 172.21.15.6:0/3786329893 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f1aac069d20 con 0x7f1aac159670 2024-09-10T20:56:49.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.676+0000 7f1aa9600640 1 -- 172.21.15.6:0/3786329893 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7f1a980832c0 con 0x7f1aac159670 2024-09-10T20:56:49.681 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T20:56:49.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.679+0000 7f1ab3e00640 1 -- 172.21.15.6:0/3786329893 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f1a8c077fa0 msgr2=0x7f1a8c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:49.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.679+0000 7f1ab3e00640 1 --2- 172.21.15.6:0/3786329893 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f1a8c077fa0 0x7f1a8c07a460 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0009bd0 tx=0x7f1aa0005f90 comp rx=0 tx=0).stop 2024-09-10T20:56:49.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.679+0000 7f1ab3e00640 1 -- 172.21.15.6:0/3786329893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1aac159670 msgr2=0x7f1aac1f4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:49.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.679+0000 7f1ab3e00640 1 --2- 172.21.15.6:0/3786329893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1aac159670 0x7f1aac1f4b70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1a98009850 tx=0x7f1a980038a0 comp rx=0 tx=0).stop 2024-09-10T20:56:49.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.679+0000 7f1ab3e00640 1 -- 172.21.15.6:0/3786329893 shutdown_connections 2024-09-10T20:56:49.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.679+0000 7f1ab3e00640 1 --2- 172.21.15.6:0/3786329893 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f1a8c077fa0 0x7f1a8c07a460 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:49.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.679+0000 7f1ab3e00640 1 --2- 172.21.15.6:0/3786329893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1aac159670 0x7f1aac1f4b70 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:49.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.679+0000 7f1ab3e00640 1 --2- 172.21.15.6:0/3786329893 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1aac15c170 0x7f1aac0c3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:49.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.679+0000 7f1ab3e00640 1 --2- 172.21.15.6:0/3786329893 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1aac06fd40 0x7f1aac0cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:49.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.679+0000 7f1ab3e00640 1 -- 172.21.15.6:0/3786329893 >> 172.21.15.6:0/3786329893 conn(0x7f1aac0cfa20 msgr2=0x7f1aac072c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:49.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.679+0000 7f1ab3e00640 1 -- 172.21.15.6:0/3786329893 shutdown_connections 2024-09-10T20:56:49.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49.679+0000 7f1ab3e00640 1 -- 172.21.15.6:0/3786329893 wait complete. 2024-09-10T20:56:49.700 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T20:56:49.700 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T20:56:49.700 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2024-09-10T20:56:49.700 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T20:56:49.700 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T20:56:49.700 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T20:56:49.700 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T20:56:49.700 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T20:56:49.700 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T20:56:49.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:49.701 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2024-09-10T20:56:49.736 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T20:56:49.737 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T20:56:49.737 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T20:56:49.737 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:56:49.737 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2024-09-10T20:56:49.737 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:56:49.737 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T20:56:49.737 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:56:49.737 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2024-09-10T20:56:49.737 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T20:56:49.737 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:56:49.737 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2024-09-10T20:56:49.737 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T20:56:49.737 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:56:49.738 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2024-09-10T20:56:49.738 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-10T20:56:49.738 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42616sec preferred_lft 42616sec 2024-09-10T20:56:49.738 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2024-09-10T20:56:49.738 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:56:49.738 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T20:56:49.738 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:56:49.738 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2024-09-10T20:56:49.738 INFO:teuthology.orchestra.run.smithi006.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T20:56:49.738 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 42:19:f6:0f:32:a7 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:56:49.738 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T20:56:49.738 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:56:49.738 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::4c7f:9eff:fe7f:c27e/64 scope link 2024-09-10T20:56:49.738 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:56:49.739 INFO:teuthology.orchestra.run.smithi006.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T20:56:49.739 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 42:19:f6:0f:32:a7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T20:56:49.739 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::4019:f6ff:fe0f:32a7/64 scope link 2024-09-10T20:56:49.739 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:56:49.739 INFO:teuthology.orchestra.run.smithi006.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T20:56:49.739 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 4a:16:f8:1a:32:88 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T20:56:49.739 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::4816:f8ff:fe1a:3288/64 scope link 2024-09-10T20:56:49.739 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:56:49.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:49.739 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T20:56:49.830 INFO:teuthology.orchestra.run.smithi006.stdout:1 2024-09-10T20:56:49.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:49.833 DEBUG:teuthology.orchestra.run.smithi006:> route 2024-09-10T20:56:49.870 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2024-09-10T20:56:49.870 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T20:56:49.870 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-10T20:56:49.870 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-10T20:56:49.870 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T20:56:49.870 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:56:49.870 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-09-10T20:56:49.871 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T20:56:49.871 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T20:56:49.871 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T20:56:49.871 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-09-10T20:56:49.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:56:50.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:56:50.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:50.067 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-09-10T20:56:50.102 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T20:56:50.102 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T20:56:50.102 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T20:56:50.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:50.103 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2024-09-10T20:56:50.199 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-10T20:56:50.199 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T20:56:50.199 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T20:56:50.235 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T20:56:50.235 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T20:56:50.235 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T20:56:50.310 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2024-09-10T20:56:50.406 DEBUG:teuthology.orchestra.run.smithi006:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T20:56:50.442 INFO:teuthology.orchestra.run.smithi006.stdout:/proc 2024-09-10T20:56:50.442 INFO:teuthology.orchestra.run.smithi006.stdout:/sys 2024-09-10T20:56:50.442 INFO:teuthology.orchestra.run.smithi006.stdout:/dev 2024-09-10T20:56:50.443 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/security 2024-09-10T20:56:50.443 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/shm 2024-09-10T20:56:50.443 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/pts 2024-09-10T20:56:50.443 INFO:teuthology.orchestra.run.smithi006.stdout:/run 2024-09-10T20:56:50.443 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/cgroup 2024-09-10T20:56:50.443 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/pstore 2024-09-10T20:56:50.443 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/bpf 2024-09-10T20:56:50.443 INFO:teuthology.orchestra.run.smithi006.stdout:/ 2024-09-10T20:56:50.443 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/selinux 2024-09-10T20:56:50.443 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T20:56:50.443 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/mqueue 2024-09-10T20:56:50.443 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/hugepages 2024-09-10T20:56:50.443 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/debug 2024-09-10T20:56:50.443 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/tracing 2024-09-10T20:56:50.444 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/fuse/connections 2024-09-10T20:56:50.444 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/config 2024-09-10T20:56:50.444 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T20:56:50.444 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T20:56:50.444 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T20:56:50.444 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T20:56:50.444 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/1000 2024-09-10T20:56:50.444 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph 2024-09-10T20:56:50.444 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T20:56:50.444 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T20:56:50.444 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T20:56:50.444 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T20:56:50.444 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns 2024-09-10T20:56:50.445 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T20:56:50.445 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T20:56:50.445 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T20:56:50.445 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T20:56:50.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:50.446 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2024-09-10T20:56:50.522 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T20:56:50.522 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-10T20:56:50.566 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2024-09-10T20:56:50.623 DEBUG:teuthology.orchestra.run.smithi006:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T20:56:50.659 INFO:teuthology.orchestra.run.smithi006.stdout:/proc 2024-09-10T20:56:50.659 INFO:teuthology.orchestra.run.smithi006.stdout:/sys 2024-09-10T20:56:50.659 INFO:teuthology.orchestra.run.smithi006.stdout:/dev 2024-09-10T20:56:50.659 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/security 2024-09-10T20:56:50.659 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/shm 2024-09-10T20:56:50.659 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/pts 2024-09-10T20:56:50.660 INFO:teuthology.orchestra.run.smithi006.stdout:/run 2024-09-10T20:56:50.660 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/cgroup 2024-09-10T20:56:50.660 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/pstore 2024-09-10T20:56:50.660 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/bpf 2024-09-10T20:56:50.660 INFO:teuthology.orchestra.run.smithi006.stdout:/ 2024-09-10T20:56:50.660 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/selinux 2024-09-10T20:56:50.660 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T20:56:50.660 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/mqueue 2024-09-10T20:56:50.660 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/hugepages 2024-09-10T20:56:50.660 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/debug 2024-09-10T20:56:50.660 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/tracing 2024-09-10T20:56:50.660 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/fuse/connections 2024-09-10T20:56:50.661 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/config 2024-09-10T20:56:50.661 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T20:56:50.661 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T20:56:50.661 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T20:56:50.661 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T20:56:50.661 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/1000 2024-09-10T20:56:50.661 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph 2024-09-10T20:56:50.661 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T20:56:50.661 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T20:56:50.661 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T20:56:50.661 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T20:56:50.661 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns 2024-09-10T20:56:50.662 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T20:56:50.662 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T20:56:50.662 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T20:56:50.662 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T20:56:50.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:50.663 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2024-09-10T20:56:50.711 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:2024-09-10T20:56:50.706+0000 7f06bd927480 -1 init, newargv = 0x55967309e5b0 newargc=15 2024-09-10T20:56:50.711 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[47982]: starting ceph client 2024-09-10T20:56:50.718 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[47982]: starting fuse 2024-09-10T20:56:50.743 INFO:teuthology.orchestra.run.smithi006.stdout:43 2024-09-10T20:56:50.743 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-09-10T20:56:50.743 DEBUG:teuthology.orchestra.run.smithi006:> sudo stdin-killer -- python3 -c ' 2024-09-10T20:56:50.743 DEBUG:teuthology.orchestra.run.smithi006:> import glob 2024-09-10T20:56:50.743 DEBUG:teuthology.orchestra.run.smithi006:> import re 2024-09-10T20:56:50.743 DEBUG:teuthology.orchestra.run.smithi006:> import os 2024-09-10T20:56:50.743 DEBUG:teuthology.orchestra.run.smithi006:> import subprocess 2024-09-10T20:56:50.743 DEBUG:teuthology.orchestra.run.smithi006:> 2024-09-10T20:56:50.744 DEBUG:teuthology.orchestra.run.smithi006:> def _find_admin_socket(client_name): 2024-09-10T20:56:50.744 DEBUG:teuthology.orchestra.run.smithi006:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-10T20:56:50.744 DEBUG:teuthology.orchestra.run.smithi006:> files = glob.glob(asok_path) 2024-09-10T20:56:50.744 DEBUG:teuthology.orchestra.run.smithi006:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-10T20:56:50.744 DEBUG:teuthology.orchestra.run.smithi006:> 2024-09-10T20:56:50.744 DEBUG:teuthology.orchestra.run.smithi006:> # Given a non-glob path, it better be there 2024-09-10T20:56:50.744 DEBUG:teuthology.orchestra.run.smithi006:> if "*" not in asok_path: 2024-09-10T20:56:50.744 DEBUG:teuthology.orchestra.run.smithi006:> assert(len(files) == 1) 2024-09-10T20:56:50.744 DEBUG:teuthology.orchestra.run.smithi006:> return files[0] 2024-09-10T20:56:50.744 DEBUG:teuthology.orchestra.run.smithi006:> 2024-09-10T20:56:50.744 DEBUG:teuthology.orchestra.run.smithi006:> for f in files: 2024-09-10T20:56:50.744 DEBUG:teuthology.orchestra.run.smithi006:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T20:56:50.745 DEBUG:teuthology.orchestra.run.smithi006:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T20:56:50.745 DEBUG:teuthology.orchestra.run.smithi006:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T20:56:50.745 DEBUG:teuthology.orchestra.run.smithi006:> contents = proc_f.read() 2024-09-10T20:56:50.745 DEBUG:teuthology.orchestra.run.smithi006:> if mountpoint in contents: 2024-09-10T20:56:50.745 DEBUG:teuthology.orchestra.run.smithi006:> return f 2024-09-10T20:56:50.745 DEBUG:teuthology.orchestra.run.smithi006:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T20:56:50.745 DEBUG:teuthology.orchestra.run.smithi006:> 2024-09-10T20:56:50.745 DEBUG:teuthology.orchestra.run.smithi006:> print(_find_admin_socket("client.0")) 2024-09-10T20:56:50.745 DEBUG:teuthology.orchestra.run.smithi006:> ' 2024-09-10T20:56:50.907 INFO:teuthology.orchestra.run.smithi006.stdout:/var/run/ceph/ceph-client.0.47982.asok 2024-09-10T20:56:50.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:56:50.921 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.47982.asok 2024-09-10T20:56:50.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:50.921 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.47982.asok status 2024-09-10T20:56:51.107 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-10T20:56:51.108 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": { 2024-09-10T20:56:51.108 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T20:56:51.108 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T20:56:51.108 INFO:teuthology.orchestra.run.smithi006.stdout: "entity_id": "0", 2024-09-10T20:56:51.108 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": "smithi006", 2024-09-10T20:56:51.108 INFO:teuthology.orchestra.run.smithi006.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-10T20:56:51.108 INFO:teuthology.orchestra.run.smithi006.stdout: "pid": "47982", 2024-09-10T20:56:51.108 INFO:teuthology.orchestra.run.smithi006.stdout: "root": "/" 2024-09-10T20:56:51.108 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-10T20:56:51.108 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_count": 0, 2024-09-10T20:56:51.109 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_pinned_count": 0, 2024-09-10T20:56:51.109 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 5145, 2024-09-10T20:56:51.109 INFO:teuthology.orchestra.run.smithi006.stdout: "inst": { 2024-09-10T20:56:51.109 INFO:teuthology.orchestra.run.smithi006.stdout: "name": { 2024-09-10T20:56:51.109 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2024-09-10T20:56:51.109 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 5145 2024-09-10T20:56:51.109 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-10T20:56:51.109 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2024-09-10T20:56:51.109 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-10T20:56:51.109 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2024-09-10T20:56:51.109 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3998924633 2024-09-10T20:56:51.109 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-10T20:56:51.109 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-10T20:56:51.109 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2024-09-10T20:56:51.110 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-10T20:56:51.110 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2024-09-10T20:56:51.110 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3998924633 2024-09-10T20:56:51.110 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-10T20:56:51.110 INFO:teuthology.orchestra.run.smithi006.stdout: "inst_str": "client.5145 192.168.0.1:0/3998924633", 2024-09-10T20:56:51.110 INFO:teuthology.orchestra.run.smithi006.stdout: "addr_str": "192.168.0.1:0/3998924633", 2024-09-10T20:56:51.110 INFO:teuthology.orchestra.run.smithi006.stdout: "inode_count": 1, 2024-09-10T20:56:51.110 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_epoch": 17, 2024-09-10T20:56:51.110 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch": 35, 2024-09-10T20:56:51.110 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch_barrier": 0, 2024-09-10T20:56:51.110 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklisted": false, 2024-09-10T20:56:51.110 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs" 2024-09-10T20:56:51.111 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-10T20:56:51.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:51.120 DEBUG:teuthology.orchestra.run.smithi006:> stat --file-system '--printf=%T 2024-09-10T20:56:51.120 DEBUG:teuthology.orchestra.run.smithi006:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-10T20:56:51.156 INFO:teuthology.orchestra.run.smithi006.stdout:fuseblk 2024-09-10T20:56:51.156 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-10T20:56:51.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:51.157 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T20:56:51.253 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_symlink_recovery false 2024-09-10T20:56:51.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.413+0000 7f2feb600640 1 -- 172.21.15.6:0/4288763354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fc8003a00 msgr2=0x7f2fc8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:51.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.413+0000 7f2feb600640 1 --2- 172.21.15.6:0/4288763354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fc8003a00 0x7f2fc8003e20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4009b80 tx=0x7f2fc8005830 comp rx=0 tx=0).stop 2024-09-10T20:56:51.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.413+0000 7f2fe9600640 1 -- 172.21.15.6:0/4288763354 reap_dead start 2024-09-10T20:56:51.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.413+0000 7f2feb600640 1 -- 172.21.15.6:0/4288763354 shutdown_connections 2024-09-10T20:56:51.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.413+0000 7f2feb600640 1 -- 172.21.15.6:0/4288763354 >> 172.21.15.6:0/4288763354 conn(0x7f2fe40cfa20 msgr2=0x7f2fe40cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:51.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.413+0000 7f2feb600640 1 -- 172.21.15.6:0/4288763354 shutdown_connections 2024-09-10T20:56:51.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.413+0000 7f2feb600640 1 -- 172.21.15.6:0/4288763354 wait complete. 2024-09-10T20:56:51.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.415+0000 7f2feb600640 1 Processor -- start 2024-09-10T20:56:51.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.415+0000 7f2feb600640 1 -- start start 2024-09-10T20:56:51.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.416+0000 7f2feb600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2fc8003a00 0x7f2fe40b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:51.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.416+0000 7f2feb600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fe4151e50 0x7f2fe415de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:51.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.416+0000 7f2feb600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fe415e340 0x7f2fe406e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:51.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.416+0000 7f2feb600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe40adc10 con 0x7f2fe415e340 2024-09-10T20:56:51.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.416+0000 7f2feb600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe40ada90 con 0x7f2fe4151e50 2024-09-10T20:56:51.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.416+0000 7f2feb600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f2fe40add90 con 0x7f2fc8003a00 2024-09-10T20:56:51.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.416+0000 7f2fe9600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fe415e340 0x7f2fe406e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:51.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.416+0000 7f2fe9600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fe415e340 0x7f2fe406e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53380/0 (socket says 172.21.15.6:53380) 2024-09-10T20:56:51.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.416+0000 7f2fe9600640 1 -- 172.21.15.6:0/3544648074 learned_addr learned my addr 172.21.15.6:0/3544648074 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:51.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.417+0000 7f2fdbe00640 1 --2- 172.21.15.6:0/3544648074 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fe4151e50 0x7f2fe415de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:51.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.417+0000 7f2fe8c00640 1 --2- 172.21.15.6:0/3544648074 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2fc8003a00 0x7f2fe40b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:51.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.417+0000 7f2fe9600640 1 -- 172.21.15.6:0/3544648074 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2fc8003a00 msgr2=0x7f2fe40b28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:51.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.417+0000 7f2fe9600640 1 --2- 172.21.15.6:0/3544648074 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2fc8003a00 0x7f2fe40b28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:51.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.417+0000 7f2fe9600640 1 -- 172.21.15.6:0/3544648074 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fe4151e50 msgr2=0x7f2fe415de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:51.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.417+0000 7f2fe9600640 1 --2- 172.21.15.6:0/3544648074 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fe4151e50 0x7f2fe415de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:51.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.417+0000 7f2fe9600640 1 -- 172.21.15.6:0/3544648074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe41f87c0 con 0x7f2fe415e340 2024-09-10T20:56:51.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.417+0000 7f2fe8c00640 1 --2- 172.21.15.6:0/3544648074 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2fc8003a00 0x7f2fe40b28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:56:51.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.417+0000 7f2fdbe00640 1 --2- 172.21.15.6:0/3544648074 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fe4151e50 0x7f2fe415de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:56:51.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.417+0000 7f2fe9600640 1 --2- 172.21.15.6:0/3544648074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fe415e340 0x7f2fe406e620 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4072510 tx=0x7f2fdc010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:51.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.417+0000 7f2fe1600640 1 -- 172.21.15.6:0/3544648074 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc003970 con 0x7f2fe415e340 2024-09-10T20:56:51.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.417+0000 7f2fe1600640 1 -- 172.21.15.6:0/3544648074 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2fdc015070 con 0x7f2fe415e340 2024-09-10T20:56:51.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.417+0000 7f2feb600640 1 -- 172.21.15.6:0/3544648074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fe41f8aa0 con 0x7f2fe415e340 2024-09-10T20:56:51.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.417+0000 7f2fe1600640 1 -- 172.21.15.6:0/3544648074 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc004030 con 0x7f2fe415e340 2024-09-10T20:56:51.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.417+0000 7f2feb600640 1 -- 172.21.15.6:0/3544648074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fe41f9060 con 0x7f2fe415e340 2024-09-10T20:56:51.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.418+0000 7f2feb600640 1 -- 172.21.15.6:0/3544648074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fe40cf6a0 con 0x7f2fe415e340 2024-09-10T20:56:51.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.420+0000 7f2fe1600640 1 -- 172.21.15.6:0/3544648074 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2fdc0041d0 con 0x7f2fe415e340 2024-09-10T20:56:51.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.420+0000 7f2fe1600640 1 --2- 172.21.15.6:0/3544648074 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2fc0077fa0 0x7f2fc007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:51.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.421+0000 7f2fe1600640 1 -- 172.21.15.6:0/3544648074 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f2fdc09a930 con 0x7f2fe415e340 2024-09-10T20:56:51.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.421+0000 7f2fe8c00640 1 --2- 172.21.15.6:0/3544648074 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2fc0077fa0 0x7f2fc007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:51.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.422+0000 7f2fe8c00640 1 --2- 172.21.15.6:0/3544648074 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2fc0077fa0 0x7f2fc007a460 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4035000 tx=0x7f2fd402d040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:51.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.424+0000 7f2fe1600640 1 -- 172.21.15.6:0/3544648074 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2fe40cf6a0 con 0x7f2fe415e340 2024-09-10T20:56:51.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.621+0000 7f2feb600640 1 -- 172.21.15.6:0/3544648074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mds_symlink_recovery}] v 0) -- 0x7f2fe4069d20 con 0x7f2fe415e340 2024-09-10T20:56:51.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.625+0000 7f2fe1600640 1 -- 172.21.15.6:0/3544648074 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_symlink_recovery}]=0 v29)=0 v29) ==== 122+0+0 (secure 0 0 0) 0x7f2fdc063390 con 0x7f2fe415e340 2024-09-10T20:56:51.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.627+0000 7f2feb600640 1 -- 172.21.15.6:0/3544648074 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2fc0077fa0 msgr2=0x7f2fc007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:51.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.627+0000 7f2feb600640 1 --2- 172.21.15.6:0/3544648074 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2fc0077fa0 0x7f2fc007a460 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4035000 tx=0x7f2fd402d040 comp rx=0 tx=0).stop 2024-09-10T20:56:51.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.627+0000 7f2feb600640 1 -- 172.21.15.6:0/3544648074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fe415e340 msgr2=0x7f2fe406e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:51.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.627+0000 7f2feb600640 1 --2- 172.21.15.6:0/3544648074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fe415e340 0x7f2fe406e620 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4072510 tx=0x7f2fdc010f40 comp rx=0 tx=0).stop 2024-09-10T20:56:51.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.627+0000 7f2feb600640 1 -- 172.21.15.6:0/3544648074 shutdown_connections 2024-09-10T20:56:51.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.627+0000 7f2feb600640 1 --2- 172.21.15.6:0/3544648074 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2fc0077fa0 0x7f2fc007a460 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:51.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.627+0000 7f2feb600640 1 --2- 172.21.15.6:0/3544648074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fe415e340 0x7f2fe406e620 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:51.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.627+0000 7f2feb600640 1 --2- 172.21.15.6:0/3544648074 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fe4151e50 0x7f2fe415de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:51.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.627+0000 7f2feb600640 1 --2- 172.21.15.6:0/3544648074 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2fc8003a00 0x7f2fe40b28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:51.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.627+0000 7f2feb600640 1 -- 172.21.15.6:0/3544648074 >> 172.21.15.6:0/3544648074 conn(0x7f2fe40cfa20 msgr2=0x7f2fe415fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:51.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.628+0000 7f2feb600640 1 -- 172.21.15.6:0/3544648074 shutdown_connections 2024-09-10T20:56:51.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51.628+0000 7f2feb600640 1 -- 172.21.15.6:0/3544648074 wait complete. 2024-09-10T20:56:51.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:51.649 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir sym_dir0) 2024-09-10T20:56:51.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:51.692 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch sym_dir0/file1) 2024-09-10T20:56:51.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:51.772 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln -s sym_dir0/file1 sym_dir0/symlink_file1) 2024-09-10T20:56:51.850 DEBUG:teuthology.orchestra.run.smithi006:> stdin-killer -- python3 -c ' 2024-09-10T20:56:51.850 DEBUG:teuthology.orchestra.run.smithi006:> import os 2024-09-10T20:56:51.850 DEBUG:teuthology.orchestra.run.smithi006:> import stat 2024-09-10T20:56:51.850 DEBUG:teuthology.orchestra.run.smithi006:> 2024-09-10T20:56:51.850 DEBUG:teuthology.orchestra.run.smithi006:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/sym_dir0/symlink_file1").st_ino) 2024-09-10T20:56:51.850 DEBUG:teuthology.orchestra.run.smithi006:> ' 2024-09-10T20:56:51.991 INFO:teuthology.orchestra.run.smithi006.stdout:1099511628278 2024-09-10T20:56:51.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:56:52.003 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:56:52.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.199+0000 7fadebc00640 1 -- 172.21.15.6:0/2448369001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fade4159750 msgr2=0x7fade40d0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:52.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.199+0000 7fadebc00640 1 --2- 172.21.15.6:0/2448369001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fade4159750 0x7fade40d0d70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fadd8005fd0 tx=0x7fadd802a540 comp rx=0 tx=0).stop 2024-09-10T20:56:52.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.199+0000 7fadebc00640 1 -- 172.21.15.6:0/2448369001 shutdown_connections 2024-09-10T20:56:52.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.199+0000 7fadebc00640 1 --2- 172.21.15.6:0/2448369001 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fade40b1720 0x7fade4074120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:52.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.199+0000 7fadebc00640 1 --2- 172.21.15.6:0/2448369001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fade4159750 0x7fade40d0d70 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:52.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.199+0000 7fadebc00640 1 -- 172.21.15.6:0/2448369001 >> 172.21.15.6:0/2448369001 conn(0x7fade40d0250 msgr2=0x7fade40d0660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:52.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.199+0000 7fadebc00640 1 -- 172.21.15.6:0/2448369001 shutdown_connections 2024-09-10T20:56:52.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.199+0000 7fadebc00640 1 -- 172.21.15.6:0/2448369001 wait complete. 2024-09-10T20:56:52.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.200+0000 7fadebc00640 1 Processor -- start 2024-09-10T20:56:52.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.201+0000 7fadebc00640 1 -- start start 2024-09-10T20:56:52.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.202+0000 7fadebc00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fade4074660 0x7fade41f4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:52.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.202+0000 7fadebc00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fade40b1720 0x7fade40c4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:52.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.202+0000 7fadebc00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fade4159750 0x7fade4154500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:52.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.202+0000 7fadebc00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fade4074bf0 con 0x7fade4074660 2024-09-10T20:56:52.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.202+0000 7fadebc00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fade4074a70 con 0x7fade4159750 2024-09-10T20:56:52.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.202+0000 7fadebc00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fade4074d70 con 0x7fade40b1720 2024-09-10T20:56:52.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.202+0000 7fade9200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fade4074660 0x7fade41f4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:52.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.202+0000 7fade9200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fade4074660 0x7fade41f4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53396/0 (socket says 172.21.15.6:53396) 2024-09-10T20:56:52.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.202+0000 7fade9200640 1 -- 172.21.15.6:0/2641535600 learned_addr learned my addr 172.21.15.6:0/2641535600 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:52.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.202+0000 7fade3e00640 1 --2- 172.21.15.6:0/2641535600 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fade40b1720 0x7fade40c4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:52.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.202+0000 7fade9c00640 1 --2- 172.21.15.6:0/2641535600 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fade4159750 0x7fade4154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:52.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.202+0000 7fade9200640 1 -- 172.21.15.6:0/2641535600 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fade40b1720 msgr2=0x7fade40c4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:52.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.202+0000 7fade9200640 1 --2- 172.21.15.6:0/2641535600 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fade40b1720 0x7fade40c4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:52.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.202+0000 7fade9200640 1 -- 172.21.15.6:0/2641535600 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fade4159750 msgr2=0x7fade4154500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:52.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.202+0000 7fade9200640 1 --2- 172.21.15.6:0/2641535600 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fade4159750 0x7fade4154500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:52.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.202+0000 7fade9200640 1 -- 172.21.15.6:0/2641535600 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade4160680 con 0x7fade4074660 2024-09-10T20:56:52.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.203+0000 7fade9200640 1 --2- 172.21.15.6:0/2641535600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fade4074660 0x7fade41f4440 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fadd8034040 tx=0x7fadd80038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:52.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.203+0000 7fade0c00640 1 -- 172.21.15.6:0/2641535600 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd803e030 con 0x7fade4074660 2024-09-10T20:56:52.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.203+0000 7fade0c00640 1 -- 172.21.15.6:0/2641535600 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fadd8003d90 con 0x7fade4074660 2024-09-10T20:56:52.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.203+0000 7fadebc00640 1 -- 172.21.15.6:0/2641535600 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fade40c6020 con 0x7fade4074660 2024-09-10T20:56:52.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.203+0000 7fade0c00640 1 -- 172.21.15.6:0/2641535600 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd8035040 con 0x7fade4074660 2024-09-10T20:56:52.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.203+0000 7fadebc00640 1 -- 172.21.15.6:0/2641535600 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fade41f4980 con 0x7fade4074660 2024-09-10T20:56:52.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.204+0000 7fadebc00640 1 -- 172.21.15.6:0/2641535600 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fade415c160 con 0x7fade4074660 2024-09-10T20:56:52.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.205+0000 7fade0c00640 1 -- 172.21.15.6:0/2641535600 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fadd80049e0 con 0x7fade4074660 2024-09-10T20:56:52.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.206+0000 7fade0c00640 1 --2- 172.21.15.6:0/2641535600 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fadc4077f70 0x7fadc407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:52.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.206+0000 7fade0c00640 1 -- 172.21.15.6:0/2641535600 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fadd80baa70 con 0x7fade4074660 2024-09-10T20:56:52.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.207+0000 7fade3e00640 1 --2- 172.21.15.6:0/2641535600 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fadc4077f70 0x7fadc407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:52.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.207+0000 7fade3e00640 1 --2- 172.21.15.6:0/2641535600 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fadc4077f70 0x7fadc407a430 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fade41f8070 tx=0x7fadd0005f90 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:52.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.210+0000 7fade0c00640 1 -- 172.21.15.6:0/2641535600 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fadd80834d0 con 0x7fade4074660 2024-09-10T20:56:52.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.445+0000 7fadebc00640 1 -- 172.21.15.6:0/2641535600 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fade4074120 con 0x7fade4074660 2024-09-10T20:56:52.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.446+0000 7fade0c00640 1 -- 172.21.15.6:0/2641535600 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5220 (secure 0 0 0) 0x7fadd8082dd0 con 0x7fade4074660 2024-09-10T20:56:52.451 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:56:52.451 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":17,"btime":"2024-09-10T20:56:41:162013+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1675451102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1675451102},{"type":"v1","addr":"172.21.15.6:6834","nonce":1675451102}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4924,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/676153174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":676153174},{"type":"v1","addr":"172.21.15.150:6836","nonce":676153174}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4950,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4072260905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":4072260905},{"type":"v1","addr":"172.21.15.150:6837","nonce":4072260905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:56:37.566072+0000","modified":"2024-09-10T20:56:40.597848+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4956":{"gid":4956,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/1598644433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1598644433},{"type":"v1","addr":"172.21.15.6:6835","nonce":1598644433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4956,"qdb_cluster":[4956]},"id":2}]} 2024-09-10T20:56:52.451 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 17 2024-09-10T20:56:52.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.448+0000 7fadebc00640 1 -- 172.21.15.6:0/2641535600 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fadc4077f70 msgr2=0x7fadc407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:52.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.448+0000 7fadebc00640 1 --2- 172.21.15.6:0/2641535600 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fadc4077f70 0x7fadc407a430 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fade41f8070 tx=0x7fadd0005f90 comp rx=0 tx=0).stop 2024-09-10T20:56:52.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.448+0000 7fadebc00640 1 -- 172.21.15.6:0/2641535600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fade4074660 msgr2=0x7fade41f4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:52.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.448+0000 7fadebc00640 1 --2- 172.21.15.6:0/2641535600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fade4074660 0x7fade41f4440 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fadd8034040 tx=0x7fadd80038a0 comp rx=0 tx=0).stop 2024-09-10T20:56:52.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.448+0000 7fadebc00640 1 -- 172.21.15.6:0/2641535600 shutdown_connections 2024-09-10T20:56:52.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.448+0000 7fadebc00640 1 --2- 172.21.15.6:0/2641535600 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fadc4077f70 0x7fadc407a430 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:52.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.448+0000 7fadebc00640 1 --2- 172.21.15.6:0/2641535600 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fade4159750 0x7fade4154500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:52.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.448+0000 7fadebc00640 1 --2- 172.21.15.6:0/2641535600 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fade40b1720 0x7fade40c4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:52.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.448+0000 7fadebc00640 1 --2- 172.21.15.6:0/2641535600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fade4074660 0x7fade41f4440 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:52.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.448+0000 7fadebc00640 1 -- 172.21.15.6:0/2641535600 >> 172.21.15.6:0/2641535600 conn(0x7fade40d0250 msgr2=0x7fade4151d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:52.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.448+0000 7fadebc00640 1 -- 172.21.15.6:0/2641535600 shutdown_connections 2024-09-10T20:56:52.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.448+0000 7fadebc00640 1 -- 172.21.15.6:0/2641535600 wait complete. 2024-09-10T20:56:52.469 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-09-10T20:56:52.658 INFO:teuthology.orchestra.run.smithi006.stdout:{"message":"","return_code":0} 2024-09-10T20:56:52.659 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-10T20:56:52.659 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f6.00000000 symlink 2024-09-10T20:56:52.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.731+0000 7fef2138df40 1 Processor -- start 2024-09-10T20:56:52.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.731+0000 7fef2138df40 1 -- start start 2024-09-10T20:56:52.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.732+0000 7fef2138df40 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef040030f0 0x560a3f1e2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:52.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.732+0000 7fef2138df40 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a3f285200 0x560a3f1b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:52.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.732+0000 7fef2138df40 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x560a3f1e1e60 0x560a3f1b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:52.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.732+0000 7fef2138df40 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x560a3f1601d0 con 0x560a3f285200 2024-09-10T20:56:52.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.732+0000 7fef2138df40 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x560a3f16cf90 con 0x7fef040030f0 2024-09-10T20:56:52.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.732+0000 7fef2138df40 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x560a3f101c60 con 0x560a3f1e1e60 2024-09-10T20:56:52.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.733+0000 7fef1dc00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a3f285200 0x560a3f1b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:52.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.733+0000 7fef1dc00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a3f285200 0x560a3f1b18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53400/0 (socket says 172.21.15.6:53400) 2024-09-10T20:56:52.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.733+0000 7fef1dc00640 1 -- 172.21.15.6:0/2957450990 learned_addr learned my addr 172.21.15.6:0/2957450990 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:52.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.733+0000 7fef1dc00640 1 -- 172.21.15.6:0/2957450990 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x560a3f1e1e60 msgr2=0x560a3f1b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:52.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.733+0000 7fef1dc00640 1 --2- 172.21.15.6:0/2957450990 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x560a3f1e1e60 0x560a3f1b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:52.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.733+0000 7fef1dc00640 1 -- 172.21.15.6:0/2957450990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef040030f0 msgr2=0x560a3f1e2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:52.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.733+0000 7fef1dc00640 1 --2- 172.21.15.6:0/2957450990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef040030f0 0x560a3f1e2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:52.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.733+0000 7fef1dc00640 1 -- 172.21.15.6:0/2957450990 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a3f287b90 con 0x560a3f285200 2024-09-10T20:56:52.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.733+0000 7fef1dc00640 1 --2- 172.21.15.6:0/2957450990 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a3f285200 0x560a3f1b18d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fef0c056040 tx=0x7fef0c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=831cea04b21e44d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:52.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.733+0000 7fef17e00640 1 -- 172.21.15.6:0/2957450990 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef0c063070 con 0x560a3f285200 2024-09-10T20:56:52.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.733+0000 7fef17e00640 1 -- 172.21.15.6:0/2957450990 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fef0c053b30 con 0x560a3f285200 2024-09-10T20:56:52.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.733+0000 7fef17e00640 1 -- 172.21.15.6:0/2957450990 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef0c058040 con 0x560a3f285200 2024-09-10T20:56:52.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.734+0000 7fef2138df40 1 -- 172.21.15.6:0/2957450990 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a3f285200 msgr2=0x560a3f1b18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:52.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.734+0000 7fef2138df40 1 --2- 172.21.15.6:0/2957450990 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a3f285200 0x560a3f1b18d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fef0c056040 tx=0x7fef0c001120 comp rx=0 tx=0).stop 2024-09-10T20:56:52.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.734+0000 7fef2138df40 1 -- 172.21.15.6:0/2957450990 shutdown_connections 2024-09-10T20:56:52.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.734+0000 7fef2138df40 1 --2- 172.21.15.6:0/2957450990 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a3f285200 0x560a3f1b18d0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:52.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.734+0000 7fef2138df40 1 --2- 172.21.15.6:0/2957450990 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x560a3f1e1e60 0x560a3f1b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:52.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.734+0000 7fef2138df40 1 --2- 172.21.15.6:0/2957450990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef040030f0 0x560a3f1e2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:52.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.734+0000 7fef2138df40 1 -- 172.21.15.6:0/2957450990 >> 172.21.15.6:0/2957450990 conn(0x560a3f1e1870 msgr2=0x560a3f1afc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:52.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.734+0000 7fef2138df40 1 -- 172.21.15.6:0/2957450990 shutdown_connections 2024-09-10T20:56:52.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.734+0000 7fef2138df40 1 -- 172.21.15.6:0/2957450990 wait complete. 2024-09-10T20:56:52.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.735+0000 7fef2138df40 1 Processor -- start 2024-09-10T20:56:52.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.735+0000 7fef2138df40 1 -- start start 2024-09-10T20:56:52.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.736+0000 7fef2138df40 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x560a3f1e1e60 0x560a3f281c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:52.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.736+0000 7fef2138df40 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560a3f285200 0x560a3f284840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:52.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.736+0000 7fef2138df40 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef040030f0 0x560a3f27c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:52.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.736+0000 7fef2138df40 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x560a3f1e15c0 con 0x7fef040030f0 2024-09-10T20:56:52.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.736+0000 7fef2138df40 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x560a3f28c380 con 0x560a3f285200 2024-09-10T20:56:52.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.736+0000 7fef2138df40 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x560a3f28c6d0 con 0x560a3f1e1e60 2024-09-10T20:56:52.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.736+0000 7fef1f000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef040030f0 0x560a3f27c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:52.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.736+0000 7fef1e600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x560a3f1e1e60 0x560a3f281c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:52.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.736+0000 7fef1dc00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560a3f285200 0x560a3f284840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:52.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.736+0000 7fef1f000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef040030f0 0x560a3f27c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53408/0 (socket says 172.21.15.6:53408) 2024-09-10T20:56:52.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.736+0000 7fef1f000640 1 -- 172.21.15.6:0/4001430877 learned_addr learned my addr 172.21.15.6:0/4001430877 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:52.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.737+0000 7fef1f000640 1 -- 172.21.15.6:0/4001430877 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x560a3f1e1e60 msgr2=0x560a3f281c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:52.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.737+0000 7fef1f000640 1 --2- 172.21.15.6:0/4001430877 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x560a3f1e1e60 0x560a3f281c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:52.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.737+0000 7fef1f000640 1 -- 172.21.15.6:0/4001430877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560a3f285200 msgr2=0x560a3f284840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:52.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.737+0000 7fef1f000640 1 --2- 172.21.15.6:0/4001430877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560a3f285200 0x560a3f284840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:52.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.737+0000 7fef1f000640 1 -- 172.21.15.6:0/4001430877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a3f282380 con 0x7fef040030f0 2024-09-10T20:56:52.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.737+0000 7fef1e600640 1 --2- 172.21.15.6:0/4001430877 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x560a3f1e1e60 0x560a3f281c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:56:52.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.737+0000 7fef1f000640 1 --2- 172.21.15.6:0/4001430877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef040030f0 0x560a3f27c330 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x560a3f1ffa70 tx=0x7fef1800da10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:52.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.737+0000 7fef16a00640 1 -- 172.21.15.6:0/4001430877 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef18010910 con 0x7fef040030f0 2024-09-10T20:56:52.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.737+0000 7fef16a00640 1 -- 172.21.15.6:0/4001430877 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fef18014070 con 0x7fef040030f0 2024-09-10T20:56:52.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.737+0000 7fef2138df40 1 -- 172.21.15.6:0/4001430877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560a3f282660 con 0x7fef040030f0 2024-09-10T20:56:52.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.737+0000 7fef16a00640 1 -- 172.21.15.6:0/4001430877 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef18010e40 con 0x7fef040030f0 2024-09-10T20:56:52.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.737+0000 7fef2138df40 1 -- 172.21.15.6:0/4001430877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a3f284d80 con 0x7fef040030f0 2024-09-10T20:56:52.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.740+0000 7fef16a00640 1 -- 172.21.15.6:0/4001430877 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fef180223f0 con 0x7fef040030f0 2024-09-10T20:56:52.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.741+0000 7fef16a00640 1 --2- 172.21.15.6:0/4001430877 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fef00076950 0x7fef00078e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:52.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.741+0000 7fef16a00640 1 -- 172.21.15.6:0/4001430877 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fef18099890 con 0x7fef040030f0 2024-09-10T20:56:52.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.741+0000 7fef2138df40 1 --2- 172.21.15.6:0/4001430877 >> [v2:172.21.15.150:6826/2568527750,v1:172.21.15.150:6827/2568527750] conn(0x560a3f1b0e40 0x560a3f320d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:52.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.741+0000 7fef2138df40 1 -- 172.21.15.6:0/4001430877 --> [v2:172.21.15.150:6826/2568527750,v1:172.21.15.150:6827/2568527750] -- osd_op(unknown.0.0:1 5.2a 5:57fe7535:::100000001f6.00000000:head [getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560a3f3212c0 con 0x560a3f1b0e40 2024-09-10T20:56:52.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.741+0000 7fef1e600640 1 --2- 172.21.15.6:0/4001430877 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fef00076950 0x7fef00078e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:52.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.741+0000 7fef1dc00640 1 --2- 172.21.15.6:0/4001430877 >> [v2:172.21.15.150:6826/2568527750,v1:172.21.15.150:6827/2568527750] conn(0x560a3f1b0e40 0x560a3f320d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:52.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.742+0000 7fef1e600640 1 --2- 172.21.15.6:0/4001430877 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fef00076950 0x7fef00078e10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fef10001ca0 tx=0x7fef100011c0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:52.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.742+0000 7fef1dc00640 1 --2- 172.21.15.6:0/4001430877 >> [v2:172.21.15.150:6826/2568527750,v1:172.21.15.150:6827/2568527750] conn(0x560a3f1b0e40 0x560a3f320d80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:52.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.743+0000 7fef1dc00640 1 -- 172.21.15.6:0/4001430877 <== osd.4 v2:172.21.15.150:6826/2568527750 1 ==== osd_op_reply(1 100000001f6.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) ==== 164+0+0 (crc 0 0 0) 0x7fef0c00b040 con 0x560a3f1b0e40 2024-09-10T20:56:52.748 INFO:teuthology.orchestra.run.smithi006.stderr:error getting xattr cephfs_data/100000001f6.00000000/symlink: (61) No data available 2024-09-10T20:56:52.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.743+0000 7fef2138df40 1 -- 172.21.15.6:0/4001430877 >> [v2:172.21.15.150:6826/2568527750,v1:172.21.15.150:6827/2568527750] conn(0x560a3f1b0e40 msgr2=0x560a3f320d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:52.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.743+0000 7fef2138df40 1 --2- 172.21.15.6:0/4001430877 >> [v2:172.21.15.150:6826/2568527750,v1:172.21.15.150:6827/2568527750] conn(0x560a3f1b0e40 0x560a3f320d80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:52.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.743+0000 7fef2138df40 1 -- 172.21.15.6:0/4001430877 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fef00076950 msgr2=0x7fef00078e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:52.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.743+0000 7fef2138df40 1 --2- 172.21.15.6:0/4001430877 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fef00076950 0x7fef00078e10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fef10001ca0 tx=0x7fef100011c0 comp rx=0 tx=0).stop 2024-09-10T20:56:52.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.743+0000 7fef2138df40 1 -- 172.21.15.6:0/4001430877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef040030f0 msgr2=0x560a3f27c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:52.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.743+0000 7fef2138df40 1 --2- 172.21.15.6:0/4001430877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef040030f0 0x560a3f27c330 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x560a3f1ffa70 tx=0x7fef1800da10 comp rx=0 tx=0).stop 2024-09-10T20:56:52.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.743+0000 7fef1f000640 1 -- 172.21.15.6:0/4001430877 reap_dead start 2024-09-10T20:56:52.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.743+0000 7fef2138df40 1 -- 172.21.15.6:0/4001430877 shutdown_connections 2024-09-10T20:56:52.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.743+0000 7fef2138df40 1 -- 172.21.15.6:0/4001430877 >> 172.21.15.6:0/4001430877 conn(0x560a3f1e1870 msgr2=0x560a3f1afc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:52.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.743+0000 7fef2138df40 1 -- 172.21.15.6:0/4001430877 shutdown_connections 2024-09-10T20:56:52.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.743+0000 7fef2138df40 1 -- 172.21.15.6:0/4001430877 wait complete. 2024-09-10T20:56:52.752 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T20:56:52.752 ERROR:tasks.cephfs.filesystem:Command failed on smithi006 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f6.00000000 symlink' 2024-09-10T20:56:52.753 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_symlink_recovery true 2024-09-10T20:56:52.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.911+0000 7f2738a00640 1 -- 172.21.15.6:0/2504927341 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2734073cd0 msgr2=0x7f27341668e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:52.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.911+0000 7f2738a00640 1 --2- 172.21.15.6:0/2504927341 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2734073cd0 0x7f27341668e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f272c009860 tx=0x7f272c02a4f0 comp rx=0 tx=0).stop 2024-09-10T20:56:52.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.911+0000 7f2738a00640 1 -- 172.21.15.6:0/2504927341 shutdown_connections 2024-09-10T20:56:52.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.911+0000 7f2738a00640 1 --2- 172.21.15.6:0/2504927341 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2734073cd0 0x7f27341668e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:52.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.911+0000 7f2738a00640 1 -- 172.21.15.6:0/2504927341 >> 172.21.15.6:0/2504927341 conn(0x7f27340b27c0 msgr2=0x7f27340b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:52.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.911+0000 7f2738a00640 1 -- 172.21.15.6:0/2504927341 shutdown_connections 2024-09-10T20:56:52.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.911+0000 7f2738a00640 1 -- 172.21.15.6:0/2504927341 wait complete. 2024-09-10T20:56:52.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.913+0000 7f2738a00640 1 Processor -- start 2024-09-10T20:56:52.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.913+0000 7f2738a00640 1 -- start start 2024-09-10T20:56:52.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.914+0000 7f2738a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f273406faf0 0x7f27341594e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:52.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.914+0000 7f2738a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2734073cd0 0x7f273413e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:52.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.914+0000 7f2738a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f273415b9d0 0x7f27341f67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:52.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.914+0000 7f2738a00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2734166fa0 con 0x7f273406faf0 2024-09-10T20:56:52.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.914+0000 7f2738a00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2734166e20 con 0x7f273415b9d0 2024-09-10T20:56:52.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.914+0000 7f2738a00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f2734167120 con 0x7f2734073cd0 2024-09-10T20:56:52.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.914+0000 7f2731e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f273406faf0 0x7f27341594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:52.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.914+0000 7f2731e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f273406faf0 0x7f27341594e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53420/0 (socket says 172.21.15.6:53420) 2024-09-10T20:56:52.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.914+0000 7f2731e00640 1 -- 172.21.15.6:0/840250678 learned_addr learned my addr 172.21.15.6:0/840250678 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:52.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.914+0000 7f2732800640 1 --2- 172.21.15.6:0/840250678 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f273415b9d0 0x7f27341f67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:52.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.914+0000 7f2731400640 1 --2- 172.21.15.6:0/840250678 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2734073cd0 0x7f273413e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:52.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.914+0000 7f2731e00640 1 -- 172.21.15.6:0/840250678 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2734073cd0 msgr2=0x7f273413e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:52.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.915+0000 7f2731e00640 1 --2- 172.21.15.6:0/840250678 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2734073cd0 0x7f273413e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:52.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.915+0000 7f2731e00640 1 -- 172.21.15.6:0/840250678 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f273415b9d0 msgr2=0x7f27341f67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:52.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.915+0000 7f2731e00640 1 --2- 172.21.15.6:0/840250678 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f273415b9d0 0x7f27341f67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:52.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.915+0000 7f2731e00640 1 -- 172.21.15.6:0/840250678 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f273414f890 con 0x7f273406faf0 2024-09-10T20:56:52.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.915+0000 7f2731400640 1 --2- 172.21.15.6:0/840250678 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2734073cd0 0x7f273413e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:56:52.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.915+0000 7f2731e00640 1 --2- 172.21.15.6:0/840250678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f273406faf0 0x7f27341594e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f27240015a0 tx=0x7f272400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:52.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.915+0000 7f272a000640 1 -- 172.21.15.6:0/840250678 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2724016020 con 0x7f273406faf0 2024-09-10T20:56:52.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.915+0000 7f272a000640 1 -- 172.21.15.6:0/840250678 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f272400ce20 con 0x7f273406faf0 2024-09-10T20:56:52.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.915+0000 7f2738a00640 1 -- 172.21.15.6:0/840250678 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27341f2eb0 con 0x7f273406faf0 2024-09-10T20:56:52.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.915+0000 7f272a000640 1 -- 172.21.15.6:0/840250678 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2724012680 con 0x7f273406faf0 2024-09-10T20:56:52.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.915+0000 7f2738a00640 1 -- 172.21.15.6:0/840250678 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27341f3470 con 0x7f273406faf0 2024-09-10T20:56:52.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.916+0000 7f2738a00640 1 -- 172.21.15.6:0/840250678 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27340735c0 con 0x7f273406faf0 2024-09-10T20:56:52.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.918+0000 7f272a000640 1 -- 172.21.15.6:0/840250678 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f272401a3b0 con 0x7f273406faf0 2024-09-10T20:56:52.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.919+0000 7f272a000640 1 --2- 172.21.15.6:0/840250678 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2710077fa0 0x7f271007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:52.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.919+0000 7f272a000640 1 -- 172.21.15.6:0/840250678 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f272409a490 con 0x7f273406faf0 2024-09-10T20:56:52.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.919+0000 7f2731400640 1 --2- 172.21.15.6:0/840250678 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2710077fa0 0x7f271007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:52.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.920+0000 7f2731400640 1 --2- 172.21.15.6:0/840250678 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2710077fa0 0x7f271007a460 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f271c007fd0 tx=0x7f271c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:52.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:52.923+0000 7f272a000640 1 -- 172.21.15.6:0/840250678 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2724020030 con 0x7f273406faf0 2024-09-10T20:56:53.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.116+0000 7f2738a00640 1 -- 172.21.15.6:0/840250678 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mds_symlink_recovery}] v 0) -- 0x7f273415cb20 con 0x7f273406faf0 2024-09-10T20:56:53.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.119+0000 7f272a000640 1 -- 172.21.15.6:0/840250678 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_symlink_recovery}]=0 v30)=0 v30) ==== 121+0+0 (secure 0 0 0) 0x7f2724062f10 con 0x7f273406faf0 2024-09-10T20:56:53.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.121+0000 7f2738a00640 1 -- 172.21.15.6:0/840250678 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2710077fa0 msgr2=0x7f271007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:53.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.121+0000 7f2738a00640 1 --2- 172.21.15.6:0/840250678 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2710077fa0 0x7f271007a460 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f271c007fd0 tx=0x7f271c009040 comp rx=0 tx=0).stop 2024-09-10T20:56:53.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.121+0000 7f2738a00640 1 -- 172.21.15.6:0/840250678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f273406faf0 msgr2=0x7f27341594e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:53.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.121+0000 7f2738a00640 1 --2- 172.21.15.6:0/840250678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f273406faf0 0x7f27341594e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f27240015a0 tx=0x7f272400a430 comp rx=0 tx=0).stop 2024-09-10T20:56:53.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.122+0000 7f2738a00640 1 -- 172.21.15.6:0/840250678 shutdown_connections 2024-09-10T20:56:53.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.122+0000 7f2738a00640 1 --2- 172.21.15.6:0/840250678 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2710077fa0 0x7f271007a460 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:53.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.122+0000 7f2738a00640 1 --2- 172.21.15.6:0/840250678 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f273415b9d0 0x7f27341f67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:53.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.122+0000 7f2738a00640 1 --2- 172.21.15.6:0/840250678 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2734073cd0 0x7f273413e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:53.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.122+0000 7f2738a00640 1 --2- 172.21.15.6:0/840250678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f273406faf0 0x7f27341594e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:53.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.122+0000 7f2738a00640 1 -- 172.21.15.6:0/840250678 >> 172.21.15.6:0/840250678 conn(0x7f27340b27c0 msgr2=0x7f273406cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:53.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.122+0000 7f2738a00640 1 -- 172.21.15.6:0/840250678 shutdown_connections 2024-09-10T20:56:53.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.122+0000 7f2738a00640 1 -- 172.21.15.6:0/840250678 wait complete. 2024-09-10T20:56:53.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:53.142 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir sym_dir) 2024-09-10T20:56:53.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:53.182 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch sym_dir/file1) 2024-09-10T20:56:53.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:53.263 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln -s ./file1 sym_dir/symlink_file1) 2024-09-10T20:56:53.340 DEBUG:teuthology.orchestra.run.smithi006:> stdin-killer -- python3 -c ' 2024-09-10T20:56:53.340 DEBUG:teuthology.orchestra.run.smithi006:> import os 2024-09-10T20:56:53.341 DEBUG:teuthology.orchestra.run.smithi006:> import stat 2024-09-10T20:56:53.341 DEBUG:teuthology.orchestra.run.smithi006:> 2024-09-10T20:56:53.341 DEBUG:teuthology.orchestra.run.smithi006:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/sym_dir/symlink_file1").st_ino) 2024-09-10T20:56:53.341 DEBUG:teuthology.orchestra.run.smithi006:> ' 2024-09-10T20:56:53.480 INFO:teuthology.orchestra.run.smithi006.stdout:1099511628281 2024-09-10T20:56:53.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:56:53.492 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:56:53.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.687+0000 7f6ac4400640 1 -- 172.21.15.6:0/159459809 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6abc15c170 msgr2=0x7f6abc0cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:53.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.687+0000 7f6ac4400640 1 --2- 172.21.15.6:0/159459809 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6abc15c170 0x7f6abc0cd920 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6abc051860 tx=0x7f6aa802a560 comp rx=0 tx=0).stop 2024-09-10T20:56:53.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.687+0000 7f6ac4400640 1 -- 172.21.15.6:0/159459809 shutdown_connections 2024-09-10T20:56:53.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.687+0000 7f6ac4400640 1 --2- 172.21.15.6:0/159459809 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6abc15c170 0x7f6abc0cd920 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:53.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.687+0000 7f6ac4400640 1 --2- 172.21.15.6:0/159459809 >> v2:172.21.15.150:3300/0 conn(0x7f6abc159670 0x7f6abc0743b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:53.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.687+0000 7f6ac4400640 1 -- 172.21.15.6:0/159459809 >> 172.21.15.6:0/159459809 conn(0x7f6abc0cfa20 msgr2=0x7f6abc0cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:53.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.687+0000 7f6ac4400640 1 -- 172.21.15.6:0/159459809 shutdown_connections 2024-09-10T20:56:53.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.687+0000 7f6ac4400640 1 -- 172.21.15.6:0/159459809 wait complete. 2024-09-10T20:56:53.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.689+0000 7f6ac4400640 1 Processor -- start 2024-09-10T20:56:53.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.689+0000 7f6ac4400640 1 -- start start 2024-09-10T20:56:53.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.690+0000 7f6ac4400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6abc06fd40 0x7f6abc0c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:53.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.690+0000 7f6ac4400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6abc159670 0x7f6abc151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:53.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.690+0000 7f6ac4400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6abc15c170 0x7f6abc0ad880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:53.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.690+0000 7f6ac4400640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6abc0b4a90 con 0x7f6abc15c170 2024-09-10T20:56:53.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.690+0000 7f6ac4400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6abc0b4910 con 0x7f6abc06fd40 2024-09-10T20:56:53.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.690+0000 7f6ac4400640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f6abc0b4c10 con 0x7f6abc159670 2024-09-10T20:56:53.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.690+0000 7f6ac2400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6abc15c170 0x7f6abc0ad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:53.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.690+0000 7f6ac2400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6abc15c170 0x7f6abc0ad880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53430/0 (socket says 172.21.15.6:53430) 2024-09-10T20:56:53.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.690+0000 7f6ac2400640 1 -- 172.21.15.6:0/1242484326 learned_addr learned my addr 172.21.15.6:0/1242484326 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:53.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.690+0000 7f6ac1a00640 1 --2- 172.21.15.6:0/1242484326 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6abc06fd40 0x7f6abc0c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:53.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.691+0000 7f6ac1000640 1 --2- 172.21.15.6:0/1242484326 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6abc159670 0x7f6abc151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:53.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.691+0000 7f6ac2400640 1 -- 172.21.15.6:0/1242484326 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6abc159670 msgr2=0x7f6abc151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:53.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.691+0000 7f6ac2400640 1 --2- 172.21.15.6:0/1242484326 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6abc159670 0x7f6abc151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:53.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.691+0000 7f6ac2400640 1 -- 172.21.15.6:0/1242484326 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6abc06fd40 msgr2=0x7f6abc0c6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:53.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.691+0000 7f6ac2400640 1 --2- 172.21.15.6:0/1242484326 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6abc06fd40 0x7f6abc0c6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:53.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.691+0000 7f6ac2400640 1 -- 172.21.15.6:0/1242484326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6abc1524b0 con 0x7f6abc15c170 2024-09-10T20:56:53.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.691+0000 7f6ac2400640 1 --2- 172.21.15.6:0/1242484326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6abc15c170 0x7f6abc0ad880 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6ab400c730 tx=0x7f6ab400cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:53.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.691+0000 7f6ab9600640 1 -- 172.21.15.6:0/1242484326 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab4016020 con 0x7f6abc15c170 2024-09-10T20:56:53.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.691+0000 7f6ab9600640 1 -- 172.21.15.6:0/1242484326 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ab4003990 con 0x7f6abc15c170 2024-09-10T20:56:53.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.691+0000 7f6ab9600640 1 -- 172.21.15.6:0/1242484326 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab4006e60 con 0x7f6abc15c170 2024-09-10T20:56:53.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.691+0000 7f6ac4400640 1 -- 172.21.15.6:0/1242484326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6abc1f8050 con 0x7f6abc15c170 2024-09-10T20:56:53.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.692+0000 7f6ac4400640 1 -- 172.21.15.6:0/1242484326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6abc1f8610 con 0x7f6abc15c170 2024-09-10T20:56:53.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.693+0000 7f6ac4400640 1 -- 172.21.15.6:0/1242484326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6abc0b50c0 con 0x7f6abc15c170 2024-09-10T20:56:53.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.694+0000 7f6ab9600640 1 -- 172.21.15.6:0/1242484326 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6ab40050d0 con 0x7f6abc15c170 2024-09-10T20:56:53.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.695+0000 7f6ab9600640 1 --2- 172.21.15.6:0/1242484326 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6a9c077f70 0x7f6a9c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:53.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.695+0000 7f6ab9600640 1 -- 172.21.15.6:0/1242484326 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f6ab4099860 con 0x7f6abc15c170 2024-09-10T20:56:53.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.695+0000 7f6ac1a00640 1 --2- 172.21.15.6:0/1242484326 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6a9c077f70 0x7f6a9c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:53.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.696+0000 7f6ac1a00640 1 --2- 172.21.15.6:0/1242484326 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6a9c077f70 0x7f6a9c07a430 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0009bd0 tx=0x7f6ab0005f90 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:53.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.699+0000 7f6ab9600640 1 -- 172.21.15.6:0/1242484326 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f6ab4020020 con 0x7f6abc15c170 2024-09-10T20:56:53.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.929+0000 7f6ac4400640 1 -- 172.21.15.6:0/1242484326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6abc069d20 con 0x7f6abc15c170 2024-09-10T20:56:53.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.929+0000 7f6ab9600640 1 -- 172.21.15.6:0/1242484326 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5220 (secure 0 0 0) 0x7f6ab4061d00 con 0x7f6abc15c170 2024-09-10T20:56:53.935 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:56:53.935 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":17,"btime":"2024-09-10T20:56:41:162013+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1675451102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1675451102},{"type":"v1","addr":"172.21.15.6:6834","nonce":1675451102}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4924,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/676153174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":676153174},{"type":"v1","addr":"172.21.15.150:6836","nonce":676153174}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4950,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4072260905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":4072260905},{"type":"v1","addr":"172.21.15.150:6837","nonce":4072260905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:56:37.566072+0000","modified":"2024-09-10T20:56:40.597848+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4956":{"gid":4956,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/1598644433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1598644433},{"type":"v1","addr":"172.21.15.6:6835","nonce":1598644433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4956,"qdb_cluster":[4956]},"id":2}]} 2024-09-10T20:56:53.935 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 17 2024-09-10T20:56:53.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.932+0000 7f6ac4400640 1 -- 172.21.15.6:0/1242484326 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6a9c077f70 msgr2=0x7f6a9c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:53.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.932+0000 7f6ac4400640 1 --2- 172.21.15.6:0/1242484326 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6a9c077f70 0x7f6a9c07a430 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0009bd0 tx=0x7f6ab0005f90 comp rx=0 tx=0).stop 2024-09-10T20:56:53.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.932+0000 7f6ac4400640 1 -- 172.21.15.6:0/1242484326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6abc15c170 msgr2=0x7f6abc0ad880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:53.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.932+0000 7f6ac4400640 1 --2- 172.21.15.6:0/1242484326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6abc15c170 0x7f6abc0ad880 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6ab400c730 tx=0x7f6ab400cb30 comp rx=0 tx=0).stop 2024-09-10T20:56:53.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.932+0000 7f6ac4400640 1 -- 172.21.15.6:0/1242484326 shutdown_connections 2024-09-10T20:56:53.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.932+0000 7f6ac4400640 1 --2- 172.21.15.6:0/1242484326 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6a9c077f70 0x7f6a9c07a430 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:53.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.932+0000 7f6ac4400640 1 --2- 172.21.15.6:0/1242484326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6abc15c170 0x7f6abc0ad880 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:53.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.932+0000 7f6ac4400640 1 --2- 172.21.15.6:0/1242484326 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6abc159670 0x7f6abc151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:53.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.932+0000 7f6ac4400640 1 --2- 172.21.15.6:0/1242484326 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6abc06fd40 0x7f6abc0c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:53.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.932+0000 7f6ac4400640 1 -- 172.21.15.6:0/1242484326 >> 172.21.15.6:0/1242484326 conn(0x7f6abc0cfa20 msgr2=0x7f6abc0b28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:53.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.932+0000 7f6ac4400640 1 -- 172.21.15.6:0/1242484326 shutdown_connections 2024-09-10T20:56:53.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:53.932+0000 7f6ac4400640 1 -- 172.21.15.6:0/1242484326 wait complete. 2024-09-10T20:56:53.952 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-09-10T20:56:54.144 INFO:teuthology.orchestra.run.smithi006.stdout:{"message":"","return_code":0} 2024-09-10T20:56:54.144 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-10T20:56:54.144 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f9.00000000 symlink 2024-09-10T20:56:54.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.219+0000 7efd1fbfff40 1 Processor -- start 2024-09-10T20:56:54.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.219+0000 7efd1fbfff40 1 -- start start 2024-09-10T20:56:54.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.220+0000 7efd1fbfff40 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e70bb94990 0x55e70bc60160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:54.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.220+0000 7efd1fbfff40 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e70bbdbd90 0x55e70bc5c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:54.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.220+0000 7efd1fbfff40 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e70bbdc170 0x55e70bbbdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:54.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.220+0000 7efd1fbfff40 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55e70bae1c60 con 0x55e70bbdc170 2024-09-10T20:56:54.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.220+0000 7efd1fbfff40 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55e70bb401d0 con 0x55e70bb94990 2024-09-10T20:56:54.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.220+0000 7efd1fbfff40 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x55e70bc68080 con 0x55e70bbdbd90 2024-09-10T20:56:54.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.221+0000 7efd1ce00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e70bb94990 0x55e70bc60160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:54.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.221+0000 7efd1d800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e70bbdc170 0x55e70bbbdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:54.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.221+0000 7efd1d800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e70bbdc170 0x55e70bbbdfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53450/0 (socket says 172.21.15.6:53450) 2024-09-10T20:56:54.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.221+0000 7efd17e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e70bbdbd90 0x55e70bc5c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:54.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.221+0000 7efd1d800640 1 -- 172.21.15.6:0/2752041420 learned_addr learned my addr 172.21.15.6:0/2752041420 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:54.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.221+0000 7efd1d800640 1 -- 172.21.15.6:0/2752041420 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e70bbdbd90 msgr2=0x55e70bc5c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:54.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.221+0000 7efd1d800640 1 --2- 172.21.15.6:0/2752041420 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e70bbdbd90 0x55e70bc5c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:54.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.221+0000 7efd1d800640 1 -- 172.21.15.6:0/2752041420 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e70bb94990 msgr2=0x55e70bc60160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:54.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.221+0000 7efd1d800640 1 --2- 172.21.15.6:0/2752041420 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e70bb94990 0x55e70bc60160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:54.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.221+0000 7efd1d800640 1 -- 172.21.15.6:0/2752041420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e70bbbe500 con 0x55e70bbdc170 2024-09-10T20:56:54.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.221+0000 7efd1d800640 1 --2- 172.21.15.6:0/2752041420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e70bbdc170 0x55e70bbbdfc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7efd1800a550 tx=0x7efd18003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7541beb28998379e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:54.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.222+0000 7efd16a00640 1 -- 172.21.15.6:0/2752041420 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd18064030 con 0x55e70bbdc170 2024-09-10T20:56:54.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.222+0000 7efd16a00640 1 -- 172.21.15.6:0/2752041420 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd18004020 con 0x55e70bbdc170 2024-09-10T20:56:54.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.222+0000 7efd16a00640 1 -- 172.21.15.6:0/2752041420 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd18004270 con 0x55e70bbdc170 2024-09-10T20:56:54.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.222+0000 7efd1fbfff40 1 -- 172.21.15.6:0/2752041420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e70bbdc170 msgr2=0x55e70bbbdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:54.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.222+0000 7efd1fbfff40 1 --2- 172.21.15.6:0/2752041420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e70bbdc170 0x55e70bbbdfc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7efd1800a550 tx=0x7efd18003330 comp rx=0 tx=0).stop 2024-09-10T20:56:54.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.222+0000 7efd1fbfff40 1 -- 172.21.15.6:0/2752041420 shutdown_connections 2024-09-10T20:56:54.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.222+0000 7efd1fbfff40 1 --2- 172.21.15.6:0/2752041420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e70bbdc170 0x55e70bbbdfc0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:54.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.222+0000 7efd1fbfff40 1 --2- 172.21.15.6:0/2752041420 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e70bbdbd90 0x55e70bc5c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:54.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.222+0000 7efd1fbfff40 1 --2- 172.21.15.6:0/2752041420 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e70bb94990 0x55e70bc60160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:54.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.222+0000 7efd1fbfff40 1 -- 172.21.15.6:0/2752041420 >> 172.21.15.6:0/2752041420 conn(0x55e70bb91780 msgr2=0x55e70bbc2360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:54.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.222+0000 7efd1fbfff40 1 -- 172.21.15.6:0/2752041420 shutdown_connections 2024-09-10T20:56:54.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.222+0000 7efd1fbfff40 1 -- 172.21.15.6:0/2752041420 wait complete. 2024-09-10T20:56:54.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.223+0000 7efd1fbfff40 1 Processor -- start 2024-09-10T20:56:54.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.223+0000 7efd1fbfff40 1 -- start start 2024-09-10T20:56:54.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.224+0000 7efd1fbfff40 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e70bb94990 0x55e70bc5b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:54.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.224+0000 7efd1fbfff40 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e70bbdbd90 0x55e70bd016e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:54.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.224+0000 7efd1fbfff40 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e70bbdc170 0x55e70bd01c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:54.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.224+0000 7efd1fbfff40 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55e70bbbfd70 con 0x55e70bbdc170 2024-09-10T20:56:54.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.224+0000 7efd1fbfff40 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55e70bbbfab0 con 0x55e70bb94990 2024-09-10T20:56:54.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.224+0000 7efd1fbfff40 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x55e70bc61f10 con 0x55e70bbdbd90 2024-09-10T20:56:54.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.224+0000 7efd1d800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e70bbdc170 0x55e70bd01c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:54.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.224+0000 7efd1d800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e70bbdc170 0x55e70bd01c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53452/0 (socket says 172.21.15.6:53452) 2024-09-10T20:56:54.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.224+0000 7efd1d800640 1 -- 172.21.15.6:0/1162901526 learned_addr learned my addr 172.21.15.6:0/1162901526 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:54.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.225+0000 7efd1ce00640 1 --2- 172.21.15.6:0/1162901526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e70bb94990 0x55e70bc5b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:54.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.225+0000 7efd17e00640 1 --2- 172.21.15.6:0/1162901526 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e70bbdbd90 0x55e70bd016e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:54.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.225+0000 7efd1d800640 1 -- 172.21.15.6:0/1162901526 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e70bbdbd90 msgr2=0x55e70bd016e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:54.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.225+0000 7efd1d800640 1 --2- 172.21.15.6:0/1162901526 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e70bbdbd90 0x55e70bd016e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:54.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.225+0000 7efd1d800640 1 -- 172.21.15.6:0/1162901526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e70bb94990 msgr2=0x55e70bc5b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:54.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.225+0000 7efd1d800640 1 --2- 172.21.15.6:0/1162901526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e70bb94990 0x55e70bc5b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:54.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.225+0000 7efd1d800640 1 -- 172.21.15.6:0/1162901526 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e70bc5bc90 con 0x55e70bbdc170 2024-09-10T20:56:54.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.225+0000 7efd1d800640 1 --2- 172.21.15.6:0/1162901526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e70bbdc170 0x55e70bd01c20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7efd1800a550 tx=0x7efd1804db30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:54.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.225+0000 7efd15600640 1 -- 172.21.15.6:0/1162901526 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1806d020 con 0x55e70bbdc170 2024-09-10T20:56:54.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.225+0000 7efd15600640 1 -- 172.21.15.6:0/1162901526 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd18060560 con 0x55e70bbdc170 2024-09-10T20:56:54.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.225+0000 7efd1fbfff40 1 -- 172.21.15.6:0/1162901526 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e70bd02460 con 0x55e70bbdc170 2024-09-10T20:56:54.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.225+0000 7efd15600640 1 -- 172.21.15.6:0/1162901526 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd18064040 con 0x55e70bbdc170 2024-09-10T20:56:54.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.226+0000 7efd1fbfff40 1 -- 172.21.15.6:0/1162901526 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e70bcf0ed0 con 0x55e70bbdc170 2024-09-10T20:56:54.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.228+0000 7efd15600640 1 -- 172.21.15.6:0/1162901526 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7efd18060990 con 0x55e70bbdc170 2024-09-10T20:56:54.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.228+0000 7efd15600640 1 --2- 172.21.15.6:0/1162901526 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7efcfc076980 0x7efcfc078e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:54.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.228+0000 7efd15600640 1 -- 172.21.15.6:0/1162901526 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7efd180de450 con 0x55e70bbdc170 2024-09-10T20:56:54.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.229+0000 7efd1fbfff40 1 --2- 172.21.15.6:0/1162901526 >> [v2:172.21.15.6:6808/1129113250,v1:172.21.15.6:6809/1129113250] conn(0x55e70bc5f870 0x55e70bcf2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:54.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.229+0000 7efd1fbfff40 1 -- 172.21.15.6:0/1162901526 --> [v2:172.21.15.6:6808/1129113250,v1:172.21.15.6:6809/1129113250] -- osd_op(unknown.0.0:1 5.36 5:6ee5e2c4:::100000001f9.00000000:head [getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e70bbc11b0 con 0x55e70bc5f870 2024-09-10T20:56:54.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.229+0000 7efd1ce00640 1 --2- 172.21.15.6:0/1162901526 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7efcfc076980 0x7efcfc078e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:54.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.229+0000 7efd17e00640 1 --2- 172.21.15.6:0/1162901526 >> [v2:172.21.15.6:6808/1129113250,v1:172.21.15.6:6809/1129113250] conn(0x55e70bc5f870 0x55e70bcf2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:54.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.229+0000 7efd1ce00640 1 --2- 172.21.15.6:0/1162901526 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7efcfc076980 0x7efcfc078e40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7efd1000c740 tx=0x7efd1000e040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:54.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.230+0000 7efd17e00640 1 --2- 172.21.15.6:0/1162901526 >> [v2:172.21.15.6:6808/1129113250,v1:172.21.15.6:6809/1129113250] conn(0x55e70bc5f870 0x55e70bcf2d80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:54.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.230+0000 7efd17e00640 1 -- 172.21.15.6:0/1162901526 <== osd.1 v2:172.21.15.6:6808/1129113250 1 ==== osd_op_reply(1 100000001f9.00000000 [getxattr (11) out=11b] v0'0 uv1 ondisk = 0) ==== 164+0+11 (crc 0 0 0) 0x7efd080019f0 con 0x55e70bc5f870 2024-09-10T20:56:54.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.230+0000 7efd1fbfff40 1 -- 172.21.15.6:0/1162901526 >> [v2:172.21.15.6:6808/1129113250,v1:172.21.15.6:6809/1129113250] conn(0x55e70bc5f870 msgr2=0x55e70bcf2d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:54.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.230+0000 7efd1fbfff40 1 --2- 172.21.15.6:0/1162901526 >> [v2:172.21.15.6:6808/1129113250,v1:172.21.15.6:6809/1129113250] conn(0x55e70bc5f870 0x55e70bcf2d80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:54.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.230+0000 7efd1fbfff40 1 -- 172.21.15.6:0/1162901526 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7efcfc076980 msgr2=0x7efcfc078e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:54.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.230+0000 7efd1fbfff40 1 --2- 172.21.15.6:0/1162901526 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7efcfc076980 0x7efcfc078e40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7efd1000c740 tx=0x7efd1000e040 comp rx=0 tx=0).stop 2024-09-10T20:56:54.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.230+0000 7efd1fbfff40 1 -- 172.21.15.6:0/1162901526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e70bbdc170 msgr2=0x55e70bd01c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:54.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.230+0000 7efd1fbfff40 1 --2- 172.21.15.6:0/1162901526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e70bbdc170 0x55e70bd01c20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7efd1800a550 tx=0x7efd1804db30 comp rx=0 tx=0).stop 2024-09-10T20:56:54.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.230+0000 7efd1d800640 1 -- 172.21.15.6:0/1162901526 reap_dead start 2024-09-10T20:56:54.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.230+0000 7efd1fbfff40 1 -- 172.21.15.6:0/1162901526 shutdown_connections 2024-09-10T20:56:54.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.230+0000 7efd1fbfff40 1 -- 172.21.15.6:0/1162901526 >> 172.21.15.6:0/1162901526 conn(0x55e70bb91780 msgr2=0x55e70bc62850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:54.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.230+0000 7efd1fbfff40 1 -- 172.21.15.6:0/1162901526 shutdown_connections 2024-09-10T20:56:54.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.230+0000 7efd1fbfff40 1 -- 172.21.15.6:0/1162901526 wait complete. 2024-09-10T20:56:54.240 INFO:teuthology.orchestra.run.smithi006.stdout:./file1 2024-09-10T20:56:54.240 DEBUG:teuthology.orchestra.run.smithi006:> ceph-dencoder type string_wrapper import - decode dump_json 2024-09-10T20:56:54.375 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-10T20:56:54.375 INFO:teuthology.orchestra.run.smithi006.stdout: "s": "./file1" 2024-09-10T20:56:54.375 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-10T20:56:54.375 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:56:54.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:54.382 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent_a) 2024-09-10T20:56:54.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:54.421 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parent_a/alpha) 2024-09-10T20:56:54.501 DEBUG:teuthology.orchestra.run.smithi006:> stdin-killer -- python3 -c ' 2024-09-10T20:56:54.501 DEBUG:teuthology.orchestra.run.smithi006:> import os 2024-09-10T20:56:54.501 DEBUG:teuthology.orchestra.run.smithi006:> import stat 2024-09-10T20:56:54.501 DEBUG:teuthology.orchestra.run.smithi006:> 2024-09-10T20:56:54.502 DEBUG:teuthology.orchestra.run.smithi006:> print(os.stat("/home/ubuntu/cephtest/mnt.0/parent_a/alpha").st_ino) 2024-09-10T20:56:54.502 DEBUG:teuthology.orchestra.run.smithi006:> ' 2024-09-10T20:56:54.642 INFO:teuthology.orchestra.run.smithi006.stdout:1099511628283 2024-09-10T20:56:54.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:56:54.653 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:56:54.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.848+0000 7f134a600640 1 -- 172.21.15.6:0/3839683595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f134415bb30 msgr2=0x7f13440cf340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:54.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.848+0000 7f134a600640 1 --2- 172.21.15.6:0/3839683595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f134415bb30 0x7f13440cf340 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1334005fd0 tx=0x7f133402a5d0 comp rx=0 tx=0).stop 2024-09-10T20:56:54.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.848+0000 7f134a600640 1 -- 172.21.15.6:0/3839683595 shutdown_connections 2024-09-10T20:56:54.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.848+0000 7f134a600640 1 --2- 172.21.15.6:0/3839683595 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f13440caa40 0x7f1344161a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:54.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.848+0000 7f134a600640 1 --2- 172.21.15.6:0/3839683595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f134415bb30 0x7f13440cf340 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:54.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.848+0000 7f134a600640 1 -- 172.21.15.6:0/3839683595 >> 172.21.15.6:0/3839683595 conn(0x7f13440cfa20 msgr2=0x7f13440cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:54.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.848+0000 7f134a600640 1 -- 172.21.15.6:0/3839683595 shutdown_connections 2024-09-10T20:56:54.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.848+0000 7f134a600640 1 -- 172.21.15.6:0/3839683595 wait complete. 2024-09-10T20:56:54.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.850+0000 7f134a600640 1 Processor -- start 2024-09-10T20:56:54.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.850+0000 7f134a600640 1 -- start start 2024-09-10T20:56:54.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.851+0000 7f134a600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13440caa40 0x7f1344161420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:54.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.851+0000 7f134a600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f134415bb30 0x7f13441f58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:54.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.851+0000 7f134a600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1344161f60 0x7f134415a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:54.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.851+0000 7f134a600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f13440cb000 con 0x7f134415bb30 2024-09-10T20:56:54.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.851+0000 7f134a600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f13440aeaa0 con 0x7f13440caa40 2024-09-10T20:56:54.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.851+0000 7f134a600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f134415eb40 con 0x7f1344161f60 2024-09-10T20:56:54.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.851+0000 7f133aa00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f134415bb30 0x7f13441f58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:54.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.851+0000 7f133aa00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f134415bb30 0x7f13441f58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53468/0 (socket says 172.21.15.6:53468) 2024-09-10T20:56:54.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.851+0000 7f133aa00640 1 -- 172.21.15.6:0/3420680834 learned_addr learned my addr 172.21.15.6:0/3420680834 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:54.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.851+0000 7f1343400640 1 --2- 172.21.15.6:0/3420680834 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13440caa40 0x7f1344161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:54.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.851+0000 7f1343e00640 1 --2- 172.21.15.6:0/3420680834 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1344161f60 0x7f134415a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:54.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.852+0000 7f133aa00640 1 -- 172.21.15.6:0/3420680834 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1344161f60 msgr2=0x7f134415a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:54.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.852+0000 7f133aa00640 1 --2- 172.21.15.6:0/3420680834 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1344161f60 0x7f134415a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:54.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.852+0000 7f133aa00640 1 -- 172.21.15.6:0/3420680834 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13440caa40 msgr2=0x7f1344161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:54.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.852+0000 7f133aa00640 1 --2- 172.21.15.6:0/3420680834 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13440caa40 0x7f1344161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:54.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.852+0000 7f133aa00640 1 -- 172.21.15.6:0/3420680834 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13441f84c0 con 0x7f134415bb30 2024-09-10T20:56:54.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.852+0000 7f133aa00640 1 --2- 172.21.15.6:0/3420680834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f134415bb30 0x7f13441f58a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f132c00d7a0 tx=0x7f132c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:54.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.852+0000 7f133be00640 1 -- 172.21.15.6:0/3420680834 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f132c017070 con 0x7f134415bb30 2024-09-10T20:56:54.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.852+0000 7f133be00640 1 -- 172.21.15.6:0/3420680834 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f132c009d20 con 0x7f134415bb30 2024-09-10T20:56:54.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.852+0000 7f133be00640 1 -- 172.21.15.6:0/3420680834 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f132c004280 con 0x7f134415bb30 2024-09-10T20:56:54.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.852+0000 7f134a600640 1 -- 172.21.15.6:0/3420680834 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13441f87a0 con 0x7f134415bb30 2024-09-10T20:56:54.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.852+0000 7f134a600640 1 -- 172.21.15.6:0/3420680834 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13441f8d60 con 0x7f134415bb30 2024-09-10T20:56:54.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.853+0000 7f134a600640 1 -- 172.21.15.6:0/3420680834 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1344069d20 con 0x7f134415bb30 2024-09-10T20:56:54.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.855+0000 7f133be00640 1 -- 172.21.15.6:0/3420680834 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f132c0035f0 con 0x7f134415bb30 2024-09-10T20:56:54.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.855+0000 7f133be00640 1 --2- 172.21.15.6:0/3420680834 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f1320077f70 0x7f132007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:54.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.856+0000 7f133be00640 1 -- 172.21.15.6:0/3420680834 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f132c099ed0 con 0x7f134415bb30 2024-09-10T20:56:54.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.856+0000 7f1343400640 1 --2- 172.21.15.6:0/3420680834 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f1320077f70 0x7f132007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:54.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.857+0000 7f1343400640 1 --2- 172.21.15.6:0/3420680834 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f1320077f70 0x7f132007a430 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1334033000 tx=0x7f1334004730 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:54.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:54.860+0000 7f133be00640 1 -- 172.21.15.6:0/3420680834 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f132c0622e0 con 0x7f134415bb30 2024-09-10T20:56:55.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.092+0000 7f134a600640 1 -- 172.21.15.6:0/3420680834 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f13440d0850 con 0x7f134415bb30 2024-09-10T20:56:55.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.093+0000 7f133be00640 1 -- 172.21.15.6:0/3420680834 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5220 (secure 0 0 0) 0x7f132c066d10 con 0x7f134415bb30 2024-09-10T20:56:55.098 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:56:55.098 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":17,"btime":"2024-09-10T20:56:41:162013+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1675451102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1675451102},{"type":"v1","addr":"172.21.15.6:6834","nonce":1675451102}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4924,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/676153174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":676153174},{"type":"v1","addr":"172.21.15.150:6836","nonce":676153174}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4950,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4072260905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":4072260905},{"type":"v1","addr":"172.21.15.150:6837","nonce":4072260905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:56:37.566072+0000","modified":"2024-09-10T20:56:40.597848+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4956":{"gid":4956,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/1598644433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1598644433},{"type":"v1","addr":"172.21.15.6:6835","nonce":1598644433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4956,"qdb_cluster":[4956]},"id":2}]} 2024-09-10T20:56:55.098 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 17 2024-09-10T20:56:55.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.095+0000 7f134a600640 1 -- 172.21.15.6:0/3420680834 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f1320077f70 msgr2=0x7f132007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:55.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.096+0000 7f134a600640 1 --2- 172.21.15.6:0/3420680834 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f1320077f70 0x7f132007a430 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1334033000 tx=0x7f1334004730 comp rx=0 tx=0).stop 2024-09-10T20:56:55.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.096+0000 7f134a600640 1 -- 172.21.15.6:0/3420680834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f134415bb30 msgr2=0x7f13441f58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:55.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.096+0000 7f134a600640 1 --2- 172.21.15.6:0/3420680834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f134415bb30 0x7f13441f58a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f132c00d7a0 tx=0x7f132c00dc60 comp rx=0 tx=0).stop 2024-09-10T20:56:55.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.096+0000 7f134a600640 1 -- 172.21.15.6:0/3420680834 shutdown_connections 2024-09-10T20:56:55.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.096+0000 7f134a600640 1 --2- 172.21.15.6:0/3420680834 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f1320077f70 0x7f132007a430 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:55.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.096+0000 7f134a600640 1 --2- 172.21.15.6:0/3420680834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f134415bb30 0x7f13441f58a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:55.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.096+0000 7f134a600640 1 --2- 172.21.15.6:0/3420680834 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1344161f60 0x7f134415a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:55.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.096+0000 7f134a600640 1 --2- 172.21.15.6:0/3420680834 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13440caa40 0x7f1344161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:55.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.096+0000 7f134a600640 1 -- 172.21.15.6:0/3420680834 >> 172.21.15.6:0/3420680834 conn(0x7f13440cfa20 msgr2=0x7f134415d420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:55.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.096+0000 7f134a600640 1 -- 172.21.15.6:0/3420680834 shutdown_connections 2024-09-10T20:56:55.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.096+0000 7f134a600640 1 -- 172.21.15.6:0/3420680834 wait complete. 2024-09-10T20:56:55.116 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-09-10T20:56:55.305 INFO:teuthology.orchestra.run.smithi006.stdout:{"message":"","return_code":0} 2024-09-10T20:56:55.305 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-10T20:56:55.306 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001fb.00000000 parent 2024-09-10T20:56:55.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.378+0000 7f081b920f40 1 Processor -- start 2024-09-10T20:56:55.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.378+0000 7f081b920f40 1 -- start start 2024-09-10T20:56:55.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.379+0000 7f081b920f40 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07fc002550 0x55ab70338950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:55.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.379+0000 7f081b920f40 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab7030b230 0x55ab703c5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:55.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.379+0000 7f081b920f40 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ab70309150 0x55ab70309580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:55.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.379+0000 7f081b920f40 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55ab702b91d0 con 0x55ab7030b230 2024-09-10T20:56:55.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.379+0000 7f081b920f40 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55ab702c5f90 con 0x55ab70309150 2024-09-10T20:56:55.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.379+0000 7f081b920f40 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x55ab7025ac60 con 0x7f07fc002550 2024-09-10T20:56:55.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.379+0000 7f0817600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab7030b230 0x55ab703c5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:55.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.379+0000 7f0817600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab7030b230 0x55ab703c5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53482/0 (socket says 172.21.15.6:53482) 2024-09-10T20:56:55.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.379+0000 7f0817600640 1 -- 172.21.15.6:0/1292748981 learned_addr learned my addr 172.21.15.6:0/1292748981 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:55.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.380+0000 7f0818000640 1 --2- 172.21.15.6:0/1292748981 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07fc002550 0x55ab70338950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:55.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.380+0000 7f0818a00640 1 --2- 172.21.15.6:0/1292748981 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ab70309150 0x55ab70309580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:55.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.380+0000 7f0817600640 1 -- 172.21.15.6:0/1292748981 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07fc002550 msgr2=0x55ab70338950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:55.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.380+0000 7f0817600640 1 --2- 172.21.15.6:0/1292748981 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07fc002550 0x55ab70338950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:55.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.380+0000 7f0817600640 1 -- 172.21.15.6:0/1292748981 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ab70309150 msgr2=0x55ab70309580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:55.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.380+0000 7f0817600640 1 --2- 172.21.15.6:0/1292748981 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ab70309150 0x55ab70309580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:55.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.380+0000 7f0817600640 1 -- 172.21.15.6:0/1292748981 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab703de170 con 0x55ab7030b230 2024-09-10T20:56:55.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.380+0000 7f0818000640 1 --2- 172.21.15.6:0/1292748981 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07fc002550 0x55ab70338950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:56:55.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.380+0000 7f0817600640 1 --2- 172.21.15.6:0/1292748981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab7030b230 0x55ab703c5350 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f080400b7c0 tx=0x7f080400bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab3c29a348b52ef3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:55.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.380+0000 7f0816200640 1 -- 172.21.15.6:0/1292748981 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080401a070 con 0x55ab7030b230 2024-09-10T20:56:55.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.380+0000 7f0816200640 1 -- 172.21.15.6:0/1292748981 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f080400ae20 con 0x55ab7030b230 2024-09-10T20:56:55.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.380+0000 7f0816200640 1 -- 172.21.15.6:0/1292748981 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0804008670 con 0x55ab7030b230 2024-09-10T20:56:55.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.381+0000 7f081b920f40 1 -- 172.21.15.6:0/1292748981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab7030b230 msgr2=0x55ab703c5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:55.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.381+0000 7f081b920f40 1 --2- 172.21.15.6:0/1292748981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab7030b230 0x55ab703c5350 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f080400b7c0 tx=0x7f080400bc80 comp rx=0 tx=0).stop 2024-09-10T20:56:55.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.381+0000 7f081b920f40 1 -- 172.21.15.6:0/1292748981 shutdown_connections 2024-09-10T20:56:55.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.381+0000 7f081b920f40 1 --2- 172.21.15.6:0/1292748981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab7030b230 0x55ab703c5350 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:55.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.381+0000 7f081b920f40 1 --2- 172.21.15.6:0/1292748981 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ab70309150 0x55ab70309580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:55.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.381+0000 7f081b920f40 1 --2- 172.21.15.6:0/1292748981 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07fc002550 0x55ab70338950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:55.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.381+0000 7f081b920f40 1 -- 172.21.15.6:0/1292748981 >> 172.21.15.6:0/1292748981 conn(0x55ab7033a870 msgr2=0x55ab70339620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:55.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.381+0000 7f081b920f40 1 -- 172.21.15.6:0/1292748981 shutdown_connections 2024-09-10T20:56:55.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.381+0000 7f081b920f40 1 -- 172.21.15.6:0/1292748981 wait complete. 2024-09-10T20:56:55.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.382+0000 7f081b920f40 1 Processor -- start 2024-09-10T20:56:55.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.382+0000 7f081b920f40 1 -- start start 2024-09-10T20:56:55.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.383+0000 7f081b920f40 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ab70309150 0x55ab703d7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:55.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.383+0000 7f081b920f40 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab7030b230 0x55ab703c3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:55.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.383+0000 7f081b920f40 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07fc002550 0x55ab703e4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:55.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.383+0000 7f081b920f40 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55ab70339e40 con 0x55ab7030b230 2024-09-10T20:56:55.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.383+0000 7f081b920f40 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55ab7033a0e0 con 0x55ab70309150 2024-09-10T20:56:55.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.383+0000 7f081b920f40 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x55ab7030ad10 con 0x7f07fc002550 2024-09-10T20:56:55.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.383+0000 7f0817600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab7030b230 0x55ab703c3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:55.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.383+0000 7f0817600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab7030b230 0x55ab703c3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53484/0 (socket says 172.21.15.6:53484) 2024-09-10T20:56:55.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.383+0000 7f0817600640 1 -- 172.21.15.6:0/98270610 learned_addr learned my addr 172.21.15.6:0/98270610 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:55.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.383+0000 7f0818000640 1 --2- 172.21.15.6:0/98270610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ab70309150 0x55ab703d7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:55.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.383+0000 7f0818a00640 1 --2- 172.21.15.6:0/98270610 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07fc002550 0x55ab703e4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:55.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.383+0000 7f0817600640 1 -- 172.21.15.6:0/98270610 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07fc002550 msgr2=0x55ab703e4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:55.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.383+0000 7f0817600640 1 --2- 172.21.15.6:0/98270610 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07fc002550 0x55ab703e4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:55.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.383+0000 7f0817600640 1 -- 172.21.15.6:0/98270610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ab70309150 msgr2=0x55ab703d7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:55.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.383+0000 7f0817600640 1 --2- 172.21.15.6:0/98270610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ab70309150 0x55ab703d7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:55.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.383+0000 7f0817600640 1 -- 172.21.15.6:0/98270610 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab703d9ca0 con 0x55ab7030b230 2024-09-10T20:56:55.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.384+0000 7f0817600640 1 --2- 172.21.15.6:0/98270610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab7030b230 0x55ab703c3b70 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0804000c00 tx=0x7f0804015a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:55.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.384+0000 7f0814e00640 1 -- 172.21.15.6:0/98270610 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0804023030 con 0x55ab7030b230 2024-09-10T20:56:55.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.384+0000 7f0814e00640 1 -- 172.21.15.6:0/98270610 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0804015c10 con 0x55ab7030b230 2024-09-10T20:56:55.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.384+0000 7f081b920f40 1 -- 172.21.15.6:0/98270610 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ab703d9f80 con 0x55ab7030b230 2024-09-10T20:56:55.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.384+0000 7f0814e00640 1 -- 172.21.15.6:0/98270610 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080401a040 con 0x55ab7030b230 2024-09-10T20:56:55.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.384+0000 7f081b920f40 1 -- 172.21.15.6:0/98270610 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab703c4950 con 0x55ab7030b230 2024-09-10T20:56:55.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.386+0000 7f0814e00640 1 -- 172.21.15.6:0/98270610 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f0804030060 con 0x55ab7030b230 2024-09-10T20:56:55.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.387+0000 7f0814e00640 1 --2- 172.21.15.6:0/98270610 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f07f8076980 0x7f07f8078e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:55.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.387+0000 7f0814e00640 1 -- 172.21.15.6:0/98270610 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f080409a9d0 con 0x55ab7030b230 2024-09-10T20:56:55.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.387+0000 7f081b920f40 1 --2- 172.21.15.6:0/98270610 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x55ab70309580 0x55ab703d6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:55.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.387+0000 7f081b920f40 1 -- 172.21.15.6:0/98270610 --> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] -- osd_op(unknown.0.0:1 5.13 5:ca8fdbba:::100000001fb.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ab703d6fb0 con 0x55ab70309580 2024-09-10T20:56:55.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.388+0000 7f0818000640 1 --2- 172.21.15.6:0/98270610 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f07f8076980 0x7f07f8078e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:55.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.388+0000 7f0818a00640 1 --2- 172.21.15.6:0/98270610 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x55ab70309580 0x55ab703d6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:55.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.388+0000 7f0818a00640 1 --2- 172.21.15.6:0/98270610 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x55ab70309580 0x55ab703d6a70 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:55.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.388+0000 7f0818000640 1 --2- 172.21.15.6:0/98270610 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f07f8076980 0x7f07f8078e40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0808056000 tx=0x7f080804f070 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:55.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.389+0000 7f0818a00640 1 -- 172.21.15.6:0/98270610 <== osd.3 v2:172.21.15.6:6816/3911674247 1 ==== osd_op_reply(1 100000001fb.00000000 [getxattr (95) out=95b] v0'0 uv1 ondisk = 0) ==== 164+0+95 (crc 0 0 0) 0x7f0810008a50 con 0x55ab70309580 2024-09-10T20:56:55.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.389+0000 7f081b920f40 1 -- 172.21.15.6:0/98270610 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x55ab70309580 msgr2=0x55ab703d6a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:55.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.389+0000 7f081b920f40 1 --2- 172.21.15.6:0/98270610 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x55ab70309580 0x55ab703d6a70 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:55.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.389+0000 7f081b920f40 1 -- 172.21.15.6:0/98270610 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f07f8076980 msgr2=0x7f07f8078e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:55.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.389+0000 7f081b920f40 1 --2- 172.21.15.6:0/98270610 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f07f8076980 0x7f07f8078e40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0808056000 tx=0x7f080804f070 comp rx=0 tx=0).stop 2024-09-10T20:56:55.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.389+0000 7f081b920f40 1 -- 172.21.15.6:0/98270610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab7030b230 msgr2=0x55ab703c3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:55.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.389+0000 7f081b920f40 1 --2- 172.21.15.6:0/98270610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab7030b230 0x55ab703c3b70 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0804000c00 tx=0x7f0804015a20 comp rx=0 tx=0).stop 2024-09-10T20:56:55.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.389+0000 7f0818a00640 1 -- 172.21.15.6:0/98270610 reap_dead start 2024-09-10T20:56:55.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.389+0000 7f081b920f40 1 -- 172.21.15.6:0/98270610 shutdown_connections 2024-09-10T20:56:55.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.389+0000 7f081b920f40 1 -- 172.21.15.6:0/98270610 >> 172.21.15.6:0/98270610 conn(0x55ab7033a870 msgr2=0x55ab70339450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:55.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.389+0000 7f081b920f40 1 -- 172.21.15.6:0/98270610 shutdown_connections 2024-09-10T20:56:55.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.389+0000 7f081b920f40 1 -- 172.21.15.6:0/98270610 wait complete. 2024-09-10T20:56:55.398 INFO:teuthology.orchestra.run.smithi006.stdout:Y��alphaparent_a 2024-09-10T20:56:55.398 DEBUG:teuthology.orchestra.run.smithi006:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-09-10T20:56:55.479 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-10T20:56:55.479 INFO:teuthology.orchestra.run.smithi006.stdout: "ino": 1099511628283, 2024-09-10T20:56:55.479 INFO:teuthology.orchestra.run.smithi006.stdout: "ancestors": [ 2024-09-10T20:56:55.479 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-10T20:56:55.479 INFO:teuthology.orchestra.run.smithi006.stdout: "dirino": 1099511628282, 2024-09-10T20:56:55.479 INFO:teuthology.orchestra.run.smithi006.stdout: "dname": "alpha", 2024-09-10T20:56:55.479 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 2 2024-09-10T20:56:55.479 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-10T20:56:55.479 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-10T20:56:55.480 INFO:teuthology.orchestra.run.smithi006.stdout: "dirino": 1, 2024-09-10T20:56:55.480 INFO:teuthology.orchestra.run.smithi006.stdout: "dname": "parent_a", 2024-09-10T20:56:55.480 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 18 2024-09-10T20:56:55.480 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-10T20:56:55.480 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-10T20:56:55.480 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 5, 2024-09-10T20:56:55.480 INFO:teuthology.orchestra.run.smithi006.stdout: "old_pools": [] 2024-09-10T20:56:55.480 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-10T20:56:55.480 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:56:55.486 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001fb.00000000 layout 2024-09-10T20:56:55.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.599+0000 7f5dd9b87f40 1 Processor -- start 2024-09-10T20:56:55.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.599+0000 7f5dd9b87f40 1 -- start start 2024-09-10T20:56:55.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.600+0000 7f5dd9b87f40 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55cc26e38650 0x55cc26f0a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:55.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.600+0000 7f5dd9b87f40 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cc26e68b70 0x55cc26f09240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:55.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.600+0000 7f5dd9b87f40 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cc26f0f1e0 0x55cc26f0c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:55.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.600+0000 7f5dd9b87f40 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55cc26d87c60 con 0x55cc26f0f1e0 2024-09-10T20:56:55.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.600+0000 7f5dd9b87f40 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55cc26de61d0 con 0x55cc26e68b70 2024-09-10T20:56:55.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.600+0000 7f5dd9b87f40 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x55cc26e840a0 con 0x55cc26e38650 2024-09-10T20:56:55.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.600+0000 7f5dd7800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cc26f0f1e0 0x55cc26f0c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:55.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.600+0000 7f5dd7800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cc26f0f1e0 0x55cc26f0c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53498/0 (socket says 172.21.15.6:53498) 2024-09-10T20:56:55.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.600+0000 7f5dd7800640 1 -- 172.21.15.6:0/1231105125 learned_addr learned my addr 172.21.15.6:0/1231105125 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:55.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.600+0000 7f5dd6400640 1 --2- 172.21.15.6:0/1231105125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cc26e68b70 0x55cc26f09240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:55.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.600+0000 7f5dd6e00640 1 --2- 172.21.15.6:0/1231105125 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55cc26e38650 0x55cc26f0a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:55.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.600+0000 7f5dd7800640 1 -- 172.21.15.6:0/1231105125 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55cc26e38650 msgr2=0x55cc26f0a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:55.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.600+0000 7f5dd7800640 1 --2- 172.21.15.6:0/1231105125 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55cc26e38650 0x55cc26f0a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:55.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.600+0000 7f5dd7800640 1 -- 172.21.15.6:0/1231105125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cc26e68b70 msgr2=0x55cc26f09240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:55.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.600+0000 7f5dd7800640 1 --2- 172.21.15.6:0/1231105125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cc26e68b70 0x55cc26f09240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:55.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.600+0000 7f5dd7800640 1 -- 172.21.15.6:0/1231105125 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc26f0ab00 con 0x55cc26f0f1e0 2024-09-10T20:56:55.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.600+0000 7f5dd6e00640 1 --2- 172.21.15.6:0/1231105125 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55cc26e38650 0x55cc26f0a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:56:55.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.601+0000 7f5dd7800640 1 --2- 172.21.15.6:0/1231105125 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cc26f0f1e0 0x55cc26f0c7c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5dd000a850 tx=0x7f5dd000ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26d3ebe12af6fd2a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:55.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.601+0000 7f5dd5000640 1 -- 172.21.15.6:0/1231105125 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd0004220 con 0x55cc26f0f1e0 2024-09-10T20:56:55.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.601+0000 7f5dd5000640 1 -- 172.21.15.6:0/1231105125 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5dd000d930 con 0x55cc26f0f1e0 2024-09-10T20:56:55.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.601+0000 7f5dd5000640 1 -- 172.21.15.6:0/1231105125 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd000dd80 con 0x55cc26f0f1e0 2024-09-10T20:56:55.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.601+0000 7f5dd9b87f40 1 -- 172.21.15.6:0/1231105125 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cc26f0f1e0 msgr2=0x55cc26f0c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:55.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.601+0000 7f5dd9b87f40 1 --2- 172.21.15.6:0/1231105125 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cc26f0f1e0 0x55cc26f0c7c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5dd000a850 tx=0x7f5dd000ad10 comp rx=0 tx=0).stop 2024-09-10T20:56:55.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.602+0000 7f5dd9b87f40 1 -- 172.21.15.6:0/1231105125 shutdown_connections 2024-09-10T20:56:55.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.602+0000 7f5dd9b87f40 1 --2- 172.21.15.6:0/1231105125 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cc26f0f1e0 0x55cc26f0c7c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:55.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.602+0000 7f5dd9b87f40 1 --2- 172.21.15.6:0/1231105125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cc26e68b70 0x55cc26f09240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:55.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.602+0000 7f5dd9b87f40 1 --2- 172.21.15.6:0/1231105125 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55cc26e38650 0x55cc26f0a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:55.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.602+0000 7f5dd9b87f40 1 -- 172.21.15.6:0/1231105125 >> 172.21.15.6:0/1231105125 conn(0x55cc26e67870 msgr2=0x55cc26e6a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:55.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.602+0000 7f5dd9b87f40 1 -- 172.21.15.6:0/1231105125 shutdown_connections 2024-09-10T20:56:55.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.602+0000 7f5dd9b87f40 1 -- 172.21.15.6:0/1231105125 wait complete. 2024-09-10T20:56:55.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.602+0000 7f5dd9b87f40 1 Processor -- start 2024-09-10T20:56:55.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.603+0000 7f5dd9b87f40 1 -- start start 2024-09-10T20:56:55.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.603+0000 7f5dd9b87f40 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cc26e38650 0x55cc26efd530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:55.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.603+0000 7f5dd9b87f40 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55cc26e68b70 0x55cc26f09750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:55.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.603+0000 7f5dd9b87f40 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cc26f0f1e0 0x55cc26f112c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:55.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.603+0000 7f5dd9b87f40 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55cc26efeaa0 con 0x55cc26e38650 2024-09-10T20:56:55.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.604+0000 7f5dd9b87f40 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55cc26e37cc0 con 0x55cc26f0f1e0 2024-09-10T20:56:55.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.604+0000 7f5dd9b87f40 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x55cc26f99900 con 0x55cc26e68b70 2024-09-10T20:56:55.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.604+0000 7f5dd6e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cc26e38650 0x55cc26efd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:55.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.604+0000 7f5dd6e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cc26e38650 0x55cc26efd530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53506/0 (socket says 172.21.15.6:53506) 2024-09-10T20:56:55.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.604+0000 7f5dd6e00640 1 -- 172.21.15.6:0/162196081 learned_addr learned my addr 172.21.15.6:0/162196081 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:55.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.604+0000 7f5dd6400640 1 --2- 172.21.15.6:0/162196081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55cc26e68b70 0x55cc26f09750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:55.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.604+0000 7f5dd6e00640 1 -- 172.21.15.6:0/162196081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55cc26e68b70 msgr2=0x55cc26f09750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:55.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.604+0000 7f5dd6e00640 1 --2- 172.21.15.6:0/162196081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55cc26e68b70 0x55cc26f09750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:55.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.604+0000 7f5dd6e00640 1 -- 172.21.15.6:0/162196081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cc26f0f1e0 msgr2=0x55cc26f112c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:55.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.604+0000 7f5dd7800640 1 --2- 172.21.15.6:0/162196081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cc26f0f1e0 0x55cc26f112c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:55.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.604+0000 7f5dd6e00640 1 --2- 172.21.15.6:0/162196081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cc26f0f1e0 0x55cc26f112c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:55.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.604+0000 7f5dd6e00640 1 -- 172.21.15.6:0/162196081 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc26f11a60 con 0x55cc26e38650 2024-09-10T20:56:55.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.604+0000 7f5dd7800640 1 --2- 172.21.15.6:0/162196081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cc26f0f1e0 0x55cc26f112c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:56:55.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.604+0000 7f5dd6e00640 1 --2- 172.21.15.6:0/162196081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cc26e38650 0x55cc26efd530 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5dc800df70 tx=0x7f5dc800b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:55.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.605+0000 7f5dcf400640 1 -- 172.21.15.6:0/162196081 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc800be60 con 0x55cc26e38650 2024-09-10T20:56:55.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.605+0000 7f5dcf400640 1 -- 172.21.15.6:0/162196081 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5dc8016070 con 0x55cc26e38650 2024-09-10T20:56:55.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.605+0000 7f5dcf400640 1 -- 172.21.15.6:0/162196081 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc80116c0 con 0x55cc26e38650 2024-09-10T20:56:55.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.605+0000 7f5dd9b87f40 1 -- 172.21.15.6:0/162196081 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cc26f11d40 con 0x55cc26e38650 2024-09-10T20:56:55.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.605+0000 7f5dd9b87f40 1 -- 172.21.15.6:0/162196081 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc26f99fe0 con 0x55cc26e38650 2024-09-10T20:56:55.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.607+0000 7f5dcf400640 1 -- 172.21.15.6:0/162196081 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5dc8011860 con 0x55cc26e38650 2024-09-10T20:56:55.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.608+0000 7f5dcf400640 1 --2- 172.21.15.6:0/162196081 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5db8076980 0x7f5db8078e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:55.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.608+0000 7f5dcf400640 1 -- 172.21.15.6:0/162196081 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f5dc8098950 con 0x55cc26e38650 2024-09-10T20:56:55.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.608+0000 7f5dd9b87f40 1 --2- 172.21.15.6:0/162196081 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x55cc26f9a7e0 0x55cc26f9ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:55.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.608+0000 7f5dd6400640 1 --2- 172.21.15.6:0/162196081 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5db8076980 0x7f5db8078e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:55.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.608+0000 7f5dd9b87f40 1 -- 172.21.15.6:0/162196081 --> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] -- osd_op(unknown.0.0:1 5.13 5:ca8fdbba:::100000001fb.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55cc26f9b1a0 con 0x55cc26f9a7e0 2024-09-10T20:56:55.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.608+0000 7f5dd7800640 1 --2- 172.21.15.6:0/162196081 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x55cc26f9a7e0 0x55cc26f9ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:55.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.609+0000 7f5dd6400640 1 --2- 172.21.15.6:0/162196081 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5db8076980 0x7f5db8078e40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4055000 tx=0x7f5dc4003020 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:55.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.609+0000 7f5dd7800640 1 --2- 172.21.15.6:0/162196081 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x55cc26f9a7e0 0x55cc26f9ac60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:55.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.609+0000 7f5dd7800640 1 -- 172.21.15.6:0/162196081 <== osd.3 v2:172.21.15.6:6816/3911674247 1 ==== osd_op_reply(1 100000001fb.00000000 [getxattr (30) out=30b] v0'0 uv1 ondisk = 0) ==== 164+0+30 (crc 0 0 0) 0x7f5dd000b040 con 0x55cc26f9a7e0 2024-09-10T20:56:55.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.609+0000 7f5dd9b87f40 1 -- 172.21.15.6:0/162196081 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x55cc26f9a7e0 msgr2=0x55cc26f9ac60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:55.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.609+0000 7f5dd9b87f40 1 --2- 172.21.15.6:0/162196081 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x55cc26f9a7e0 0x55cc26f9ac60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:55.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.609+0000 7f5dd9b87f40 1 -- 172.21.15.6:0/162196081 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5db8076980 msgr2=0x7f5db8078e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:55.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.609+0000 7f5dd9b87f40 1 --2- 172.21.15.6:0/162196081 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5db8076980 0x7f5db8078e40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4055000 tx=0x7f5dc4003020 comp rx=0 tx=0).stop 2024-09-10T20:56:55.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.609+0000 7f5dd9b87f40 1 -- 172.21.15.6:0/162196081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cc26e38650 msgr2=0x55cc26efd530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:55.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.609+0000 7f5dd9b87f40 1 --2- 172.21.15.6:0/162196081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cc26e38650 0x55cc26efd530 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5dc800df70 tx=0x7f5dc800b5b0 comp rx=0 tx=0).stop 2024-09-10T20:56:55.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.610+0000 7f5dd7800640 1 -- 172.21.15.6:0/162196081 reap_dead start 2024-09-10T20:56:55.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.610+0000 7f5dd9b87f40 1 -- 172.21.15.6:0/162196081 shutdown_connections 2024-09-10T20:56:55.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.610+0000 7f5dd9b87f40 1 -- 172.21.15.6:0/162196081 >> 172.21.15.6:0/162196081 conn(0x55cc26e67870 msgr2=0x55cc26e6a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:55.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.610+0000 7f5dd9b87f40 1 -- 172.21.15.6:0/162196081 shutdown_connections 2024-09-10T20:56:55.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:55.610+0000 7f5dd9b87f40 1 -- 172.21.15.6:0/162196081 wait complete. 2024-09-10T20:56:55.618 INFO:teuthology.orchestra.run.smithi006.stdout:@@ 2024-09-10T20:56:55.619 DEBUG:teuthology.orchestra.run.smithi006:> ceph-dencoder type file_layout_t import - decode dump_json 2024-09-10T20:56:55.700 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-10T20:56:55.700 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_unit": 4194304, 2024-09-10T20:56:55.701 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_count": 1, 2024-09-10T20:56:55.701 INFO:teuthology.orchestra.run.smithi006.stdout: "object_size": 4194304, 2024-09-10T20:56:55.701 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_id": 5, 2024-09-10T20:56:55.701 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_ns": "" 2024-09-10T20:56:55.701 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-10T20:56:55.701 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:56:55.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:55.706 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent_b) 2024-09-10T20:56:55.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:55.784 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec mv parent_a/alpha parent_b/alpha) 2024-09-10T20:56:55.868 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:56:56.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.066+0000 7fbc89800640 1 -- 172.21.15.6:0/2981270593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc68004800 msgr2=0x7fbc68004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:56.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.066+0000 7fbc89800640 1 --2- 172.21.15.6:0/2981270593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc68004800 0x7fbc68004c80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c009b20 tx=0x7fbc68005830 comp rx=0 tx=0).stop 2024-09-10T20:56:56.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.067+0000 7fbc89800640 1 -- 172.21.15.6:0/2981270593 shutdown_connections 2024-09-10T20:56:56.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.067+0000 7fbc89800640 1 --2- 172.21.15.6:0/2981270593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc68004800 0x7fbc68004c80 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:56.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.067+0000 7fbc89800640 1 -- 172.21.15.6:0/2981270593 >> 172.21.15.6:0/2981270593 conn(0x7fbc840cfa20 msgr2=0x7fbc840cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:56.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.067+0000 7fbc89800640 1 -- 172.21.15.6:0/2981270593 shutdown_connections 2024-09-10T20:56:56.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.067+0000 7fbc89800640 1 -- 172.21.15.6:0/2981270593 wait complete. 2024-09-10T20:56:56.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.068+0000 7fbc89800640 1 Processor -- start 2024-09-10T20:56:56.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.068+0000 7fbc89800640 1 -- start start 2024-09-10T20:56:56.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.069+0000 7fbc89800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc68004800 0x7fbc840c5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:56.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.069+0000 7fbc89800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc840c6af0 0x7fbc84154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:56.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.069+0000 7fbc89800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc840c3dd0 0x7fbc840c4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:56.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.069+0000 7fbc89800640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbc84074740 con 0x7fbc840c6af0 2024-09-10T20:56:56.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.069+0000 7fbc89800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbc840745c0 con 0x7fbc68004800 2024-09-10T20:56:56.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.069+0000 7fbc89800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fbc8406e7e0 con 0x7fbc840c3dd0 2024-09-10T20:56:56.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.070+0000 7fbc7a000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc840c6af0 0x7fbc84154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:56.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.070+0000 7fbc7a000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc840c6af0 0x7fbc84154fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53524/0 (socket says 172.21.15.6:53524) 2024-09-10T20:56:56.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.070+0000 7fbc7a000640 1 -- 172.21.15.6:0/1178134493 learned_addr learned my addr 172.21.15.6:0/1178134493 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:56.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.070+0000 7fbc82a00640 1 --2- 172.21.15.6:0/1178134493 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc68004800 0x7fbc840c5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:56.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.070+0000 7fbc83400640 1 --2- 172.21.15.6:0/1178134493 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc840c3dd0 0x7fbc840c4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:56.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.070+0000 7fbc7a000640 1 -- 172.21.15.6:0/1178134493 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc840c3dd0 msgr2=0x7fbc840c4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:56.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.070+0000 7fbc7a000640 1 --2- 172.21.15.6:0/1178134493 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc840c3dd0 0x7fbc840c4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:56.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.070+0000 7fbc7a000640 1 -- 172.21.15.6:0/1178134493 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc68004800 msgr2=0x7fbc840c5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:56.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.070+0000 7fbc7a000640 1 --2- 172.21.15.6:0/1178134493 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc68004800 0x7fbc840c5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:56.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.070+0000 7fbc7a000640 1 -- 172.21.15.6:0/1178134493 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc840c72b0 con 0x7fbc840c6af0 2024-09-10T20:56:56.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.071+0000 7fbc7a000640 1 --2- 172.21.15.6:0/1178134493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc840c6af0 0x7fbc84154fd0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c009c40 tx=0x7fbc6c033650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:56.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.071+0000 7fbc7b400640 1 -- 172.21.15.6:0/1178134493 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c038040 con 0x7fbc840c6af0 2024-09-10T20:56:56.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.071+0000 7fbc7b400640 1 -- 172.21.15.6:0/1178134493 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbc6c004020 con 0x7fbc840c6af0 2024-09-10T20:56:56.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.071+0000 7fbc89800640 1 -- 172.21.15.6:0/1178134493 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc840c7590 con 0x7fbc840c6af0 2024-09-10T20:56:56.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.071+0000 7fbc7b400640 1 -- 172.21.15.6:0/1178134493 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c004450 con 0x7fbc840c6af0 2024-09-10T20:56:56.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.071+0000 7fbc89800640 1 -- 172.21.15.6:0/1178134493 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc840c7b50 con 0x7fbc840c6af0 2024-09-10T20:56:56.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.072+0000 7fbc89800640 1 -- 172.21.15.6:0/1178134493 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc840cdba0 con 0x7fbc840c6af0 2024-09-10T20:56:56.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.073+0000 7fbc7b400640 1 -- 172.21.15.6:0/1178134493 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fbc6c03b030 con 0x7fbc840c6af0 2024-09-10T20:56:56.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.074+0000 7fbc7b400640 1 --2- 172.21.15.6:0/1178134493 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbc60077fa0 0x7fbc6007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:56.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.074+0000 7fbc7b400640 1 -- 172.21.15.6:0/1178134493 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fbc6c0ba380 con 0x7fbc840c6af0 2024-09-10T20:56:56.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.075+0000 7fbc82a00640 1 --2- 172.21.15.6:0/1178134493 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbc60077fa0 0x7fbc6007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:56.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.075+0000 7fbc82a00640 1 --2- 172.21.15.6:0/1178134493 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbc60077fa0 0x7fbc6007a460 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbc8406b930 tx=0x7fbc74006720 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:56.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.078+0000 7fbc7b400640 1 -- 172.21.15.6:0/1178134493 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fbc6c082790 con 0x7fbc840c6af0 2024-09-10T20:56:56.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.310+0000 7fbc89800640 1 -- 172.21.15.6:0/1178134493 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbc84069d20 con 0x7fbc840c6af0 2024-09-10T20:56:56.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.310+0000 7fbc7b400640 1 -- 172.21.15.6:0/1178134493 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5220 (secure 0 0 0) 0x7fbc6c0871c0 con 0x7fbc840c6af0 2024-09-10T20:56:56.315 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:56:56.315 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":17,"btime":"2024-09-10T20:56:41:162013+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1675451102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1675451102},{"type":"v1","addr":"172.21.15.6:6834","nonce":1675451102}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4924,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/676153174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":676153174},{"type":"v1","addr":"172.21.15.150:6836","nonce":676153174}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4950,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4072260905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":4072260905},{"type":"v1","addr":"172.21.15.150:6837","nonce":4072260905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:56:37.566072+0000","modified":"2024-09-10T20:56:40.597848+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4956":{"gid":4956,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/1598644433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1598644433},{"type":"v1","addr":"172.21.15.6:6835","nonce":1598644433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4956,"qdb_cluster":[4956]},"id":2}]} 2024-09-10T20:56:56.316 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 17 2024-09-10T20:56:56.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.313+0000 7fbc89800640 1 -- 172.21.15.6:0/1178134493 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbc60077fa0 msgr2=0x7fbc6007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:56.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.313+0000 7fbc89800640 1 --2- 172.21.15.6:0/1178134493 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbc60077fa0 0x7fbc6007a460 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbc8406b930 tx=0x7fbc74006720 comp rx=0 tx=0).stop 2024-09-10T20:56:56.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.313+0000 7fbc89800640 1 -- 172.21.15.6:0/1178134493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc840c6af0 msgr2=0x7fbc84154fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:56.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.313+0000 7fbc89800640 1 --2- 172.21.15.6:0/1178134493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc840c6af0 0x7fbc84154fd0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c009c40 tx=0x7fbc6c033650 comp rx=0 tx=0).stop 2024-09-10T20:56:56.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.313+0000 7fbc89800640 1 -- 172.21.15.6:0/1178134493 shutdown_connections 2024-09-10T20:56:56.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.313+0000 7fbc89800640 1 --2- 172.21.15.6:0/1178134493 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbc60077fa0 0x7fbc6007a460 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:56.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.313+0000 7fbc89800640 1 --2- 172.21.15.6:0/1178134493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc840c6af0 0x7fbc84154fd0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:56.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.313+0000 7fbc89800640 1 --2- 172.21.15.6:0/1178134493 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc840c3dd0 0x7fbc840c4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:56.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.313+0000 7fbc89800640 1 --2- 172.21.15.6:0/1178134493 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc68004800 0x7fbc840c5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:56.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.313+0000 7fbc89800640 1 -- 172.21.15.6:0/1178134493 >> 172.21.15.6:0/1178134493 conn(0x7fbc840cfa20 msgr2=0x7fbc840ce5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:56.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.313+0000 7fbc89800640 1 -- 172.21.15.6:0/1178134493 shutdown_connections 2024-09-10T20:56:56.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.313+0000 7fbc89800640 1 -- 172.21.15.6:0/1178134493 wait complete. 2024-09-10T20:56:56.334 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-09-10T20:56:56.516 INFO:teuthology.orchestra.run.smithi006.stdout:{"message":"","return_code":0} 2024-09-10T20:56:56.517 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-10T20:56:56.517 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001fb.00000000 parent 2024-09-10T20:56:56.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.588+0000 7f4e55ce6f40 1 Processor -- start 2024-09-10T20:56:56.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.589+0000 7f4e55ce6f40 1 -- start start 2024-09-10T20:56:56.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.589+0000 7f4e55ce6f40 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0f1038480 0x55e0f10c4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:56.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.589+0000 7f4e55ce6f40 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0f1038860 0x55e0f1035e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:56.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.589+0000 7f4e55ce6f40 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e0f10e0400 0x55e0f1009b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:56.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.589+0000 7f4e55ce6f40 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55e0f0f57c60 con 0x55e0f1038480 2024-09-10T20:56:56.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.589+0000 7f4e55ce6f40 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55e0f0fb61d0 con 0x55e0f1038860 2024-09-10T20:56:56.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.589+0000 7f4e55ce6f40 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x55e0f1051110 con 0x55e0f10e0400 2024-09-10T20:56:56.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.590+0000 7f4e52e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0f1038480 0x55e0f10c4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:56.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.590+0000 7f4e52e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0f1038480 0x55e0f10c4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53542/0 (socket says 172.21.15.6:53542) 2024-09-10T20:56:56.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.590+0000 7f4e52e00640 1 -- 172.21.15.6:0/115455541 learned_addr learned my addr 172.21.15.6:0/115455541 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:56.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.590+0000 7f4e52e00640 1 -- 172.21.15.6:0/115455541 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e0f10e0400 msgr2=0x55e0f1009b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:56.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.590+0000 7f4e52e00640 1 --2- 172.21.15.6:0/115455541 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e0f10e0400 0x55e0f1009b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:56.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.590+0000 7f4e52e00640 1 -- 172.21.15.6:0/115455541 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0f1038860 msgr2=0x55e0f1035e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:56.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.590+0000 7f4e52400640 1 --2- 172.21.15.6:0/115455541 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0f1038860 0x55e0f1035e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:56.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.590+0000 7f4e52e00640 1 --2- 172.21.15.6:0/115455541 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0f1038860 0x55e0f1035e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:56.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.590+0000 7f4e52e00640 1 -- 172.21.15.6:0/115455541 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0f1029e00 con 0x55e0f1038480 2024-09-10T20:56:56.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.590+0000 7f4e52400640 1 --2- 172.21.15.6:0/115455541 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0f1038860 0x55e0f1035e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:56:56.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.590+0000 7f4e52e00640 1 --2- 172.21.15.6:0/115455541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0f1038480 0x55e0f10c4660 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4e44001dc0 tx=0x7f4e4400b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=828091f783de2973 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:56.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.590+0000 7f4e51000640 1 -- 172.21.15.6:0/115455541 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e4400bdb0 con 0x55e0f1038480 2024-09-10T20:56:56.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.591+0000 7f4e51000640 1 -- 172.21.15.6:0/115455541 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4e4400f400 con 0x55e0f1038480 2024-09-10T20:56:56.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.591+0000 7f4e51000640 1 -- 172.21.15.6:0/115455541 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e4400f890 con 0x55e0f1038480 2024-09-10T20:56:56.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.591+0000 7f4e55ce6f40 1 -- 172.21.15.6:0/115455541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0f1038480 msgr2=0x55e0f10c4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:56.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.591+0000 7f4e55ce6f40 1 --2- 172.21.15.6:0/115455541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0f1038480 0x55e0f10c4660 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4e44001dc0 tx=0x7f4e4400b5b0 comp rx=0 tx=0).stop 2024-09-10T20:56:56.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.591+0000 7f4e55ce6f40 1 -- 172.21.15.6:0/115455541 shutdown_connections 2024-09-10T20:56:56.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.591+0000 7f4e55ce6f40 1 --2- 172.21.15.6:0/115455541 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e0f10e0400 0x55e0f1009b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:56.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.591+0000 7f4e55ce6f40 1 --2- 172.21.15.6:0/115455541 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0f1038860 0x55e0f1035e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:56.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.591+0000 7f4e55ce6f40 1 --2- 172.21.15.6:0/115455541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0f1038480 0x55e0f10c4660 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:56.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.591+0000 7f4e55ce6f40 1 -- 172.21.15.6:0/115455541 >> 172.21.15.6:0/115455541 conn(0x55e0f1007780 msgr2=0x55e0f10e21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:56.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.591+0000 7f4e55ce6f40 1 -- 172.21.15.6:0/115455541 shutdown_connections 2024-09-10T20:56:56.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.591+0000 7f4e55ce6f40 1 -- 172.21.15.6:0/115455541 wait complete. 2024-09-10T20:56:56.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.592+0000 7f4e55ce6f40 1 Processor -- start 2024-09-10T20:56:56.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.592+0000 7f4e55ce6f40 1 -- start start 2024-09-10T20:56:56.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.593+0000 7f4e55ce6f40 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0f1038480 0x55e0f10c3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:56.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.593+0000 7f4e55ce6f40 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e0f1038860 0x55e0f10c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:56.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.593+0000 7f4e55ce6f40 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0f10e0400 0x55e0f1178000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:56.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.593+0000 7f4e55ce6f40 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55e0f10371e0 con 0x55e0f1038480 2024-09-10T20:56:56.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.593+0000 7f4e55ce6f40 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55e0f10374c0 con 0x55e0f10e0400 2024-09-10T20:56:56.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.593+0000 7f4e55ce6f40 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x55e0f100b090 con 0x55e0f1038860 2024-09-10T20:56:56.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.593+0000 7f4e52e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0f1038480 0x55e0f10c3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:56.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.593+0000 7f4e52e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0f1038480 0x55e0f10c3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53550/0 (socket says 172.21.15.6:53550) 2024-09-10T20:56:56.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.593+0000 7f4e52e00640 1 -- 172.21.15.6:0/3747995104 learned_addr learned my addr 172.21.15.6:0/3747995104 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:56.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.593+0000 7f4e52400640 1 --2- 172.21.15.6:0/3747995104 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e0f1038860 0x55e0f10c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:56.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.593+0000 7f4e53800640 1 --2- 172.21.15.6:0/3747995104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0f10e0400 0x55e0f1178000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:56.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.594+0000 7f4e52e00640 1 -- 172.21.15.6:0/3747995104 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e0f1038860 msgr2=0x55e0f10c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:56.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.594+0000 7f4e52e00640 1 --2- 172.21.15.6:0/3747995104 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e0f1038860 0x55e0f10c39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:56.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.594+0000 7f4e52e00640 1 -- 172.21.15.6:0/3747995104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0f10e0400 msgr2=0x55e0f1178000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:56.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.594+0000 7f4e52e00640 1 --2- 172.21.15.6:0/3747995104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0f10e0400 0x55e0f1178000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:56.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.594+0000 7f4e52e00640 1 -- 172.21.15.6:0/3747995104 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0f10c48d0 con 0x55e0f1038480 2024-09-10T20:56:56.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.594+0000 7f4e53800640 1 --2- 172.21.15.6:0/3747995104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0f10e0400 0x55e0f1178000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:56:56.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.594+0000 7f4e52e00640 1 --2- 172.21.15.6:0/3747995104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0f1038480 0x55e0f10c3470 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x55e0f1009650 tx=0x7f4e4400ff30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:56.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.594+0000 7f4e4b400640 1 -- 172.21.15.6:0/3747995104 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e4401f070 con 0x55e0f1038480 2024-09-10T20:56:56.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.594+0000 7f4e4b400640 1 -- 172.21.15.6:0/3747995104 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4e4401b430 con 0x55e0f1038480 2024-09-10T20:56:56.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.594+0000 7f4e4b400640 1 -- 172.21.15.6:0/3747995104 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e4401b8c0 con 0x55e0f1038480 2024-09-10T20:56:56.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.594+0000 7f4e55ce6f40 1 -- 172.21.15.6:0/3747995104 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e0f11770f0 con 0x55e0f1038480 2024-09-10T20:56:56.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.594+0000 7f4e55ce6f40 1 -- 172.21.15.6:0/3747995104 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0f11776b0 con 0x55e0f1038480 2024-09-10T20:56:56.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.596+0000 7f4e4b400640 1 -- 172.21.15.6:0/3747995104 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4e4401ba60 con 0x55e0f1038480 2024-09-10T20:56:56.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.597+0000 7f4e4b400640 1 --2- 172.21.15.6:0/3747995104 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4e34076950 0x7f4e34078e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:56.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.597+0000 7f4e4b400640 1 -- 172.21.15.6:0/3747995104 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f4e4409a340 con 0x55e0f1038480 2024-09-10T20:56:56.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.598+0000 7f4e55ce6f40 1 --2- 172.21.15.6:0/3747995104 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x55e0f10c43d0 0x55e0f1178a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:56.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.598+0000 7f4e55ce6f40 1 -- 172.21.15.6:0/3747995104 --> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] -- osd_op(unknown.0.0:1 5.13 5:ca8fdbba:::100000001fb.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e0f1176c80 con 0x55e0f10c43d0 2024-09-10T20:56:56.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.598+0000 7f4e52400640 1 --2- 172.21.15.6:0/3747995104 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4e34076950 0x7f4e34078e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:56.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.598+0000 7f4e53800640 1 --2- 172.21.15.6:0/3747995104 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x55e0f10c43d0 0x55e0f1178a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:56.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.598+0000 7f4e52400640 1 --2- 172.21.15.6:0/3747995104 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4e34076950 0x7f4e34078e10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x55e0f1033c80 tx=0x7f4e40005a20 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:56.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.598+0000 7f4e53800640 1 --2- 172.21.15.6:0/3747995104 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x55e0f10c43d0 0x55e0f1178a50 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:56.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.599+0000 7f4e53800640 1 -- 172.21.15.6:0/3747995104 <== osd.3 v2:172.21.15.6:6816/3911674247 1 ==== osd_op_reply(1 100000001fb.00000000 [getxattr (95) out=95b] v0'0 uv2 ondisk = 0) ==== 164+0+95 (crc 0 0 0) 0x7f4e4c00b040 con 0x55e0f10c43d0 2024-09-10T20:56:56.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.599+0000 7f4e55ce6f40 1 -- 172.21.15.6:0/3747995104 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x55e0f10c43d0 msgr2=0x55e0f1178a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:56.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.599+0000 7f4e55ce6f40 1 --2- 172.21.15.6:0/3747995104 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x55e0f10c43d0 0x55e0f1178a50 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:56.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.599+0000 7f4e55ce6f40 1 -- 172.21.15.6:0/3747995104 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4e34076950 msgr2=0x7f4e34078e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:56.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.599+0000 7f4e55ce6f40 1 --2- 172.21.15.6:0/3747995104 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4e34076950 0x7f4e34078e10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x55e0f1033c80 tx=0x7f4e40005a20 comp rx=0 tx=0).stop 2024-09-10T20:56:56.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.599+0000 7f4e55ce6f40 1 -- 172.21.15.6:0/3747995104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0f1038480 msgr2=0x55e0f10c3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:56.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.599+0000 7f4e55ce6f40 1 --2- 172.21.15.6:0/3747995104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0f1038480 0x55e0f10c3470 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x55e0f1009650 tx=0x7f4e4400ff30 comp rx=0 tx=0).stop 2024-09-10T20:56:56.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.599+0000 7f4e53800640 1 -- 172.21.15.6:0/3747995104 reap_dead start 2024-09-10T20:56:56.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.599+0000 7f4e55ce6f40 1 -- 172.21.15.6:0/3747995104 shutdown_connections 2024-09-10T20:56:56.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.599+0000 7f4e55ce6f40 1 -- 172.21.15.6:0/3747995104 >> 172.21.15.6:0/3747995104 conn(0x55e0f1007780 msgr2=0x55e0f1035e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:56.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.599+0000 7f4e55ce6f40 1 -- 172.21.15.6:0/3747995104 shutdown_connections 2024-09-10T20:56:56.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.599+0000 7f4e55ce6f40 1 -- 172.21.15.6:0/3747995104 wait complete. 2024-09-10T20:56:56.609 INFO:teuthology.orchestra.run.smithi006.stdout:Y��alphaparent_b 2024-09-10T20:56:56.609 DEBUG:teuthology.orchestra.run.smithi006:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-09-10T20:56:56.690 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-10T20:56:56.690 INFO:teuthology.orchestra.run.smithi006.stdout: "ino": 1099511628283, 2024-09-10T20:56:56.690 INFO:teuthology.orchestra.run.smithi006.stdout: "ancestors": [ 2024-09-10T20:56:56.690 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-10T20:56:56.690 INFO:teuthology.orchestra.run.smithi006.stdout: "dirino": 1099511628284, 2024-09-10T20:56:56.690 INFO:teuthology.orchestra.run.smithi006.stdout: "dname": "alpha", 2024-09-10T20:56:56.690 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 5 2024-09-10T20:56:56.690 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-10T20:56:56.690 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-10T20:56:56.691 INFO:teuthology.orchestra.run.smithi006.stdout: "dirino": 1, 2024-09-10T20:56:56.691 INFO:teuthology.orchestra.run.smithi006.stdout: "dname": "parent_b", 2024-09-10T20:56:56.691 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 27 2024-09-10T20:56:56.691 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-10T20:56:56.691 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-10T20:56:56.691 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 5, 2024-09-10T20:56:56.691 INFO:teuthology.orchestra.run.smithi006.stdout: "old_pools": [] 2024-09-10T20:56:56.691 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-10T20:56:56.691 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:56:56.695 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create data_new --pg_num_min 64 2024-09-10T20:56:56.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.894+0000 7fbb2a800640 1 -- 172.21.15.6:0/1597677786 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb240ca990 msgr2=0x7fbb240cf080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:56.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.894+0000 7fbb2a800640 1 --2- 172.21.15.6:0/1597677786 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb240ca990 0x7fbb240cf080 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c009830 tx=0x7fbb0c02a5a0 comp rx=0 tx=0).stop 2024-09-10T20:56:56.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.894+0000 7fbb2a800640 1 -- 172.21.15.6:0/1597677786 shutdown_connections 2024-09-10T20:56:56.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.894+0000 7fbb2a800640 1 --2- 172.21.15.6:0/1597677786 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb240ad880 0x7fbb240adce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:56.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.894+0000 7fbb2a800640 1 --2- 172.21.15.6:0/1597677786 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb240ca990 0x7fbb240cf080 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:56.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.894+0000 7fbb2a800640 1 -- 172.21.15.6:0/1597677786 >> 172.21.15.6:0/1597677786 conn(0x7fbb240cfa20 msgr2=0x7fbb240cfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:56.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.894+0000 7fbb2a800640 1 -- 172.21.15.6:0/1597677786 shutdown_connections 2024-09-10T20:56:56.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.894+0000 7fbb2a800640 1 -- 172.21.15.6:0/1597677786 wait complete. 2024-09-10T20:56:56.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.896+0000 7fbb2a800640 1 Processor -- start 2024-09-10T20:56:56.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.896+0000 7fbb2a800640 1 -- start start 2024-09-10T20:56:56.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.897+0000 7fbb2a800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb240ad880 0x7fbb240c9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:56.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.897+0000 7fbb2a800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb240ca990 0x7fbb241532b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:56.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.897+0000 7fbb2a800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb240ceca0 0x7fbb2414ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:56.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.897+0000 7fbb2a800640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbb2415edc0 con 0x7fbb240ad880 2024-09-10T20:56:56.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.897+0000 7fbb2a800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbb2415ec40 con 0x7fbb240ceca0 2024-09-10T20:56:56.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.897+0000 7fbb2a800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fbb2415ef40 con 0x7fbb240ca990 2024-09-10T20:56:56.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.897+0000 7fbb23400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb240ad880 0x7fbb240c9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:56.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.897+0000 7fbb23400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb240ad880 0x7fbb240c9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53580/0 (socket says 172.21.15.6:53580) 2024-09-10T20:56:56.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.897+0000 7fbb23400640 1 -- 172.21.15.6:0/4268255568 learned_addr learned my addr 172.21.15.6:0/4268255568 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:56.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.897+0000 7fbb23e00640 1 --2- 172.21.15.6:0/4268255568 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb240ceca0 0x7fbb2414ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:56.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.897+0000 7fbb1aa00640 1 --2- 172.21.15.6:0/4268255568 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb240ca990 0x7fbb241532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:56.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.898+0000 7fbb23400640 1 -- 172.21.15.6:0/4268255568 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb240ca990 msgr2=0x7fbb241532b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:56.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.898+0000 7fbb23400640 1 --2- 172.21.15.6:0/4268255568 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb240ca990 0x7fbb241532b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:56.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.898+0000 7fbb23400640 1 -- 172.21.15.6:0/4268255568 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb240ceca0 msgr2=0x7fbb2414ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:56.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.898+0000 7fbb23400640 1 --2- 172.21.15.6:0/4268255568 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb240ceca0 0x7fbb2414ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:56.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.898+0000 7fbb23400640 1 -- 172.21.15.6:0/4268255568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb240b3830 con 0x7fbb240ad880 2024-09-10T20:56:56.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.898+0000 7fbb23400640 1 --2- 172.21.15.6:0/4268255568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb240ad880 0x7fbb240c9430 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fbb1400c4d0 tx=0x7fbb1400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:56.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.898+0000 7fbb1be00640 1 -- 172.21.15.6:0/4268255568 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb14016020 con 0x7fbb240ad880 2024-09-10T20:56:56.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.898+0000 7fbb1be00640 1 -- 172.21.15.6:0/4268255568 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbb14012920 con 0x7fbb240ad880 2024-09-10T20:56:56.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.898+0000 7fbb1be00640 1 -- 172.21.15.6:0/4268255568 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb14012d30 con 0x7fbb240ad880 2024-09-10T20:56:56.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.898+0000 7fbb2a800640 1 -- 172.21.15.6:0/4268255568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb240b3b70 con 0x7fbb240ad880 2024-09-10T20:56:56.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.899+0000 7fbb2a800640 1 -- 172.21.15.6:0/4268255568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb240b43b0 con 0x7fbb240ad880 2024-09-10T20:56:56.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.900+0000 7fbb2a800640 1 -- 172.21.15.6:0/4268255568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb240750e0 con 0x7fbb240ad880 2024-09-10T20:56:56.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.901+0000 7fbb1be00640 1 -- 172.21.15.6:0/4268255568 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fbb1401a3b0 con 0x7fbb240ad880 2024-09-10T20:56:56.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.902+0000 7fbb1be00640 1 --2- 172.21.15.6:0/4268255568 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbb00077f70 0x7fbb0007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:56.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.902+0000 7fbb1be00640 1 -- 172.21.15.6:0/4268255568 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fbb14099c60 con 0x7fbb240ad880 2024-09-10T20:56:56.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.903+0000 7fbb1aa00640 1 --2- 172.21.15.6:0/4268255568 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbb00077f70 0x7fbb0007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:56.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.903+0000 7fbb1aa00640 1 --2- 172.21.15.6:0/4268255568 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbb00077f70 0x7fbb0007a430 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c034000 tx=0x7fbb0c004730 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:56.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:56.907+0000 7fbb1be00640 1 -- 172.21.15.6:0/4268255568 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fbb240750e0 con 0x7fbb240ad880 2024-09-10T20:56:57.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.101+0000 7fbb2a800640 1 -- 172.21.15.6:0/4268255568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "data_new", "pg_num_min": 64} v 0) -- 0x7fbb240b45b0 con 0x7fbb240ad880 2024-09-10T20:56:57.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.136+0000 7fbb1be00640 1 -- 172.21.15.6:0/4268255568 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "data_new", "pg_num_min": 64}]=0 pool 'data_new' created v36) ==== 124+0+0 (secure 0 0 0) 0x7fbb14020030 con 0x7fbb240ad880 2024-09-10T20:56:57.141 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'data_new' created 2024-09-10T20:56:57.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.139+0000 7fbb2a800640 1 -- 172.21.15.6:0/4268255568 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbb00077f70 msgr2=0x7fbb0007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:57.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.139+0000 7fbb2a800640 1 --2- 172.21.15.6:0/4268255568 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbb00077f70 0x7fbb0007a430 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c034000 tx=0x7fbb0c004730 comp rx=0 tx=0).stop 2024-09-10T20:56:57.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.139+0000 7fbb2a800640 1 -- 172.21.15.6:0/4268255568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb240ad880 msgr2=0x7fbb240c9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:57.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.139+0000 7fbb2a800640 1 --2- 172.21.15.6:0/4268255568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb240ad880 0x7fbb240c9430 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fbb1400c4d0 tx=0x7fbb1400c990 comp rx=0 tx=0).stop 2024-09-10T20:56:57.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.140+0000 7fbb2a800640 1 -- 172.21.15.6:0/4268255568 shutdown_connections 2024-09-10T20:56:57.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.140+0000 7fbb2a800640 1 --2- 172.21.15.6:0/4268255568 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbb00077f70 0x7fbb0007a430 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:57.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.140+0000 7fbb2a800640 1 --2- 172.21.15.6:0/4268255568 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb240ceca0 0x7fbb2414ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:57.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.140+0000 7fbb2a800640 1 --2- 172.21.15.6:0/4268255568 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb240ca990 0x7fbb241532b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:57.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.140+0000 7fbb2a800640 1 --2- 172.21.15.6:0/4268255568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb240ad880 0x7fbb240c9430 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:57.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.140+0000 7fbb2a800640 1 -- 172.21.15.6:0/4268255568 >> 172.21.15.6:0/4268255568 conn(0x7fbb240cfa20 msgr2=0x7fbb2406ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:57.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.140+0000 7fbb2a800640 1 -- 172.21.15.6:0/4268255568 shutdown_connections 2024-09-10T20:56:57.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.140+0000 7fbb2a800640 1 -- 172.21.15.6:0/4268255568 wait complete. 2024-09-10T20:56:57.165 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs data_new 2024-09-10T20:56:57.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.321+0000 7fa50e600640 1 -- 172.21.15.6:0/271326774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa508159670 msgr2=0x7fa5080743b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:57.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.321+0000 7fa50e600640 1 --2- 172.21.15.6:0/271326774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa508159670 0x7fa5080743b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8005fd0 tx=0x7fa4f802a4a0 comp rx=0 tx=0).stop 2024-09-10T20:56:57.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.321+0000 7fa50e600640 1 -- 172.21.15.6:0/271326774 shutdown_connections 2024-09-10T20:56:57.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.321+0000 7fa50e600640 1 --2- 172.21.15.6:0/271326774 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa508070450 0x7fa5080cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:57.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.321+0000 7fa50e600640 1 --2- 172.21.15.6:0/271326774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa508159670 0x7fa5080743b0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:57.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.321+0000 7fa50e600640 1 -- 172.21.15.6:0/271326774 >> 172.21.15.6:0/271326774 conn(0x7fa5080cfa20 msgr2=0x7fa5080cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:57.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.321+0000 7fa50e600640 1 -- 172.21.15.6:0/271326774 shutdown_connections 2024-09-10T20:56:57.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.321+0000 7fa50e600640 1 -- 172.21.15.6:0/271326774 wait complete. 2024-09-10T20:56:57.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.323+0000 7fa50e600640 1 Processor -- start 2024-09-10T20:56:57.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.323+0000 7fa50e600640 1 -- start start 2024-09-10T20:56:57.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.324+0000 7fa50e600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa508070450 0x7fa5081f3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:57.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.324+0000 7fa50e600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa508159670 0x7fa5081f3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:57.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.324+0000 7fa50e600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa50815c170 0x7fa5080c9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:57.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.324+0000 7fa50e600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa5080b4ca0 con 0x7fa50815c170 2024-09-10T20:56:57.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.324+0000 7fa50e600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa5080b4b20 con 0x7fa508070450 2024-09-10T20:56:57.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.324+0000 7fa50e600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa5080b4e20 con 0x7fa508159670 2024-09-10T20:56:57.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.324+0000 7fa507e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa50815c170 0x7fa5080c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:57.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.324+0000 7fa507e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa50815c170 0x7fa5080c9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53602/0 (socket says 172.21.15.6:53602) 2024-09-10T20:56:57.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.324+0000 7fa507e00640 1 -- 172.21.15.6:0/1477385139 learned_addr learned my addr 172.21.15.6:0/1477385139 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:57.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.324+0000 7fa507400640 1 --2- 172.21.15.6:0/1477385139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa508070450 0x7fa5081f3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:57.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.325+0000 7fa4fea00640 1 --2- 172.21.15.6:0/1477385139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa508159670 0x7fa5081f3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:57.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.325+0000 7fa507e00640 1 -- 172.21.15.6:0/1477385139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa508159670 msgr2=0x7fa5081f3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:57.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.325+0000 7fa507e00640 1 --2- 172.21.15.6:0/1477385139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa508159670 0x7fa5081f3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:57.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.325+0000 7fa507e00640 1 -- 172.21.15.6:0/1477385139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa508070450 msgr2=0x7fa5081f3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:57.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.325+0000 7fa507e00640 1 --2- 172.21.15.6:0/1477385139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa508070450 0x7fa5081f3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:57.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.325+0000 7fa507e00640 1 -- 172.21.15.6:0/1477385139 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5081f35d0 con 0x7fa50815c170 2024-09-10T20:56:57.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.325+0000 7fa507e00640 1 --2- 172.21.15.6:0/1477385139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa50815c170 0x7fa5080c9390 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa50000b970 tx=0x7fa50000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:57.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.325+0000 7fa4ffe00640 1 -- 172.21.15.6:0/1477385139 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa500019070 con 0x7fa50815c170 2024-09-10T20:56:57.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.325+0000 7fa4ffe00640 1 -- 172.21.15.6:0/1477385139 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa50000cc50 con 0x7fa50815c170 2024-09-10T20:56:57.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.325+0000 7fa50e600640 1 -- 172.21.15.6:0/1477385139 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5080c7950 con 0x7fa50815c170 2024-09-10T20:56:57.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.325+0000 7fa4ffe00640 1 -- 172.21.15.6:0/1477385139 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5000146a0 con 0x7fa50815c170 2024-09-10T20:56:57.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.325+0000 7fa50e600640 1 -- 172.21.15.6:0/1477385139 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa50815a210 con 0x7fa50815c170 2024-09-10T20:56:57.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.326+0000 7fa50e600640 1 -- 172.21.15.6:0/1477385139 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5080b5310 con 0x7fa50815c170 2024-09-10T20:56:57.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.329+0000 7fa4ffe00640 1 -- 172.21.15.6:0/1477385139 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa50001d3b0 con 0x7fa50815c170 2024-09-10T20:56:57.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.329+0000 7fa4ffe00640 1 --2- 172.21.15.6:0/1477385139 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa4e4077f70 0x7fa4e407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:57.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.329+0000 7fa4ffe00640 1 -- 172.21.15.6:0/1477385139 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6072+0+0 (secure 0 0 0) 0x7fa500099f10 con 0x7fa50815c170 2024-09-10T20:56:57.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.330+0000 7fa507400640 1 --2- 172.21.15.6:0/1477385139 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa4e4077f70 0x7fa4e407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:57.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.330+0000 7fa507400640 1 --2- 172.21.15.6:0/1477385139 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa4e4077f70 0x7fa4e407a430 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8033000 tx=0x7fa4f8004730 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:57.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.334+0000 7fa4ffe00640 1 -- 172.21.15.6:0/1477385139 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fa500062890 con 0x7fa50815c170 2024-09-10T20:56:57.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:57.566+0000 7fa50e600640 1 -- 172.21.15.6:0/1477385139 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "data_new"} v 0) -- 0x7fa508069d20 con 0x7fa50815c170 2024-09-10T20:56:58.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.147+0000 7fa4ffe00640 1 -- 172.21.15.6:0/1477385139 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "data_new"}]=0 added data pool 6 to fsmap v18) ==== 131+0+0 (secure 0 0 0) 0x7fa500062190 con 0x7fa50815c170 2024-09-10T20:56:58.153 INFO:teuthology.orchestra.run.smithi006.stderr:added data pool 6 to fsmap 2024-09-10T20:56:58.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.153+0000 7fa50e600640 1 -- 172.21.15.6:0/1477385139 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa4e4077f70 msgr2=0x7fa4e407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:58.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.153+0000 7fa50e600640 1 --2- 172.21.15.6:0/1477385139 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa4e4077f70 0x7fa4e407a430 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8033000 tx=0x7fa4f8004730 comp rx=0 tx=0).stop 2024-09-10T20:56:58.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.153+0000 7fa50e600640 1 -- 172.21.15.6:0/1477385139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa50815c170 msgr2=0x7fa5080c9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:58.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.153+0000 7fa50e600640 1 --2- 172.21.15.6:0/1477385139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa50815c170 0x7fa5080c9390 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa50000b970 tx=0x7fa50000be30 comp rx=0 tx=0).stop 2024-09-10T20:56:58.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.153+0000 7fa50e600640 1 -- 172.21.15.6:0/1477385139 shutdown_connections 2024-09-10T20:56:58.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.153+0000 7fa50e600640 1 --2- 172.21.15.6:0/1477385139 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa4e4077f70 0x7fa4e407a430 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:58.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.153+0000 7fa50e600640 1 --2- 172.21.15.6:0/1477385139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa50815c170 0x7fa5080c9390 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:58.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.153+0000 7fa50e600640 1 --2- 172.21.15.6:0/1477385139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa508159670 0x7fa5081f3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:58.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.153+0000 7fa50e600640 1 --2- 172.21.15.6:0/1477385139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa508070450 0x7fa5081f3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:58.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.153+0000 7fa50e600640 1 -- 172.21.15.6:0/1477385139 >> 172.21.15.6:0/1477385139 conn(0x7fa5080cfa20 msgr2=0x7fa5080cdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:58.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.154+0000 7fa50e600640 1 -- 172.21.15.6:0/1477385139 shutdown_connections 2024-09-10T20:56:58.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.154+0000 7fa50e600640 1 -- 172.21.15.6:0/1477385139 wait complete. 2024-09-10T20:56:58.181 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:56:58.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.339+0000 7f72a5200640 1 -- 172.21.15.6:0/2874676331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7284003aa0 msgr2=0x7f7284003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:58.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.339+0000 7f72a5200640 1 --2- 172.21.15.6:0/2874676331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7284003aa0 0x7f7284003ec0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7290001690 tx=0x7f7284005830 comp rx=0 tx=0).stop 2024-09-10T20:56:58.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.339+0000 7f72a5200640 1 -- 172.21.15.6:0/2874676331 shutdown_connections 2024-09-10T20:56:58.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.339+0000 7f72a5200640 1 --2- 172.21.15.6:0/2874676331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7284003aa0 0x7f7284003ec0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:58.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.339+0000 7f72a5200640 1 -- 172.21.15.6:0/2874676331 >> 172.21.15.6:0/2874676331 conn(0x7f72a009d0a0 msgr2=0x7f72a00d3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:58.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.339+0000 7f72a5200640 1 -- 172.21.15.6:0/2874676331 shutdown_connections 2024-09-10T20:56:58.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.339+0000 7f72a5200640 1 -- 172.21.15.6:0/2874676331 wait complete. 2024-09-10T20:56:58.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.340+0000 7f72a5200640 1 Processor -- start 2024-09-10T20:56:58.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.341+0000 7f72a5200640 1 -- start start 2024-09-10T20:56:58.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.342+0000 7f72a5200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7284003aa0 0x7f72a01f8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:58.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.342+0000 7f72a5200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72a006de30 0x7f72a006e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:58.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.342+0000 7f72a5200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72a00cd4f0 0x7f72a00cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:58.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.342+0000 7f72a5200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f72a01620a0 con 0x7f72a00cd4f0 2024-09-10T20:56:58.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.342+0000 7f72a5200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f72a0161f20 con 0x7f72a006de30 2024-09-10T20:56:58.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.342+0000 7f72a5200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f72a00d46a0 con 0x7f7284003aa0 2024-09-10T20:56:58.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.342+0000 7f729fe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72a00cd4f0 0x7f72a00cd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:58.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.342+0000 7f729fe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72a00cd4f0 0x7f72a00cd9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34882/0 (socket says 172.21.15.6:34882) 2024-09-10T20:56:58.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.342+0000 7f729fe00640 1 -- 172.21.15.6:0/3136573686 learned_addr learned my addr 172.21.15.6:0/3136573686 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:58.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.342+0000 7f729ea00640 1 --2- 172.21.15.6:0/3136573686 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72a006de30 0x7f72a006e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:58.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.342+0000 7f729f400640 1 --2- 172.21.15.6:0/3136573686 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7284003aa0 0x7f72a01f8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:58.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.342+0000 7f729fe00640 1 -- 172.21.15.6:0/3136573686 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7284003aa0 msgr2=0x7f72a01f8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:58.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.342+0000 7f729fe00640 1 --2- 172.21.15.6:0/3136573686 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7284003aa0 0x7f72a01f8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:58.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.342+0000 7f729fe00640 1 -- 172.21.15.6:0/3136573686 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72a006de30 msgr2=0x7f72a006e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:58.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.342+0000 7f729fe00640 1 --2- 172.21.15.6:0/3136573686 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72a006de30 0x7f72a006e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:58.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.342+0000 7f729fe00640 1 -- 172.21.15.6:0/3136573686 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72a01f92f0 con 0x7f72a00cd4f0 2024-09-10T20:56:58.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.343+0000 7f729fe00640 1 --2- 172.21.15.6:0/3136573686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72a00cd4f0 0x7f72a00cd9a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f72a008d1d0 tx=0x7f729800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:58.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.343+0000 7f7297400640 1 -- 172.21.15.6:0/3136573686 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7298003d80 con 0x7f72a00cd4f0 2024-09-10T20:56:58.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.343+0000 7f7297400640 1 -- 172.21.15.6:0/3136573686 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7298004b20 con 0x7f72a00cd4f0 2024-09-10T20:56:58.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.343+0000 7f7297400640 1 -- 172.21.15.6:0/3136573686 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7298004050 con 0x7f72a00cd4f0 2024-09-10T20:56:58.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.343+0000 7f72a5200640 1 -- 172.21.15.6:0/3136573686 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72a00cdee0 con 0x7f72a00cd4f0 2024-09-10T20:56:58.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.343+0000 7f72a5200640 1 -- 172.21.15.6:0/3136573686 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72a014ffe0 con 0x7f72a00cd4f0 2024-09-10T20:56:58.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.344+0000 7f72a5200640 1 -- 172.21.15.6:0/3136573686 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72a00b2e80 con 0x7f72a00cd4f0 2024-09-10T20:56:58.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.345+0000 7f7297400640 1 -- 172.21.15.6:0/3136573686 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f7298018070 con 0x7f72a00cd4f0 2024-09-10T20:56:58.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.346+0000 7f7297400640 1 --2- 172.21.15.6:0/3136573686 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f7280077f70 0x7f728007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:58.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.346+0000 7f7297400640 1 -- 172.21.15.6:0/3136573686 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6104+0+0 (secure 0 0 0) 0x7f729809ab50 con 0x7f72a00cd4f0 2024-09-10T20:56:58.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.347+0000 7f729f400640 1 --2- 172.21.15.6:0/3136573686 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f7280077f70 0x7f728007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:58.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.347+0000 7f729f400640 1 --2- 172.21.15.6:0/3136573686 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f7280077f70 0x7f728007a430 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7290032000 tx=0x7f729002c040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:58.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.350+0000 7f7297400640 1 -- 172.21.15.6:0/3136573686 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f72a00b2e80 con 0x7f72a00cd4f0 2024-09-10T20:56:58.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.581+0000 7f72a5200640 1 -- 172.21.15.6:0/3136573686 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f72a00d4c00 con 0x7f72a00cd4f0 2024-09-10T20:56:58.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.581+0000 7f7297400640 1 -- 172.21.15.6:0/3136573686 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5222 (secure 0 0 0) 0x7f7298005e10 con 0x7f72a00cd4f0 2024-09-10T20:56:58.586 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:56:58.586 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":18,"btime":"2024-09-10T20:56:58:138800+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1675451102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1675451102},{"type":"v1","addr":"172.21.15.6:6834","nonce":1675451102}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4924,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/676153174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":676153174},{"type":"v1","addr":"172.21.15.150:6836","nonce":676153174}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4950,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4072260905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":4072260905},{"type":"v1","addr":"172.21.15.150:6837","nonce":4072260905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:56:37.566072+0000","modified":"2024-09-10T20:56:57.568755+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4956":{"gid":4956,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/1598644433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1598644433},{"type":"v1","addr":"172.21.15.6:6835","nonce":1598644433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5,6],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4956,"qdb_cluster":[4956]},"id":2}]} 2024-09-10T20:56:58.586 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 18 2024-09-10T20:56:58.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.584+0000 7f72a5200640 1 -- 172.21.15.6:0/3136573686 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f7280077f70 msgr2=0x7f728007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:58.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.584+0000 7f72a5200640 1 --2- 172.21.15.6:0/3136573686 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f7280077f70 0x7f728007a430 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7290032000 tx=0x7f729002c040 comp rx=0 tx=0).stop 2024-09-10T20:56:58.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.584+0000 7f72a5200640 1 -- 172.21.15.6:0/3136573686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72a00cd4f0 msgr2=0x7f72a00cd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:58.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.584+0000 7f72a5200640 1 --2- 172.21.15.6:0/3136573686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72a00cd4f0 0x7f72a00cd9a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f72a008d1d0 tx=0x7f729800f790 comp rx=0 tx=0).stop 2024-09-10T20:56:58.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.584+0000 7f72a5200640 1 -- 172.21.15.6:0/3136573686 shutdown_connections 2024-09-10T20:56:58.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.584+0000 7f72a5200640 1 --2- 172.21.15.6:0/3136573686 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f7280077f70 0x7f728007a430 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:58.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.584+0000 7f72a5200640 1 --2- 172.21.15.6:0/3136573686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72a00cd4f0 0x7f72a00cd9a0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:58.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.584+0000 7f72a5200640 1 --2- 172.21.15.6:0/3136573686 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72a006de30 0x7f72a006e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:58.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.584+0000 7f72a5200640 1 --2- 172.21.15.6:0/3136573686 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7284003aa0 0x7f72a01f8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:58.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.584+0000 7f72a5200640 1 -- 172.21.15.6:0/3136573686 >> 172.21.15.6:0/3136573686 conn(0x7f72a009d0a0 msgr2=0x7f72a00b0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:58.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.584+0000 7f72a5200640 1 -- 172.21.15.6:0/3136573686 shutdown_connections 2024-09-10T20:56:58.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.584+0000 7f72a5200640 1 -- 172.21.15.6:0/3136573686 wait complete. 2024-09-10T20:56:58.605 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T20:56:58.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.760+0000 7f1f85c00640 1 -- 172.21.15.6:0/4161653526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f80070450 msgr2=0x7f1f800b5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:58.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.760+0000 7f1f85c00640 1 --2- 172.21.15.6:0/4161653526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f80070450 0x7f1f800b5020 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1f78005fd0 tx=0x7f1f7802a820 comp rx=0 tx=0).stop 2024-09-10T20:56:58.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.760+0000 7f1f85c00640 1 -- 172.21.15.6:0/4161653526 shutdown_connections 2024-09-10T20:56:58.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.760+0000 7f1f85c00640 1 --2- 172.21.15.6:0/4161653526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f80070450 0x7f1f800b5020 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:58.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.760+0000 7f1f85c00640 1 -- 172.21.15.6:0/4161653526 >> 172.21.15.6:0/4161653526 conn(0x7f1f800cfa20 msgr2=0x7f1f800cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:58.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.760+0000 7f1f85c00640 1 -- 172.21.15.6:0/4161653526 shutdown_connections 2024-09-10T20:56:58.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.760+0000 7f1f85c00640 1 -- 172.21.15.6:0/4161653526 wait complete. 2024-09-10T20:56:58.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.761+0000 7f1f85c00640 1 Processor -- start 2024-09-10T20:56:58.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.762+0000 7f1f85c00640 1 -- start start 2024-09-10T20:56:58.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.762+0000 7f1f85c00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f80070450 0x7f1f800c6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:58.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.762+0000 7f1f85c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f80159670 0x7f1f8014ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:58.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.763+0000 7f1f85c00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f8015c170 0x7f1f800ab340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:58.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.763+0000 7f1f85c00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1f80074740 con 0x7f1f80070450 2024-09-10T20:56:58.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.763+0000 7f1f85c00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f1f800745c0 con 0x7f1f80159670 2024-09-10T20:56:58.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.763+0000 7f1f85c00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f1f800cd920 con 0x7f1f8015c170 2024-09-10T20:56:58.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.763+0000 7f1f7ea00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f80070450 0x7f1f800c6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:58.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.763+0000 7f1f7ea00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f80070450 0x7f1f800c6f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34894/0 (socket says 172.21.15.6:34894) 2024-09-10T20:56:58.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.763+0000 7f1f7ea00640 1 -- 172.21.15.6:0/2813337203 learned_addr learned my addr 172.21.15.6:0/2813337203 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:58.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.763+0000 7f1f7e000640 1 --2- 172.21.15.6:0/2813337203 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f80159670 0x7f1f8014ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:58.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.763+0000 7f1f7f400640 1 --2- 172.21.15.6:0/2813337203 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f8015c170 0x7f1f800ab340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:58.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.763+0000 7f1f7ea00640 1 -- 172.21.15.6:0/2813337203 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f8015c170 msgr2=0x7f1f800ab340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:58.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.763+0000 7f1f7ea00640 1 --2- 172.21.15.6:0/2813337203 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f8015c170 0x7f1f800ab340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:58.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.763+0000 7f1f7ea00640 1 -- 172.21.15.6:0/2813337203 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f80159670 msgr2=0x7f1f8014ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:58.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.763+0000 7f1f7ea00640 1 --2- 172.21.15.6:0/2813337203 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f80159670 0x7f1f8014ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:58.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.763+0000 7f1f7ea00640 1 -- 172.21.15.6:0/2813337203 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f800abe90 con 0x7f1f80070450 2024-09-10T20:56:58.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.764+0000 7f1f7ea00640 1 --2- 172.21.15.6:0/2813337203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f80070450 0x7f1f800c6f90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f1f7000c430 tx=0x7f1f7000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:58.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.764+0000 7f1f76a00640 1 -- 172.21.15.6:0/2813337203 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f70011790 con 0x7f1f80070450 2024-09-10T20:56:58.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.764+0000 7f1f76a00640 1 -- 172.21.15.6:0/2813337203 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1f70017070 con 0x7f1f80070450 2024-09-10T20:56:58.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.764+0000 7f1f76a00640 1 -- 172.21.15.6:0/2813337203 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f70011cc0 con 0x7f1f80070450 2024-09-10T20:56:58.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.764+0000 7f1f85c00640 1 -- 172.21.15.6:0/2813337203 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f800ac170 con 0x7f1f80070450 2024-09-10T20:56:58.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.764+0000 7f1f85c00640 1 -- 172.21.15.6:0/2813337203 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f800ac730 con 0x7f1f80070450 2024-09-10T20:56:58.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.765+0000 7f1f85c00640 1 -- 172.21.15.6:0/2813337203 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f8006fd40 con 0x7f1f80070450 2024-09-10T20:56:58.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.766+0000 7f1f76a00640 1 -- 172.21.15.6:0/2813337203 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f1f7001c460 con 0x7f1f80070450 2024-09-10T20:56:58.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.767+0000 7f1f76a00640 1 --2- 172.21.15.6:0/2813337203 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f1f60077f70 0x7f1f6007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:58.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.767+0000 7f1f76a00640 1 -- 172.21.15.6:0/2813337203 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6104+0+0 (secure 0 0 0) 0x7f1f70099da0 con 0x7f1f80070450 2024-09-10T20:56:58.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.767+0000 7f1f7e000640 1 --2- 172.21.15.6:0/2813337203 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f1f60077f70 0x7f1f6007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:58.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.768+0000 7f1f7e000640 1 --2- 172.21.15.6:0/2813337203 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f1f60077f70 0x7f1f6007a430 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1f801f60a0 tx=0x7f1f6c007eb0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:58.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.771+0000 7f1f76a00640 1 -- 172.21.15.6:0/2813337203 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f1f70061f10 con 0x7f1f80070450 2024-09-10T20:56:58.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.965+0000 7f1f85c00640 1 -- 172.21.15.6:0/2813337203 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1f80069d20 con 0x7f1f80070450 2024-09-10T20:56:59.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.966+0000 7f1f76a00640 1 -- 172.21.15.6:0/2813337203 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+18518 (secure 0 0 0) 0x7f1f70066940 con 0x7f1f80070450 2024-09-10T20:56:59.476 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:56:59.477 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":37,"fsid":"9e04309e-61c3-4c78-82db-9576e465d98a","created":"2024-09-10T20:55:17.972466+0000","modified":"2024-09-10T20:56:57.568529+0000","last_up_change":"2024-09-10T20:55:32.392769+0000","last_in_change":"2024-09-10T20:55:22.232252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:55:33.196464+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:56:35.128358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-10T20:56:36.534250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"data_new","create_time":"2024-09-10T20:56:57.111456+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0918c5c8-a028-4987-bad2-406c412ec3f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6801","nonce":895515615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6803","nonce":895515615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6807","nonce":895515615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6805","nonce":895515615}]},"public_addr":"172.21.15.6:6801/895515615","cluster_addr":"172.21.15.6:6803/895515615","heartbeat_back_addr":"172.21.15.6:6807/895515615","heartbeat_front_addr":"172.21.15.6:6805/895515615","state":["exists","up"]},{"osd":1,"uuid":"415e9c78-c3d9-46d6-b277-348453f42155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6809","nonce":1129113250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6811","nonce":1129113250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6815","nonce":1129113250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6813","nonce":1129113250}]},"public_addr":"172.21.15.6:6809/1129113250","cluster_addr":"172.21.15.6:6811/1129113250","heartbeat_back_addr":"172.21.15.6:6815/1129113250","heartbeat_front_addr":"172.21.15.6:6813/1129113250","state":["exists","up"]},{"osd":2,"uuid":"763c1cf2-a43d-4c10-815d-eaf4a32afc1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6825","nonce":3847470051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6827","nonce":3847470051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6831","nonce":3847470051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6829","nonce":3847470051}]},"public_addr":"172.21.15.6:6825/3847470051","cluster_addr":"172.21.15.6:6827/3847470051","heartbeat_back_addr":"172.21.15.6:6831/3847470051","heartbeat_front_addr":"172.21.15.6:6829/3847470051","state":["exists","up"]},{"osd":3,"uuid":"877b1cc1-2434-4b32-af66-9c2485eac9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6817","nonce":3911674247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6819","nonce":3911674247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6823","nonce":3911674247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6821","nonce":3911674247}]},"public_addr":"172.21.15.6:6817/3911674247","cluster_addr":"172.21.15.6:6819/3911674247","heartbeat_back_addr":"172.21.15.6:6823/3911674247","heartbeat_front_addr":"172.21.15.6:6821/3911674247","state":["exists","up"]},{"osd":4,"uuid":"e0b27501-dfdc-4e7f-b73a-9573c869267a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6827","nonce":2568527750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6829","nonce":2568527750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6833","nonce":2568527750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6831","nonce":2568527750}]},"public_addr":"172.21.15.150:6827/2568527750","cluster_addr":"172.21.15.150:6829/2568527750","heartbeat_back_addr":"172.21.15.150:6833/2568527750","heartbeat_front_addr":"172.21.15.150:6831/2568527750","state":["exists","up"]},{"osd":5,"uuid":"67e48053-4f15-44fd-a30c-c9522f86d169","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6811","nonce":371417736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6813","nonce":371417736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6817","nonce":371417736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6815","nonce":371417736}]},"public_addr":"172.21.15.150:6811/371417736","cluster_addr":"172.21.15.150:6813/371417736","heartbeat_back_addr":"172.21.15.150:6817/371417736","heartbeat_front_addr":"172.21.15.150:6815/371417736","state":["exists","up"]},{"osd":6,"uuid":"1456df2e-ae91-45a4-bc3a-a06c753092af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6819","nonce":2329248366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6821","nonce":2329248366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6825","nonce":2329248366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6823","nonce":2329248366}]},"public_addr":"172.21.15.150:6819/2329248366","cluster_addr":"172.21.15.150:6821/2329248366","heartbeat_back_addr":"172.21.15.150:6825/2329248366","heartbeat_front_addr":"172.21.15.150:6823/2329248366","state":["exists","up"]},{"osd":7,"uuid":"a9daafcb-5ecd-43bd-ab0a-dc4b480cfc2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6803","nonce":527018351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6805","nonce":527018351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6809","nonce":527018351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6807","nonce":527018351}]},"public_addr":"172.21.15.150:6803/527018351","cluster_addr":"172.21.15.150:6805/527018351","heartbeat_back_addr":"172.21.15.150:6809/527018351","heartbeat_front_addr":"172.21.15.150:6807/527018351","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.710061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.024506+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.824320+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.431608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.637032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.054828+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.333290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.358875+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:56:59.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.969+0000 7f1f85c00640 1 -- 172.21.15.6:0/2813337203 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f1f60077f70 msgr2=0x7f1f6007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:59.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.969+0000 7f1f85c00640 1 --2- 172.21.15.6:0/2813337203 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f1f60077f70 0x7f1f6007a430 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1f801f60a0 tx=0x7f1f6c007eb0 comp rx=0 tx=0).stop 2024-09-10T20:56:59.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.969+0000 7f1f85c00640 1 -- 172.21.15.6:0/2813337203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f80070450 msgr2=0x7f1f800c6f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:59.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.969+0000 7f1f85c00640 1 --2- 172.21.15.6:0/2813337203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f80070450 0x7f1f800c6f90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f1f7000c430 tx=0x7f1f7000c8f0 comp rx=0 tx=0).stop 2024-09-10T20:56:59.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.969+0000 7f1f85c00640 1 -- 172.21.15.6:0/2813337203 shutdown_connections 2024-09-10T20:56:59.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.969+0000 7f1f85c00640 1 --2- 172.21.15.6:0/2813337203 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f1f60077f70 0x7f1f6007a430 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:59.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.969+0000 7f1f85c00640 1 --2- 172.21.15.6:0/2813337203 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f8015c170 0x7f1f800ab340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:59.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.969+0000 7f1f85c00640 1 --2- 172.21.15.6:0/2813337203 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f80159670 0x7f1f8014ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:59.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.969+0000 7f1f85c00640 1 --2- 172.21.15.6:0/2813337203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f80070450 0x7f1f800c6f90 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:59.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.969+0000 7f1f85c00640 1 -- 172.21.15.6:0/2813337203 >> 172.21.15.6:0/2813337203 conn(0x7f1f800cfa20 msgr2=0x7f1f8015ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:59.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.969+0000 7f1f85c00640 1 -- 172.21.15.6:0/2813337203 shutdown_connections 2024-09-10T20:56:59.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:58.969+0000 7f1f85c00640 1 -- 172.21.15.6:0/2813337203 wait complete. 2024-09-10T20:56:59.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:56:59.480 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.file.layout.pool -v data_new ./parent_b/alpha) 2024-09-10T20:56:59.537 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:56:59.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.694+0000 7fa91dc00640 1 -- 172.21.15.6:0/2860742099 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa918070450 msgr2=0x7fa9180b5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:59.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.694+0000 7fa91dc00640 1 --2- 172.21.15.6:0/2860742099 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa918070450 0x7fa9180b5020 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa910005fd0 tx=0x7fa91002a8b0 comp rx=0 tx=0).stop 2024-09-10T20:56:59.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.694+0000 7fa91dc00640 1 -- 172.21.15.6:0/2860742099 shutdown_connections 2024-09-10T20:56:59.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.694+0000 7fa91dc00640 1 --2- 172.21.15.6:0/2860742099 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa918070450 0x7fa9180b5020 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:59.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.694+0000 7fa91dc00640 1 -- 172.21.15.6:0/2860742099 >> 172.21.15.6:0/2860742099 conn(0x7fa9180cfa20 msgr2=0x7fa9180cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:59.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.695+0000 7fa91dc00640 1 -- 172.21.15.6:0/2860742099 shutdown_connections 2024-09-10T20:56:59.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.695+0000 7fa91dc00640 1 -- 172.21.15.6:0/2860742099 wait complete. 2024-09-10T20:56:59.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.696+0000 7fa91dc00640 1 Processor -- start 2024-09-10T20:56:59.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.696+0000 7fa91dc00640 1 -- start start 2024-09-10T20:56:59.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.697+0000 7fa91dc00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa918070450 0x7fa918154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:59.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.697+0000 7fa91dc00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa918159670 0x7fa9180b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:59.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.697+0000 7fa91dc00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa91815c170 0x7fa9180ad880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:59.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.697+0000 7fa91dc00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa918074740 con 0x7fa918159670 2024-09-10T20:56:59.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.697+0000 7fa91dc00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa9180745c0 con 0x7fa91815c170 2024-09-10T20:56:59.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.697+0000 7fa91dc00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa9180cd920 con 0x7fa918070450 2024-09-10T20:56:59.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.697+0000 7fa90e000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa918159670 0x7fa9180b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:59.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.698+0000 7fa90e000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa918159670 0x7fa9180b0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34902/0 (socket says 172.21.15.6:34902) 2024-09-10T20:56:59.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.698+0000 7fa90e000640 1 -- 172.21.15.6:0/1976930491 learned_addr learned my addr 172.21.15.6:0/1976930491 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:56:59.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.698+0000 7fa917400640 1 --2- 172.21.15.6:0/1976930491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa91815c170 0x7fa9180ad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:59.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.698+0000 7fa916a00640 1 --2- 172.21.15.6:0/1976930491 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa918070450 0x7fa918154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:59.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.698+0000 7fa90e000640 1 -- 172.21.15.6:0/1976930491 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa918070450 msgr2=0x7fa918154090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:59.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.698+0000 7fa90e000640 1 --2- 172.21.15.6:0/1976930491 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa918070450 0x7fa918154090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:59.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.698+0000 7fa90e000640 1 -- 172.21.15.6:0/1976930491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa91815c170 msgr2=0x7fa9180ad880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:59.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.698+0000 7fa90e000640 1 --2- 172.21.15.6:0/1976930491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa91815c170 0x7fa9180ad880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:59.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.698+0000 7fa90e000640 1 -- 172.21.15.6:0/1976930491 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9181f7f00 con 0x7fa918159670 2024-09-10T20:56:59.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.698+0000 7fa917400640 1 --2- 172.21.15.6:0/1976930491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa91815c170 0x7fa9180ad880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:56:59.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.698+0000 7fa916a00640 1 --2- 172.21.15.6:0/1976930491 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa918070450 0x7fa918154090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:56:59.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.698+0000 7fa90e000640 1 --2- 172.21.15.6:0/1976930491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa918159670 0x7fa9180b0c10 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa90000c450 tx=0x7fa90000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:59.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.699+0000 7fa90f400640 1 -- 172.21.15.6:0/1976930491 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9000052d0 con 0x7fa918159670 2024-09-10T20:56:59.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.699+0000 7fa90f400640 1 -- 172.21.15.6:0/1976930491 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa900005490 con 0x7fa918159670 2024-09-10T20:56:59.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.699+0000 7fa90f400640 1 -- 172.21.15.6:0/1976930491 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa900012890 con 0x7fa918159670 2024-09-10T20:56:59.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.699+0000 7fa91dc00640 1 -- 172.21.15.6:0/1976930491 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9181f81e0 con 0x7fa918159670 2024-09-10T20:56:59.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.699+0000 7fa91dc00640 1 -- 172.21.15.6:0/1976930491 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9181545d0 con 0x7fa918159670 2024-09-10T20:56:59.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.700+0000 7fa91dc00640 1 -- 172.21.15.6:0/1976930491 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa91806fd40 con 0x7fa918159670 2024-09-10T20:56:59.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.701+0000 7fa90f400640 1 -- 172.21.15.6:0/1976930491 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa900012a30 con 0x7fa918159670 2024-09-10T20:56:59.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.702+0000 7fa90f400640 1 --2- 172.21.15.6:0/1976930491 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa8f4077f70 0x7fa8f407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:59.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.702+0000 7fa90f400640 1 -- 172.21.15.6:0/1976930491 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6104+0+0 (secure 0 0 0) 0x7fa9000999a0 con 0x7fa918159670 2024-09-10T20:56:59.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.703+0000 7fa916a00640 1 --2- 172.21.15.6:0/1976930491 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa8f4077f70 0x7fa8f407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:59.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.703+0000 7fa916a00640 1 --2- 172.21.15.6:0/1976930491 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa8f4077f70 0x7fa8f407a430 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa918074d60 tx=0x7fa908009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:59.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.706+0000 7fa90f400640 1 -- 172.21.15.6:0/1976930491 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fa900062300 con 0x7fa918159670 2024-09-10T20:56:59.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.936+0000 7fa91dc00640 1 -- 172.21.15.6:0/1976930491 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa918069d20 con 0x7fa918159670 2024-09-10T20:56:59.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.936+0000 7fa90f400640 1 -- 172.21.15.6:0/1976930491 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5222 (secure 0 0 0) 0x7fa900061c00 con 0x7fa918159670 2024-09-10T20:56:59.940 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:56:59.941 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":18,"btime":"2024-09-10T20:56:58:138800+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1675451102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1675451102},{"type":"v1","addr":"172.21.15.6:6834","nonce":1675451102}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4924,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/676153174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":676153174},{"type":"v1","addr":"172.21.15.150:6836","nonce":676153174}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4950,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4072260905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":4072260905},{"type":"v1","addr":"172.21.15.150:6837","nonce":4072260905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:56:37.566072+0000","modified":"2024-09-10T20:56:57.568755+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4956":{"gid":4956,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/1598644433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1598644433},{"type":"v1","addr":"172.21.15.6:6835","nonce":1598644433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5,6],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4956,"qdb_cluster":[4956]},"id":2}]} 2024-09-10T20:56:59.941 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 18 2024-09-10T20:56:59.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.939+0000 7fa91dc00640 1 -- 172.21.15.6:0/1976930491 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa8f4077f70 msgr2=0x7fa8f407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:59.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.939+0000 7fa91dc00640 1 --2- 172.21.15.6:0/1976930491 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa8f4077f70 0x7fa8f407a430 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa918074d60 tx=0x7fa908009040 comp rx=0 tx=0).stop 2024-09-10T20:56:59.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.939+0000 7fa91dc00640 1 -- 172.21.15.6:0/1976930491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa918159670 msgr2=0x7fa9180b0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:59.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.939+0000 7fa91dc00640 1 --2- 172.21.15.6:0/1976930491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa918159670 0x7fa9180b0c10 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa90000c450 tx=0x7fa90000c910 comp rx=0 tx=0).stop 2024-09-10T20:56:59.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.939+0000 7fa91dc00640 1 -- 172.21.15.6:0/1976930491 shutdown_connections 2024-09-10T20:56:59.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.939+0000 7fa91dc00640 1 --2- 172.21.15.6:0/1976930491 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa8f4077f70 0x7fa8f407a430 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:59.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.939+0000 7fa91dc00640 1 --2- 172.21.15.6:0/1976930491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa918159670 0x7fa9180b0c10 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:59.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.939+0000 7fa91dc00640 1 --2- 172.21.15.6:0/1976930491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa91815c170 0x7fa9180ad880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:59.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.939+0000 7fa91dc00640 1 --2- 172.21.15.6:0/1976930491 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa918070450 0x7fa918154090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:59.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.939+0000 7fa91dc00640 1 -- 172.21.15.6:0/1976930491 >> 172.21.15.6:0/1976930491 conn(0x7fa9180cfa20 msgr2=0x7fa9180ccbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:59.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.939+0000 7fa91dc00640 1 -- 172.21.15.6:0/1976930491 shutdown_connections 2024-09-10T20:56:59.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:56:59.939+0000 7fa91dc00640 1 -- 172.21.15.6:0/1976930491 wait complete. 2024-09-10T20:56:59.959 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-09-10T20:57:00.144 INFO:teuthology.orchestra.run.smithi006.stdout:{"message":"","return_code":0} 2024-09-10T20:57:00.145 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-10T20:57:00.145 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001fb.00000000 parent 2024-09-10T20:57:00.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.218+0000 7fcf10d51f40 1 Processor -- start 2024-09-10T20:57:00.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.219+0000 7fcf10d51f40 1 -- start start 2024-09-10T20:57:00.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.219+0000 7fcf10d51f40 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5637c9744650 0x5637c9813880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:00.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.219+0000 7fcf10d51f40 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637c9791020 0x5637c9742130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:00.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.219+0000 7fcf10d51f40 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5637c981b1e0 0x5637c9742670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:00.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.219+0000 7fcf10d51f40 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5637c9693c60 con 0x5637c9791020 2024-09-10T20:57:00.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.219+0000 7fcf10d51f40 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5637c96f21d0 con 0x5637c9744650 2024-09-10T20:57:00.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.219+0000 7fcf10d51f40 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x5637c9790340 con 0x5637c981b1e0 2024-09-10T20:57:00.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.220+0000 7fcf07e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637c9791020 0x5637c9742130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:00.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.220+0000 7fcf07e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637c9791020 0x5637c9742130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34908/0 (socket says 172.21.15.6:34908) 2024-09-10T20:57:00.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.220+0000 7fcf07e00640 1 -- 172.21.15.6:0/2442802951 learned_addr learned my addr 172.21.15.6:0/2442802951 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:00.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.220+0000 7fcf0e000640 1 --2- 172.21.15.6:0/2442802951 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5637c9744650 0x5637c9813880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:00.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.220+0000 7fcf0ea00640 1 --2- 172.21.15.6:0/2442802951 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5637c981b1e0 0x5637c9742670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:00.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.220+0000 7fcf07e00640 1 -- 172.21.15.6:0/2442802951 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5637c981b1e0 msgr2=0x5637c9742670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:00.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.220+0000 7fcf07e00640 1 --2- 172.21.15.6:0/2442802951 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5637c981b1e0 0x5637c9742670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:00.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.220+0000 7fcf07e00640 1 -- 172.21.15.6:0/2442802951 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5637c9744650 msgr2=0x5637c9813880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:00.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.220+0000 7fcf07e00640 1 --2- 172.21.15.6:0/2442802951 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5637c9744650 0x5637c9813880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:00.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.220+0000 7fcf07e00640 1 -- 172.21.15.6:0/2442802951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637c981e0c0 con 0x5637c9791020 2024-09-10T20:57:00.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.220+0000 7fcf0e000640 1 --2- 172.21.15.6:0/2442802951 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5637c9744650 0x5637c9813880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:57:00.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.220+0000 7fcf07e00640 1 --2- 172.21.15.6:0/2442802951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637c9791020 0x5637c9742130 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fcef8000c00 tx=0x7fcef8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1c4e02d41a32b41 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:00.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.221+0000 7fcf0cc00640 1 -- 172.21.15.6:0/2442802951 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef804dd70 con 0x5637c9791020 2024-09-10T20:57:00.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.221+0000 7fcf0cc00640 1 -- 172.21.15.6:0/2442802951 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcef8056470 con 0x5637c9791020 2024-09-10T20:57:00.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.221+0000 7fcf0cc00640 1 -- 172.21.15.6:0/2442802951 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef80568c0 con 0x5637c9791020 2024-09-10T20:57:00.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.221+0000 7fcf10d51f40 1 -- 172.21.15.6:0/2442802951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637c9791020 msgr2=0x5637c9742130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:00.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.221+0000 7fcf10d51f40 1 --2- 172.21.15.6:0/2442802951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637c9791020 0x5637c9742130 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fcef8000c00 tx=0x7fcef8002fb0 comp rx=0 tx=0).stop 2024-09-10T20:57:00.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.221+0000 7fcf10d51f40 1 -- 172.21.15.6:0/2442802951 shutdown_connections 2024-09-10T20:57:00.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.221+0000 7fcf10d51f40 1 --2- 172.21.15.6:0/2442802951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637c9791020 0x5637c9742130 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:00.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.221+0000 7fcf10d51f40 1 --2- 172.21.15.6:0/2442802951 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5637c981b1e0 0x5637c9742670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:00.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.221+0000 7fcf10d51f40 1 --2- 172.21.15.6:0/2442802951 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5637c9744650 0x5637c9813880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:00.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.221+0000 7fcf10d51f40 1 -- 172.21.15.6:0/2442802951 >> 172.21.15.6:0/2442802951 conn(0x5637c9773870 msgr2=0x5637c9772e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:00.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.221+0000 7fcf10d51f40 1 -- 172.21.15.6:0/2442802951 shutdown_connections 2024-09-10T20:57:00.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.221+0000 7fcf10d51f40 1 -- 172.21.15.6:0/2442802951 wait complete. 2024-09-10T20:57:00.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.222+0000 7fcf10d51f40 1 Processor -- start 2024-09-10T20:57:00.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.222+0000 7fcf10d51f40 1 -- start start 2024-09-10T20:57:00.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.223+0000 7fcf10d51f40 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637c9744650 0x5637c97fbd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:00.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.223+0000 7fcf10d51f40 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5637c9791020 0x5637c97fb290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:00.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.223+0000 7fcf10d51f40 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5637c981b1e0 0x5637c97725e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:00.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.223+0000 7fcf10d51f40 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5637c9819ef0 con 0x5637c9744650 2024-09-10T20:57:00.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.223+0000 7fcf10d51f40 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5637c981de70 con 0x5637c981b1e0 2024-09-10T20:57:00.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.223+0000 7fcf10d51f40 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x5637c981a1d0 con 0x5637c9791020 2024-09-10T20:57:00.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.223+0000 7fcf0e000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637c9744650 0x5637c97fbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:00.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.223+0000 7fcf0e000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637c9744650 0x5637c97fbd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34916/0 (socket says 172.21.15.6:34916) 2024-09-10T20:57:00.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.223+0000 7fcf0e000640 1 -- 172.21.15.6:0/3328516232 learned_addr learned my addr 172.21.15.6:0/3328516232 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:00.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.223+0000 7fcf07e00640 1 --2- 172.21.15.6:0/3328516232 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5637c9791020 0x5637c97fb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:00.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.223+0000 7fcf0ea00640 1 --2- 172.21.15.6:0/3328516232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5637c981b1e0 0x5637c97725e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:00.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.224+0000 7fcf0e000640 1 -- 172.21.15.6:0/3328516232 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5637c9791020 msgr2=0x5637c97fb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:00.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.224+0000 7fcf0e000640 1 --2- 172.21.15.6:0/3328516232 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5637c9791020 0x5637c97fb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:00.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.224+0000 7fcf0e000640 1 -- 172.21.15.6:0/3328516232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5637c981b1e0 msgr2=0x5637c97725e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:00.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.224+0000 7fcf0e000640 1 --2- 172.21.15.6:0/3328516232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5637c981b1e0 0x5637c97725e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:00.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.224+0000 7fcf0e000640 1 -- 172.21.15.6:0/3328516232 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637c981cab0 con 0x5637c9744650 2024-09-10T20:57:00.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.224+0000 7fcf0e000640 1 --2- 172.21.15.6:0/3328516232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637c9744650 0x5637c97fbd70 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fcf0000a450 tx=0x7fcf0000a910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:00.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.224+0000 7fcf06a00640 1 -- 172.21.15.6:0/3328516232 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf00008740 con 0x5637c9744650 2024-09-10T20:57:00.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.224+0000 7fcf06a00640 1 -- 172.21.15.6:0/3328516232 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf000088e0 con 0x5637c9744650 2024-09-10T20:57:00.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.224+0000 7fcf06a00640 1 -- 172.21.15.6:0/3328516232 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf00008cb0 con 0x5637c9744650 2024-09-10T20:57:00.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.224+0000 7fcf10d51f40 1 -- 172.21.15.6:0/3328516232 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5637c981cd50 con 0x5637c9744650 2024-09-10T20:57:00.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.225+0000 7fcf10d51f40 1 -- 172.21.15.6:0/3328516232 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637c9814930 con 0x5637c9744650 2024-09-10T20:57:00.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.226+0000 7fcf06a00640 1 -- 172.21.15.6:0/3328516232 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fcf0001e030 con 0x5637c9744650 2024-09-10T20:57:00.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.227+0000 7fcf06a00640 1 --2- 172.21.15.6:0/3328516232 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fceec076950 0x7fceec078e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:00.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.227+0000 7fcf06a00640 1 -- 172.21.15.6:0/3328516232 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6104+0+0 (secure 0 0 0) 0x7fcf000987e0 con 0x5637c9744650 2024-09-10T20:57:00.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.228+0000 7fcf10d51f40 1 --2- 172.21.15.6:0/3328516232 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x5637c980fe40 0x5637c9814e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:00.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.228+0000 7fcf10d51f40 1 -- 172.21.15.6:0/3328516232 --> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] -- osd_op(unknown.0.0:1 5.13 5:ca8fdbba:::100000001fb.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38) -- 0x5637c9815390 con 0x5637c980fe40 2024-09-10T20:57:00.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.228+0000 7fcf07e00640 1 --2- 172.21.15.6:0/3328516232 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fceec076950 0x7fceec078e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:00.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.228+0000 7fcf0ea00640 1 --2- 172.21.15.6:0/3328516232 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x5637c980fe40 0x5637c9814e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:00.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.229+0000 7fcf0ea00640 1 --2- 172.21.15.6:0/3328516232 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x5637c980fe40 0x5637c9814e50 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:00.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.229+0000 7fcf07e00640 1 --2- 172.21.15.6:0/3328516232 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fceec076950 0x7fceec078e10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcef8004f50 tx=0x7fcef8004940 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:00.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.229+0000 7fcf0ea00640 1 -- 172.21.15.6:0/3328516232 <== osd.3 v2:172.21.15.6:6816/3911674247 1 ==== osd_op_reply(1 100000001fb.00000000 [getxattr (103) out=103b] v0'0 uv3 ondisk = 0) ==== 164+0+103 (crc 0 0 0) 0x7fcf080105a0 con 0x5637c980fe40 2024-09-10T20:57:00.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.229+0000 7fcf10d51f40 1 -- 172.21.15.6:0/3328516232 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x5637c980fe40 msgr2=0x5637c9814e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:00.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.229+0000 7fcf10d51f40 1 --2- 172.21.15.6:0/3328516232 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x5637c980fe40 0x5637c9814e50 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:00.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.229+0000 7fcf10d51f40 1 -- 172.21.15.6:0/3328516232 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fceec076950 msgr2=0x7fceec078e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:00.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.229+0000 7fcf10d51f40 1 --2- 172.21.15.6:0/3328516232 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fceec076950 0x7fceec078e10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcef8004f50 tx=0x7fcef8004940 comp rx=0 tx=0).stop 2024-09-10T20:57:00.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.229+0000 7fcf10d51f40 1 -- 172.21.15.6:0/3328516232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637c9744650 msgr2=0x5637c97fbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:00.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.229+0000 7fcf10d51f40 1 --2- 172.21.15.6:0/3328516232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5637c9744650 0x5637c97fbd70 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fcf0000a450 tx=0x7fcf0000a910 comp rx=0 tx=0).stop 2024-09-10T20:57:00.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.229+0000 7fcf0ea00640 1 -- 172.21.15.6:0/3328516232 reap_dead start 2024-09-10T20:57:00.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.229+0000 7fcf10d51f40 1 -- 172.21.15.6:0/3328516232 shutdown_connections 2024-09-10T20:57:00.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.229+0000 7fcf10d51f40 1 -- 172.21.15.6:0/3328516232 >> 172.21.15.6:0/3328516232 conn(0x5637c9773870 msgr2=0x5637c98197c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:00.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.229+0000 7fcf10d51f40 1 -- 172.21.15.6:0/3328516232 shutdown_connections 2024-09-10T20:57:00.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.229+0000 7fcf10d51f40 1 -- 172.21.15.6:0/3328516232 wait complete. 2024-09-10T20:57:00.237 INFO:teuthology.orchestra.run.smithi006.stdout:a��alpha parent_b$ 2024-09-10T20:57:00.237 DEBUG:teuthology.orchestra.run.smithi006:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-09-10T20:57:00.318 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-10T20:57:00.318 INFO:teuthology.orchestra.run.smithi006.stdout: "ino": 1099511628283, 2024-09-10T20:57:00.318 INFO:teuthology.orchestra.run.smithi006.stdout: "ancestors": [ 2024-09-10T20:57:00.318 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-10T20:57:00.318 INFO:teuthology.orchestra.run.smithi006.stdout: "dirino": 1099511628284, 2024-09-10T20:57:00.319 INFO:teuthology.orchestra.run.smithi006.stdout: "dname": "alpha", 2024-09-10T20:57:00.319 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 9 2024-09-10T20:57:00.319 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-10T20:57:00.319 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-10T20:57:00.319 INFO:teuthology.orchestra.run.smithi006.stdout: "dirino": 1, 2024-09-10T20:57:00.319 INFO:teuthology.orchestra.run.smithi006.stdout: "dname": "parent_b", 2024-09-10T20:57:00.319 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 36 2024-09-10T20:57:00.319 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-10T20:57:00.319 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-10T20:57:00.319 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 6, 2024-09-10T20:57:00.319 INFO:teuthology.orchestra.run.smithi006.stdout: "old_pools": [ 2024-09-10T20:57:00.319 INFO:teuthology.orchestra.run.smithi006.stdout: 5 2024-09-10T20:57:00.319 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-10T20:57:00.319 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-10T20:57:00.319 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:57:00.323 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool data_new getxattr 100000001fb.00000000 parent 2024-09-10T20:57:00.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.437+0000 7fda42f51f40 1 Processor -- start 2024-09-10T20:57:00.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.437+0000 7fda42f51f40 1 -- start start 2024-09-10T20:57:00.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.438+0000 7fda42f51f40 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x557611828650 0x557611901790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:00.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.438+0000 7fda42f51f40 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557611858b70 0x557611901cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:00.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.438+0000 7fda42f51f40 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5576118ff1e0 0x55761198cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:00.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.438+0000 7fda42f51f40 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x557611777c60 con 0x5576118ff1e0 2024-09-10T20:57:00.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.438+0000 7fda42f51f40 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5576117d61d0 con 0x557611858b70 2024-09-10T20:57:00.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.438+0000 7fda42f51f40 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x557611874120 con 0x557611828650 2024-09-10T20:57:00.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.438+0000 7fda40c00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5576118ff1e0 0x55761198cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:00.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.438+0000 7fda40c00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5576118ff1e0 0x55761198cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34928/0 (socket says 172.21.15.6:34928) 2024-09-10T20:57:00.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.438+0000 7fda40c00640 1 -- 172.21.15.6:0/725467197 learned_addr learned my addr 172.21.15.6:0/725467197 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:00.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.438+0000 7fda40200640 1 --2- 172.21.15.6:0/725467197 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x557611828650 0x557611901790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:00.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.438+0000 7fda3f800640 1 --2- 172.21.15.6:0/725467197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557611858b70 0x557611901cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:00.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.439+0000 7fda40c00640 1 -- 172.21.15.6:0/725467197 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x557611828650 msgr2=0x557611901790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:00.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.439+0000 7fda40c00640 1 --2- 172.21.15.6:0/725467197 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x557611828650 0x557611901790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:00.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.439+0000 7fda40c00640 1 -- 172.21.15.6:0/725467197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557611858b70 msgr2=0x557611901cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:00.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.439+0000 7fda40c00640 1 --2- 172.21.15.6:0/725467197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557611858b70 0x557611901cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:00.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.439+0000 7fda40c00640 1 -- 172.21.15.6:0/725467197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557611902560 con 0x5576118ff1e0 2024-09-10T20:57:00.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.439+0000 7fda40c00640 1 --2- 172.21.15.6:0/725467197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5576118ff1e0 0x55761198cc70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fda3800a550 tx=0x7fda38003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcab55a2b65cff6e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:00.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.439+0000 7fda3e400640 1 -- 172.21.15.6:0/725467197 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda38064030 con 0x5576118ff1e0 2024-09-10T20:57:00.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.439+0000 7fda3e400640 1 -- 172.21.15.6:0/725467197 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda38004020 con 0x5576118ff1e0 2024-09-10T20:57:00.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.439+0000 7fda3e400640 1 -- 172.21.15.6:0/725467197 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda38004270 con 0x5576118ff1e0 2024-09-10T20:57:00.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.440+0000 7fda42f51f40 1 -- 172.21.15.6:0/725467197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5576118ff1e0 msgr2=0x55761198cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:00.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.440+0000 7fda42f51f40 1 --2- 172.21.15.6:0/725467197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5576118ff1e0 0x55761198cc70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fda3800a550 tx=0x7fda38003330 comp rx=0 tx=0).stop 2024-09-10T20:57:00.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.440+0000 7fda42f51f40 1 -- 172.21.15.6:0/725467197 shutdown_connections 2024-09-10T20:57:00.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.440+0000 7fda42f51f40 1 --2- 172.21.15.6:0/725467197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5576118ff1e0 0x55761198cc70 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:00.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.440+0000 7fda42f51f40 1 --2- 172.21.15.6:0/725467197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557611858b70 0x557611901cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:00.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.440+0000 7fda42f51f40 1 --2- 172.21.15.6:0/725467197 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x557611828650 0x557611901790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:00.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.440+0000 7fda42f51f40 1 -- 172.21.15.6:0/725467197 >> 172.21.15.6:0/725467197 conn(0x557611857870 msgr2=0x557611856e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:00.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.440+0000 7fda42f51f40 1 -- 172.21.15.6:0/725467197 shutdown_connections 2024-09-10T20:57:00.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.440+0000 7fda42f51f40 1 -- 172.21.15.6:0/725467197 wait complete. 2024-09-10T20:57:00.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.441+0000 7fda42f51f40 1 Processor -- start 2024-09-10T20:57:00.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.441+0000 7fda42f51f40 1 -- start start 2024-09-10T20:57:00.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.441+0000 7fda42f51f40 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557611828650 0x5576118f3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:00.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.441+0000 7fda42f51f40 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557611858b70 0x5576118f7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:00.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.442+0000 7fda42f51f40 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5576118ff1e0 0x5576118f8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:00.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.442+0000 7fda42f51f40 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5576118f7d40 con 0x557611828650 2024-09-10T20:57:00.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.442+0000 7fda42f51f40 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5576118f7a60 con 0x557611858b70 2024-09-10T20:57:00.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.442+0000 7fda42f51f40 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x55761198de20 con 0x5576118ff1e0 2024-09-10T20:57:00.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.442+0000 7fda40200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557611828650 0x5576118f3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:00.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.442+0000 7fda40200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557611828650 0x5576118f3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34944/0 (socket says 172.21.15.6:34944) 2024-09-10T20:57:00.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.442+0000 7fda40200640 1 -- 172.21.15.6:0/1807913630 learned_addr learned my addr 172.21.15.6:0/1807913630 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:00.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.442+0000 7fda3f800640 1 --2- 172.21.15.6:0/1807913630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557611858b70 0x5576118f7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:00.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.442+0000 7fda40c00640 1 --2- 172.21.15.6:0/1807913630 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5576118ff1e0 0x5576118f8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:00.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.442+0000 7fda40200640 1 -- 172.21.15.6:0/1807913630 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5576118ff1e0 msgr2=0x5576118f8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:00.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.442+0000 7fda40200640 1 --2- 172.21.15.6:0/1807913630 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5576118ff1e0 0x5576118f8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:00.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.442+0000 7fda40200640 1 -- 172.21.15.6:0/1807913630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557611858b70 msgr2=0x5576118f7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:00.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.442+0000 7fda40200640 1 --2- 172.21.15.6:0/1807913630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557611858b70 0x5576118f7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:00.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.442+0000 7fda40200640 1 -- 172.21.15.6:0/1807913630 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55761185bae0 con 0x557611828650 2024-09-10T20:57:00.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.442+0000 7fda3f800640 1 --2- 172.21.15.6:0/1807913630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557611858b70 0x5576118f7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:57:00.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.442+0000 7fda40c00640 1 --2- 172.21.15.6:0/1807913630 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5576118ff1e0 0x5576118f8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:57:00.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.442+0000 7fda40200640 1 --2- 172.21.15.6:0/1807913630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557611828650 0x5576118f3790 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fda3000a710 tx=0x7fda3000abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:00.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.443+0000 7fda3d000640 1 -- 172.21.15.6:0/1807913630 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda30009b40 con 0x557611828650 2024-09-10T20:57:00.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.443+0000 7fda3d000640 1 -- 172.21.15.6:0/1807913630 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda30009ce0 con 0x557611828650 2024-09-10T20:57:00.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.443+0000 7fda3d000640 1 -- 172.21.15.6:0/1807913630 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda30017690 con 0x557611828650 2024-09-10T20:57:00.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.443+0000 7fda42f51f40 1 -- 172.21.15.6:0/1807913630 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5576118f45b0 con 0x557611828650 2024-09-10T20:57:00.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.443+0000 7fda42f51f40 1 -- 172.21.15.6:0/1807913630 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576118f4a60 con 0x557611828650 2024-09-10T20:57:00.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.445+0000 7fda3d000640 1 -- 172.21.15.6:0/1807913630 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fda30017830 con 0x557611828650 2024-09-10T20:57:00.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.446+0000 7fda3d000640 1 --2- 172.21.15.6:0/1807913630 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fda20076950 0x7fda20078e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:00.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.446+0000 7fda3d000640 1 -- 172.21.15.6:0/1807913630 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6104+0+0 (secure 0 0 0) 0x7fda30099740 con 0x557611828650 2024-09-10T20:57:00.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.446+0000 7fda3f800640 1 --2- 172.21.15.6:0/1807913630 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fda20076950 0x7fda20078e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:00.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.446+0000 7fda42f51f40 1 --2- 172.21.15.6:0/1807913630 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x557611828210 0x5576118f8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:00.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.446+0000 7fda42f51f40 1 -- 172.21.15.6:0/1807913630 --> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] -- osd_op(unknown.0.0:1 6.13 6:ca8fdbba:::100000001fb.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38) -- 0x5576118f9130 con 0x557611828210 2024-09-10T20:57:00.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.446+0000 7fda40c00640 1 --2- 172.21.15.6:0/1807913630 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x557611828210 0x5576118f8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:00.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.447+0000 7fda3f800640 1 --2- 172.21.15.6:0/1807913630 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fda20076950 0x7fda20078e10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x5576118f7a30 tx=0x7fda2c003050 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:00.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.447+0000 7fda40c00640 1 --2- 172.21.15.6:0/1807913630 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x557611828210 0x5576118f8bf0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:00.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.447+0000 7fda40c00640 1 -- 172.21.15.6:0/1807913630 <== osd.3 v2:172.21.15.6:6816/3911674247 1 ==== osd_op_reply(1 100000001fb.00000000 [getxattr (103) out=103b] v0'0 uv1 ondisk = 0) ==== 164+0+103 (crc 0 0 0) 0x7fda3800b040 con 0x557611828210 2024-09-10T20:57:00.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.447+0000 7fda42f51f40 1 -- 172.21.15.6:0/1807913630 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x557611828210 msgr2=0x5576118f8bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:00.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.447+0000 7fda42f51f40 1 --2- 172.21.15.6:0/1807913630 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x557611828210 0x5576118f8bf0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:00.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.448+0000 7fda42f51f40 1 -- 172.21.15.6:0/1807913630 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fda20076950 msgr2=0x7fda20078e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:00.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.448+0000 7fda42f51f40 1 --2- 172.21.15.6:0/1807913630 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fda20076950 0x7fda20078e10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x5576118f7a30 tx=0x7fda2c003050 comp rx=0 tx=0).stop 2024-09-10T20:57:00.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.448+0000 7fda42f51f40 1 -- 172.21.15.6:0/1807913630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557611828650 msgr2=0x5576118f3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:00.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.448+0000 7fda42f51f40 1 --2- 172.21.15.6:0/1807913630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557611828650 0x5576118f3790 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fda3000a710 tx=0x7fda3000abd0 comp rx=0 tx=0).stop 2024-09-10T20:57:00.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.448+0000 7fda40c00640 1 -- 172.21.15.6:0/1807913630 reap_dead start 2024-09-10T20:57:00.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.448+0000 7fda42f51f40 1 -- 172.21.15.6:0/1807913630 shutdown_connections 2024-09-10T20:57:00.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.448+0000 7fda42f51f40 1 -- 172.21.15.6:0/1807913630 >> 172.21.15.6:0/1807913630 conn(0x557611857870 msgr2=0x5576118565e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:00.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.448+0000 7fda42f51f40 1 -- 172.21.15.6:0/1807913630 shutdown_connections 2024-09-10T20:57:00.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.448+0000 7fda42f51f40 1 -- 172.21.15.6:0/1807913630 wait complete. 2024-09-10T20:57:00.456 INFO:teuthology.orchestra.run.smithi006.stdout:a��alpha parent_b$ 2024-09-10T20:57:00.456 DEBUG:teuthology.orchestra.run.smithi006:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-09-10T20:57:00.537 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-10T20:57:00.537 INFO:teuthology.orchestra.run.smithi006.stdout: "ino": 1099511628283, 2024-09-10T20:57:00.537 INFO:teuthology.orchestra.run.smithi006.stdout: "ancestors": [ 2024-09-10T20:57:00.538 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-10T20:57:00.538 INFO:teuthology.orchestra.run.smithi006.stdout: "dirino": 1099511628284, 2024-09-10T20:57:00.538 INFO:teuthology.orchestra.run.smithi006.stdout: "dname": "alpha", 2024-09-10T20:57:00.538 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 9 2024-09-10T20:57:00.538 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-10T20:57:00.538 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-10T20:57:00.538 INFO:teuthology.orchestra.run.smithi006.stdout: "dirino": 1, 2024-09-10T20:57:00.538 INFO:teuthology.orchestra.run.smithi006.stdout: "dname": "parent_b", 2024-09-10T20:57:00.538 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 36 2024-09-10T20:57:00.538 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-10T20:57:00.538 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-10T20:57:00.538 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 6, 2024-09-10T20:57:00.538 INFO:teuthology.orchestra.run.smithi006.stdout: "old_pools": [ 2024-09-10T20:57:00.539 INFO:teuthology.orchestra.run.smithi006.stdout: 5 2024-09-10T20:57:00.539 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-10T20:57:00.539 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-10T20:57:00.539 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:57:00.543 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool data_new getxattr 100000001fb.00000000 layout 2024-09-10T20:57:00.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.655+0000 7f5311f20f40 1 Processor -- start 2024-09-10T20:57:00.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.655+0000 7f5311f20f40 1 -- start start 2024-09-10T20:57:00.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.656+0000 7f5311f20f40 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x558b1053b650 0x558b106136a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:00.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.656+0000 7f5311f20f40 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558b10588020 0x558b1060e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:00.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.656+0000 7f5311f20f40 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558b106121e0 0x558b10606a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:00.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.656+0000 7f5311f20f40 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x558b10587340 con 0x558b106121e0 2024-09-10T20:57:00.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.656+0000 7f5311f20f40 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x558b1048ac60 con 0x558b10588020 2024-09-10T20:57:00.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.656+0000 7f5311f20f40 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x558b106125c0 con 0x558b1053b650 2024-09-10T20:57:00.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.656+0000 7f530f200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558b106121e0 0x558b10606a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:00.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.656+0000 7f530f200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558b106121e0 0x558b10606a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34962/0 (socket says 172.21.15.6:34962) 2024-09-10T20:57:00.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.656+0000 7f530f200640 1 -- 172.21.15.6:0/1251065440 learned_addr learned my addr 172.21.15.6:0/1251065440 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:00.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.656+0000 7f5307e00640 1 --2- 172.21.15.6:0/1251065440 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558b10588020 0x558b1060e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:00.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.656+0000 7f530e800640 1 --2- 172.21.15.6:0/1251065440 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x558b1053b650 0x558b106136a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:00.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.657+0000 7f530f200640 1 -- 172.21.15.6:0/1251065440 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x558b1053b650 msgr2=0x558b106136a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:00.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.657+0000 7f530f200640 1 --2- 172.21.15.6:0/1251065440 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x558b1053b650 0x558b106136a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:00.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.657+0000 7f530f200640 1 -- 172.21.15.6:0/1251065440 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558b10588020 msgr2=0x558b1060e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:00.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.657+0000 7f530f200640 1 --2- 172.21.15.6:0/1251065440 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558b10588020 0x558b1060e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:00.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.657+0000 7f530f200640 1 -- 172.21.15.6:0/1251065440 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b10462f10 con 0x558b106121e0 2024-09-10T20:57:00.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.657+0000 7f530f200640 1 --2- 172.21.15.6:0/1251065440 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558b106121e0 0x558b10606a70 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f530800c770 tx=0x7f530800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af464ef624bd7616 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:00.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.657+0000 7f530d400640 1 -- 172.21.15.6:0/1251065440 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5308013070 con 0x558b106121e0 2024-09-10T20:57:00.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.657+0000 7f530d400640 1 -- 172.21.15.6:0/1251065440 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f530800ab30 con 0x558b106121e0 2024-09-10T20:57:00.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.657+0000 7f530d400640 1 -- 172.21.15.6:0/1251065440 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f530800f460 con 0x558b106121e0 2024-09-10T20:57:00.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.658+0000 7f5311f20f40 1 -- 172.21.15.6:0/1251065440 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558b106121e0 msgr2=0x558b10606a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:00.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.658+0000 7f5311f20f40 1 --2- 172.21.15.6:0/1251065440 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558b106121e0 0x558b10606a70 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f530800c770 tx=0x7f530800cc30 comp rx=0 tx=0).stop 2024-09-10T20:57:00.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.658+0000 7f5311f20f40 1 -- 172.21.15.6:0/1251065440 shutdown_connections 2024-09-10T20:57:00.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.658+0000 7f5311f20f40 1 --2- 172.21.15.6:0/1251065440 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558b106121e0 0x558b10606a70 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:00.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.658+0000 7f5311f20f40 1 --2- 172.21.15.6:0/1251065440 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558b10588020 0x558b1060e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:00.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.658+0000 7f5311f20f40 1 --2- 172.21.15.6:0/1251065440 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x558b1053b650 0x558b106136a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:00.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.658+0000 7f5311f20f40 1 -- 172.21.15.6:0/1251065440 >> 172.21.15.6:0/1251065440 conn(0x558b1056a870 msgr2=0x558b105695e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:00.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.658+0000 7f5311f20f40 1 -- 172.21.15.6:0/1251065440 shutdown_connections 2024-09-10T20:57:00.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.658+0000 7f5311f20f40 1 -- 172.21.15.6:0/1251065440 wait complete. 2024-09-10T20:57:00.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.659+0000 7f5311f20f40 1 Processor -- start 2024-09-10T20:57:00.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.659+0000 7f5311f20f40 1 -- start start 2024-09-10T20:57:00.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.659+0000 7f5311f20f40 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558b1053b650 0x558b1060f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:00.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.660+0000 7f5311f20f40 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558b10588020 0x558b10614670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:00.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.660+0000 7f5311f20f40 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x558b106121e0 0x558b10610250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:00.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.660+0000 7f5311f20f40 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x558b1056a2d0 con 0x558b10588020 2024-09-10T20:57:00.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.660+0000 7f5311f20f40 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x558b1060d3a0 con 0x558b1053b650 2024-09-10T20:57:00.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.660+0000 7f5311f20f40 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x558b10607160 con 0x558b106121e0 2024-09-10T20:57:00.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.660+0000 7f5307e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558b10588020 0x558b10614670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:00.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.660+0000 7f5307e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558b10588020 0x558b10614670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34972/0 (socket says 172.21.15.6:34972) 2024-09-10T20:57:00.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.660+0000 7f5307e00640 1 -- 172.21.15.6:0/1216791020 learned_addr learned my addr 172.21.15.6:0/1216791020 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:00.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.660+0000 7f5307e00640 1 -- 172.21.15.6:0/1216791020 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x558b106121e0 msgr2=0x558b10610250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:00.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.660+0000 7f5307e00640 1 --2- 172.21.15.6:0/1216791020 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x558b106121e0 0x558b10610250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:00.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.660+0000 7f5307e00640 1 -- 172.21.15.6:0/1216791020 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558b1053b650 msgr2=0x558b1060f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:00.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.660+0000 7f5307e00640 1 --2- 172.21.15.6:0/1216791020 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558b1053b650 0x558b1060f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:00.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.660+0000 7f5307e00640 1 -- 172.21.15.6:0/1216791020 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b10608e70 con 0x558b10588020 2024-09-10T20:57:00.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.660+0000 7f5307e00640 1 --2- 172.21.15.6:0/1216791020 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558b10588020 0x558b10614670 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f52f8008720 tx=0x7f52f8008810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:00.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.661+0000 7f5307400640 1 -- 172.21.15.6:0/1216791020 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f800a850 con 0x558b10588020 2024-09-10T20:57:00.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.661+0000 7f5307400640 1 -- 172.21.15.6:0/1216791020 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f52f800a9f0 con 0x558b10588020 2024-09-10T20:57:00.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.661+0000 7f5307400640 1 -- 172.21.15.6:0/1216791020 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f800ae00 con 0x558b10588020 2024-09-10T20:57:00.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.661+0000 7f5311f20f40 1 -- 172.21.15.6:0/1216791020 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558b10609150 con 0x558b10588020 2024-09-10T20:57:00.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.661+0000 7f5311f20f40 1 -- 172.21.15.6:0/1216791020 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b10609710 con 0x558b10588020 2024-09-10T20:57:00.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.663+0000 7f5307400640 1 -- 172.21.15.6:0/1216791020 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f52f8016430 con 0x558b10588020 2024-09-10T20:57:00.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.664+0000 7f5307400640 1 --2- 172.21.15.6:0/1216791020 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f52ec076950 0x7f52ec078e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:00.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.664+0000 7f5307400640 1 -- 172.21.15.6:0/1216791020 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6104+0+0 (secure 0 0 0) 0x7f52f8099500 con 0x558b10588020 2024-09-10T20:57:00.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.664+0000 7f5311f20f40 1 --2- 172.21.15.6:0/1216791020 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x558b10609f10 0x558b10610ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:00.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.664+0000 7f5311f20f40 1 -- 172.21.15.6:0/1216791020 --> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] -- osd_op(unknown.0.0:1 6.13 6:ca8fdbba:::100000001fb.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38) -- 0x558b10614bb0 con 0x558b10609f10 2024-09-10T20:57:00.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.664+0000 7f530e800640 1 --2- 172.21.15.6:0/1216791020 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f52ec076950 0x7f52ec078e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:00.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.665+0000 7f530f200640 1 --2- 172.21.15.6:0/1216791020 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x558b10609f10 0x558b10610ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:00.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.665+0000 7f530f200640 1 --2- 172.21.15.6:0/1216791020 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x558b10609f10 0x558b10610ca0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:00.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.665+0000 7f530e800640 1 --2- 172.21.15.6:0/1216791020 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f52ec076950 0x7f52ec078e10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5300055000 tx=0x7f5300002fb0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:00.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.665+0000 7f530f200640 1 -- 172.21.15.6:0/1216791020 <== osd.3 v2:172.21.15.6:6816/3911674247 1 ==== osd_op_reply(1 100000001fb.00000000 [getxattr (30) out=30b] v0'0 uv1 ondisk = 0) ==== 164+0+30 (crc 0 0 0) 0x7f5308015030 con 0x558b10609f10 2024-09-10T20:57:00.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.665+0000 7f5311f20f40 1 -- 172.21.15.6:0/1216791020 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x558b10609f10 msgr2=0x558b10610ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:00.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.666+0000 7f5311f20f40 1 --2- 172.21.15.6:0/1216791020 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x558b10609f10 0x558b10610ca0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:00.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.666+0000 7f5311f20f40 1 -- 172.21.15.6:0/1216791020 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f52ec076950 msgr2=0x7f52ec078e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:00.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.666+0000 7f5311f20f40 1 --2- 172.21.15.6:0/1216791020 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f52ec076950 0x7f52ec078e10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5300055000 tx=0x7f5300002fb0 comp rx=0 tx=0).stop 2024-09-10T20:57:00.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.666+0000 7f5311f20f40 1 -- 172.21.15.6:0/1216791020 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558b10588020 msgr2=0x558b10614670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:00.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.666+0000 7f5311f20f40 1 --2- 172.21.15.6:0/1216791020 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558b10588020 0x558b10614670 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f52f8008720 tx=0x7f52f8008810 comp rx=0 tx=0).stop 2024-09-10T20:57:00.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.666+0000 7f530f200640 1 -- 172.21.15.6:0/1216791020 reap_dead start 2024-09-10T20:57:00.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.666+0000 7f5311f20f40 1 -- 172.21.15.6:0/1216791020 shutdown_connections 2024-09-10T20:57:00.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.666+0000 7f5311f20f40 1 -- 172.21.15.6:0/1216791020 >> 172.21.15.6:0/1216791020 conn(0x558b1056a870 msgr2=0x558b106113c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:00.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.666+0000 7f5311f20f40 1 -- 172.21.15.6:0/1216791020 shutdown_connections 2024-09-10T20:57:00.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:00.666+0000 7f5311f20f40 1 -- 172.21.15.6:0/1216791020 wait complete. 2024-09-10T20:57:00.674 INFO:teuthology.orchestra.run.smithi006.stdout:@@ 2024-09-10T20:57:00.674 DEBUG:teuthology.orchestra.run.smithi006:> ceph-dencoder type file_layout_t import - decode dump_json 2024-09-10T20:57:00.754 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-10T20:57:00.754 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_unit": 4194304, 2024-09-10T20:57:00.754 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_count": 1, 2024-09-10T20:57:00.755 INFO:teuthology.orchestra.run.smithi006.stdout: "object_size": 4194304, 2024-09-10T20:57:00.755 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_id": 6, 2024-09-10T20:57:00.755 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_ns": "" 2024-09-10T20:57:00.755 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-10T20:57:00.755 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:57:00.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:57:00.760 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent_c) 2024-09-10T20:57:00.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:57:00.838 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec mv parent_b/alpha parent_c/alpha) 2024-09-10T20:57:00.921 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:57:01.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.118+0000 7f2ebde00640 1 -- 172.21.15.6:0/1637769287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb806fd40 msgr2=0x7f2eb80701b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:01.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.118+0000 7f2ebde00640 1 --2- 172.21.15.6:0/1637769287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb806fd40 0x7f2eb80701b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8051860 tx=0x7f2eb002a980 comp rx=0 tx=0).stop 2024-09-10T20:57:01.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.118+0000 7f2ebde00640 1 -- 172.21.15.6:0/1637769287 shutdown_connections 2024-09-10T20:57:01.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.118+0000 7f2ebde00640 1 --2- 172.21.15.6:0/1637769287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb806fd40 0x7f2eb80701b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:01.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.118+0000 7f2ebde00640 1 --2- 172.21.15.6:0/1637769287 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2eb815c170 0x7f2eb80cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:01.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.118+0000 7f2ebde00640 1 --2- 172.21.15.6:0/1637769287 >> v2:172.21.15.150:3300/0 conn(0x7f2eb8159670 0x7f2eb80743b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:01.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.118+0000 7f2ebde00640 1 -- 172.21.15.6:0/1637769287 >> 172.21.15.6:0/1637769287 conn(0x7f2eb80cfa20 msgr2=0x7f2eb80cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:01.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.118+0000 7f2ebde00640 1 -- 172.21.15.6:0/1637769287 shutdown_connections 2024-09-10T20:57:01.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.118+0000 7f2ebde00640 1 -- 172.21.15.6:0/1637769287 wait complete. 2024-09-10T20:57:01.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.119+0000 7f2ebde00640 1 Processor -- start 2024-09-10T20:57:01.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.120+0000 7f2ebde00640 1 -- start start 2024-09-10T20:57:01.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.120+0000 7f2ebde00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2eb806fd40 0x7f2eb81487d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:01.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.120+0000 7f2ebde00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb8159670 0x7f2eb80c6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:01.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.120+0000 7f2ebde00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2eb815c170 0x7f2eb80b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:01.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.121+0000 7f2ebde00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb80b4a90 con 0x7f2eb8159670 2024-09-10T20:57:01.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.121+0000 7f2ebde00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb80b4910 con 0x7f2eb806fd40 2024-09-10T20:57:01.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.121+0000 7f2ebde00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f2eb80b4c10 con 0x7f2eb815c170 2024-09-10T20:57:01.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.121+0000 7f2eb6000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb8159670 0x7f2eb80c6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:01.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.121+0000 7f2eb6000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb8159670 0x7f2eb80c6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34990/0 (socket says 172.21.15.6:34990) 2024-09-10T20:57:01.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.121+0000 7f2eb6000640 1 -- 172.21.15.6:0/3115322340 learned_addr learned my addr 172.21.15.6:0/3115322340 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:01.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.121+0000 7f2eb6a00640 1 --2- 172.21.15.6:0/3115322340 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2eb806fd40 0x7f2eb81487d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:01.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.121+0000 7f2eb7400640 1 --2- 172.21.15.6:0/3115322340 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2eb815c170 0x7f2eb80b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:01.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.121+0000 7f2eb6000640 1 -- 172.21.15.6:0/3115322340 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2eb815c170 msgr2=0x7f2eb80b06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:01.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.121+0000 7f2eb6000640 1 --2- 172.21.15.6:0/3115322340 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2eb815c170 0x7f2eb80b06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:01.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.121+0000 7f2eb6000640 1 -- 172.21.15.6:0/3115322340 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2eb806fd40 msgr2=0x7f2eb81487d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:01.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.121+0000 7f2eb6000640 1 --2- 172.21.15.6:0/3115322340 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2eb806fd40 0x7f2eb81487d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:01.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.121+0000 7f2eb6000640 1 -- 172.21.15.6:0/3115322340 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb8148d10 con 0x7f2eb8159670 2024-09-10T20:57:01.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.122+0000 7f2eb6000640 1 --2- 172.21.15.6:0/3115322340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb8159670 0x7f2eb80c6250 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2ea400d770 tx=0x7f2ea400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:01.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.122+0000 7f2eaf400640 1 -- 172.21.15.6:0/3115322340 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4017070 con 0x7f2eb8159670 2024-09-10T20:57:01.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.122+0000 7f2eaf400640 1 -- 172.21.15.6:0/3115322340 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ea4009cc0 con 0x7f2eb8159670 2024-09-10T20:57:01.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.122+0000 7f2eaf400640 1 -- 172.21.15.6:0/3115322340 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4005280 con 0x7f2eb8159670 2024-09-10T20:57:01.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.122+0000 7f2ebde00640 1 -- 172.21.15.6:0/3115322340 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2eb814be90 con 0x7f2eb8159670 2024-09-10T20:57:01.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.122+0000 7f2ebde00640 1 -- 172.21.15.6:0/3115322340 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2eb80c5a50 con 0x7f2eb8159670 2024-09-10T20:57:01.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.123+0000 7f2ebde00640 1 -- 172.21.15.6:0/3115322340 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2eb80b51a0 con 0x7f2eb8159670 2024-09-10T20:57:01.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.124+0000 7f2eaf400640 1 -- 172.21.15.6:0/3115322340 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2ea4005420 con 0x7f2eb8159670 2024-09-10T20:57:01.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.125+0000 7f2eaf400640 1 --2- 172.21.15.6:0/3115322340 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2e98077f70 0x7f2e9807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:01.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.125+0000 7f2eaf400640 1 -- 172.21.15.6:0/3115322340 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6104+0+0 (secure 0 0 0) 0x7f2ea409a110 con 0x7f2eb8159670 2024-09-10T20:57:01.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.126+0000 7f2eb6a00640 1 --2- 172.21.15.6:0/3115322340 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2e98077f70 0x7f2e9807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:01.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.127+0000 7f2eb6a00640 1 --2- 172.21.15.6:0/3115322340 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2e98077f70 0x7f2e9807a430 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8009b50 tx=0x7f2ea8005f90 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:01.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.129+0000 7f2eaf400640 1 -- 172.21.15.6:0/3115322340 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2ea4062300 con 0x7f2eb8159670 2024-09-10T20:57:01.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.365+0000 7f2ebde00640 1 -- 172.21.15.6:0/3115322340 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2eb8069d20 con 0x7f2eb8159670 2024-09-10T20:57:01.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.366+0000 7f2eaf400640 1 -- 172.21.15.6:0/3115322340 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5222 (secure 0 0 0) 0x7f2ea406b100 con 0x7f2eb8159670 2024-09-10T20:57:01.370 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:57:01.370 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":18,"btime":"2024-09-10T20:56:58:138800+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1675451102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1675451102},{"type":"v1","addr":"172.21.15.6:6834","nonce":1675451102}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4924,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/676153174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":676153174},{"type":"v1","addr":"172.21.15.150:6836","nonce":676153174}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4950,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4072260905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":4072260905},{"type":"v1","addr":"172.21.15.150:6837","nonce":4072260905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:56:37.566072+0000","modified":"2024-09-10T20:56:57.568755+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4956":{"gid":4956,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/1598644433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1598644433},{"type":"v1","addr":"172.21.15.6:6835","nonce":1598644433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5,6],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4956,"qdb_cluster":[4956]},"id":2}]} 2024-09-10T20:57:01.370 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 18 2024-09-10T20:57:01.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.368+0000 7f2ebde00640 1 -- 172.21.15.6:0/3115322340 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2e98077f70 msgr2=0x7f2e9807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:01.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.368+0000 7f2ebde00640 1 --2- 172.21.15.6:0/3115322340 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2e98077f70 0x7f2e9807a430 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8009b50 tx=0x7f2ea8005f90 comp rx=0 tx=0).stop 2024-09-10T20:57:01.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.368+0000 7f2ebde00640 1 -- 172.21.15.6:0/3115322340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb8159670 msgr2=0x7f2eb80c6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:01.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.368+0000 7f2ebde00640 1 --2- 172.21.15.6:0/3115322340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb8159670 0x7f2eb80c6250 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2ea400d770 tx=0x7f2ea400dc30 comp rx=0 tx=0).stop 2024-09-10T20:57:01.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.368+0000 7f2ebde00640 1 -- 172.21.15.6:0/3115322340 shutdown_connections 2024-09-10T20:57:01.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.368+0000 7f2ebde00640 1 --2- 172.21.15.6:0/3115322340 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2e98077f70 0x7f2e9807a430 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:01.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.368+0000 7f2ebde00640 1 --2- 172.21.15.6:0/3115322340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb8159670 0x7f2eb80c6250 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:01.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.368+0000 7f2ebde00640 1 --2- 172.21.15.6:0/3115322340 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2eb815c170 0x7f2eb80b06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:01.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.368+0000 7f2ebde00640 1 --2- 172.21.15.6:0/3115322340 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2eb806fd40 0x7f2eb81487d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:01.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.368+0000 7f2ebde00640 1 -- 172.21.15.6:0/3115322340 >> 172.21.15.6:0/3115322340 conn(0x7f2eb80cfa20 msgr2=0x7f2eb8073e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:01.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.368+0000 7f2ebde00640 1 -- 172.21.15.6:0/3115322340 shutdown_connections 2024-09-10T20:57:01.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.368+0000 7f2ebde00640 1 -- 172.21.15.6:0/3115322340 wait complete. 2024-09-10T20:57:01.389 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-09-10T20:57:01.575 INFO:teuthology.orchestra.run.smithi006.stdout:{"message":"","return_code":0} 2024-09-10T20:57:01.575 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-10T20:57:01.576 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001fb.00000000 parent 2024-09-10T20:57:01.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.651+0000 7fec37421f40 1 Processor -- start 2024-09-10T20:57:01.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.651+0000 7fec37421f40 1 -- start start 2024-09-10T20:57:01.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.651+0000 7fec37421f40 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec180030f0 0x55d721630510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:01.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.651+0000 7fec37421f40 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55d7215c0080 0x55d7215a7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:01.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.652+0000 7fec37421f40 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d721648510 0x55d7215a8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:01.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.652+0000 7fec37421f40 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55d7215241d0 con 0x7fec180030f0 2024-09-10T20:57:01.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.652+0000 7fec37421f40 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55d721530f90 con 0x55d721648510 2024-09-10T20:57:01.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.652+0000 7fec37421f40 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x55d7214c5c60 con 0x55d7215c0080 2024-09-10T20:57:01.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.652+0000 7fec34600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec180030f0 0x55d721630510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:01.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.652+0000 7fec34600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec180030f0 0x55d721630510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35010/0 (socket says 172.21.15.6:35010) 2024-09-10T20:57:01.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.652+0000 7fec34600640 1 -- 172.21.15.6:0/1379050590 learned_addr learned my addr 172.21.15.6:0/1379050590 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:01.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.652+0000 7fec2bc00640 1 --2- 172.21.15.6:0/1379050590 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55d7215c0080 0x55d7215a7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:01.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.652+0000 7fec35000640 1 --2- 172.21.15.6:0/1379050590 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d721648510 0x55d7215a8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:01.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.652+0000 7fec34600640 1 -- 172.21.15.6:0/1379050590 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55d7215c0080 msgr2=0x55d7215a7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:01.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.652+0000 7fec34600640 1 --2- 172.21.15.6:0/1379050590 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55d7215c0080 0x55d7215a7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:01.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.652+0000 7fec34600640 1 -- 172.21.15.6:0/1379050590 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d721648510 msgr2=0x55d7215a8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:01.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.652+0000 7fec34600640 1 --2- 172.21.15.6:0/1379050590 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d721648510 0x55d7215a8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:01.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.652+0000 7fec34600640 1 -- 172.21.15.6:0/1379050590 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7215a4b70 con 0x7fec180030f0 2024-09-10T20:57:01.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.652+0000 7fec34600640 1 --2- 172.21.15.6:0/1379050590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec180030f0 0x55d721630510 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fec24002f60 tx=0x7fec24002f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=717d248957e0a8e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:01.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.653+0000 7fec33200640 1 -- 172.21.15.6:0/1379050590 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec24013020 con 0x7fec180030f0 2024-09-10T20:57:01.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.653+0000 7fec33200640 1 -- 172.21.15.6:0/1379050590 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fec2400f750 con 0x7fec180030f0 2024-09-10T20:57:01.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.653+0000 7fec33200640 1 -- 172.21.15.6:0/1379050590 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec2400fba0 con 0x7fec180030f0 2024-09-10T20:57:01.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.653+0000 7fec37421f40 1 -- 172.21.15.6:0/1379050590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec180030f0 msgr2=0x55d721630510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:01.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.653+0000 7fec37421f40 1 --2- 172.21.15.6:0/1379050590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec180030f0 0x55d721630510 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fec24002f60 tx=0x7fec24002f90 comp rx=0 tx=0).stop 2024-09-10T20:57:01.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.653+0000 7fec37421f40 1 -- 172.21.15.6:0/1379050590 shutdown_connections 2024-09-10T20:57:01.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.653+0000 7fec37421f40 1 --2- 172.21.15.6:0/1379050590 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d721648510 0x55d7215a8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:01.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.653+0000 7fec37421f40 1 --2- 172.21.15.6:0/1379050590 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55d7215c0080 0x55d7215a7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:01.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.653+0000 7fec37421f40 1 --2- 172.21.15.6:0/1379050590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec180030f0 0x55d721630510 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:01.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.653+0000 7fec37421f40 1 -- 172.21.15.6:0/1379050590 >> 172.21.15.6:0/1379050590 conn(0x55d7215a5870 msgr2=0x55d72164d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:01.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.653+0000 7fec37421f40 1 -- 172.21.15.6:0/1379050590 shutdown_connections 2024-09-10T20:57:01.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.653+0000 7fec37421f40 1 -- 172.21.15.6:0/1379050590 wait complete. 2024-09-10T20:57:01.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.654+0000 7fec37421f40 1 Processor -- start 2024-09-10T20:57:01.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.654+0000 7fec37421f40 1 -- start start 2024-09-10T20:57:01.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.655+0000 7fec37421f40 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7215c0080 0x55d721647350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:01.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.655+0000 7fec37421f40 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55d721648510 0x55d721647890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:01.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.655+0000 7fec37421f40 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec180030f0 0x55d7216e6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:01.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.655+0000 7fec37421f40 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55d721649040 con 0x7fec180030f0 2024-09-10T20:57:01.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.655+0000 7fec37421f40 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55d721630e30 con 0x55d7215c0080 2024-09-10T20:57:01.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.655+0000 7fec37421f40 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x55d7216339c0 con 0x55d721648510 2024-09-10T20:57:01.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.655+0000 7fec35000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec180030f0 0x55d7216e6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:01.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.655+0000 7fec35000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec180030f0 0x55d7216e6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35024/0 (socket says 172.21.15.6:35024) 2024-09-10T20:57:01.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.655+0000 7fec35000640 1 -- 172.21.15.6:0/43781965 learned_addr learned my addr 172.21.15.6:0/43781965 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:01.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.655+0000 7fec34600640 1 --2- 172.21.15.6:0/43781965 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7215c0080 0x55d721647350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:01.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.656+0000 7fec2bc00640 1 --2- 172.21.15.6:0/43781965 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55d721648510 0x55d721647890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:01.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.656+0000 7fec35000640 1 -- 172.21.15.6:0/43781965 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55d721648510 msgr2=0x55d721647890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:01.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.656+0000 7fec35000640 1 --2- 172.21.15.6:0/43781965 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55d721648510 0x55d721647890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:01.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.656+0000 7fec35000640 1 -- 172.21.15.6:0/43781965 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7215c0080 msgr2=0x55d721647350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:01.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.656+0000 7fec35000640 1 --2- 172.21.15.6:0/43781965 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7215c0080 0x55d721647350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:01.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.656+0000 7fec35000640 1 -- 172.21.15.6:0/43781965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d721630a50 con 0x7fec180030f0 2024-09-10T20:57:01.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.656+0000 7fec35000640 1 --2- 172.21.15.6:0/43781965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec180030f0 0x55d7216e6ee0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fec1800ac70 tx=0x7fec2c005c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:01.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.656+0000 7fec31e00640 1 -- 172.21.15.6:0/43781965 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec2c0038e0 con 0x7fec180030f0 2024-09-10T20:57:01.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.656+0000 7fec31e00640 1 -- 172.21.15.6:0/43781965 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fec2c007e50 con 0x7fec180030f0 2024-09-10T20:57:01.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.656+0000 7fec37421f40 1 -- 172.21.15.6:0/43781965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d721645ef0 con 0x7fec180030f0 2024-09-10T20:57:01.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.656+0000 7fec31e00640 1 -- 172.21.15.6:0/43781965 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec2c003ce0 con 0x7fec180030f0 2024-09-10T20:57:01.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.657+0000 7fec37421f40 1 -- 172.21.15.6:0/43781965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d721645b80 con 0x7fec180030f0 2024-09-10T20:57:01.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.659+0000 7fec31e00640 1 -- 172.21.15.6:0/43781965 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fec2c015420 con 0x7fec180030f0 2024-09-10T20:57:01.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.660+0000 7fec31e00640 1 --2- 172.21.15.6:0/43781965 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fec10076980 0x7fec10078e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:01.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.660+0000 7fec31e00640 1 -- 172.21.15.6:0/43781965 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6104+0+0 (secure 0 0 0) 0x7fec2c098b80 con 0x7fec180030f0 2024-09-10T20:57:01.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.660+0000 7fec37421f40 1 --2- 172.21.15.6:0/43781965 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x55d721644f90 0x55d7216e7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:01.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.660+0000 7fec34600640 1 --2- 172.21.15.6:0/43781965 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fec10076980 0x7fec10078e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:01.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.660+0000 7fec37421f40 1 -- 172.21.15.6:0/43781965 --> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] -- osd_op(unknown.0.0:1 5.13 5:ca8fdbba:::100000001fb.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38) -- 0x55d721630510 con 0x55d721644f90 2024-09-10T20:57:01.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.661+0000 7fec2bc00640 1 --2- 172.21.15.6:0/43781965 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x55d721644f90 0x55d7216e7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:01.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.661+0000 7fec34600640 1 --2- 172.21.15.6:0/43781965 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fec10076980 0x7fec10078e40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fec24012040 tx=0x7fec2401b040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:01.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.661+0000 7fec2bc00640 1 --2- 172.21.15.6:0/43781965 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x55d721644f90 0x55d7216e7420 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:01.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.662+0000 7fec2bc00640 1 -- 172.21.15.6:0/43781965 <== osd.3 v2:172.21.15.6:6816/3911674247 1 ==== osd_op_reply(1 100000001fb.00000000 [getxattr (103) out=103b] v0'0 uv3 ondisk = 0) ==== 164+0+103 (crc 0 0 0) 0x7fec1c060420 con 0x55d721644f90 2024-09-10T20:57:01.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.662+0000 7fec37421f40 1 -- 172.21.15.6:0/43781965 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x55d721644f90 msgr2=0x55d7216e7420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:01.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.662+0000 7fec37421f40 1 --2- 172.21.15.6:0/43781965 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x55d721644f90 0x55d7216e7420 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:01.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.662+0000 7fec37421f40 1 -- 172.21.15.6:0/43781965 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fec10076980 msgr2=0x7fec10078e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:01.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.662+0000 7fec37421f40 1 --2- 172.21.15.6:0/43781965 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fec10076980 0x7fec10078e40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fec24012040 tx=0x7fec2401b040 comp rx=0 tx=0).stop 2024-09-10T20:57:01.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.662+0000 7fec37421f40 1 -- 172.21.15.6:0/43781965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec180030f0 msgr2=0x55d7216e6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:01.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.662+0000 7fec37421f40 1 --2- 172.21.15.6:0/43781965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec180030f0 0x55d7216e6ee0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fec1800ac70 tx=0x7fec2c005c60 comp rx=0 tx=0).stop 2024-09-10T20:57:01.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.662+0000 7fec35000640 1 -- 172.21.15.6:0/43781965 reap_dead start 2024-09-10T20:57:01.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.662+0000 7fec37421f40 1 -- 172.21.15.6:0/43781965 shutdown_connections 2024-09-10T20:57:01.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.662+0000 7fec37421f40 1 -- 172.21.15.6:0/43781965 >> 172.21.15.6:0/43781965 conn(0x55d7215a5870 msgr2=0x55d721640fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:01.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.662+0000 7fec37421f40 1 -- 172.21.15.6:0/43781965 shutdown_connections 2024-09-10T20:57:01.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.662+0000 7fec37421f40 1 -- 172.21.15.6:0/43781965 wait complete. 2024-09-10T20:57:01.670 INFO:teuthology.orchestra.run.smithi006.stdout:a��alpha parent_b$ 2024-09-10T20:57:01.670 DEBUG:teuthology.orchestra.run.smithi006:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-09-10T20:57:01.751 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-10T20:57:01.751 INFO:teuthology.orchestra.run.smithi006.stdout: "ino": 1099511628283, 2024-09-10T20:57:01.751 INFO:teuthology.orchestra.run.smithi006.stdout: "ancestors": [ 2024-09-10T20:57:01.751 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-10T20:57:01.751 INFO:teuthology.orchestra.run.smithi006.stdout: "dirino": 1099511628284, 2024-09-10T20:57:01.752 INFO:teuthology.orchestra.run.smithi006.stdout: "dname": "alpha", 2024-09-10T20:57:01.752 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 9 2024-09-10T20:57:01.752 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-10T20:57:01.752 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-10T20:57:01.752 INFO:teuthology.orchestra.run.smithi006.stdout: "dirino": 1, 2024-09-10T20:57:01.752 INFO:teuthology.orchestra.run.smithi006.stdout: "dname": "parent_b", 2024-09-10T20:57:01.752 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 36 2024-09-10T20:57:01.752 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-10T20:57:01.752 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-10T20:57:01.752 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 6, 2024-09-10T20:57:01.752 INFO:teuthology.orchestra.run.smithi006.stdout: "old_pools": [ 2024-09-10T20:57:01.752 INFO:teuthology.orchestra.run.smithi006.stdout: 5 2024-09-10T20:57:01.752 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-10T20:57:01.752 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-10T20:57:01.753 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:57:01.757 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool data_new getxattr 100000001fb.00000000 parent 2024-09-10T20:57:01.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.869+0000 7f6fd336cf40 1 Processor -- start 2024-09-10T20:57:01.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.870+0000 7f6fd336cf40 1 -- start start 2024-09-10T20:57:01.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.870+0000 7f6fd336cf40 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55f1f00e0280 0x55f1f010ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:01.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.870+0000 7f6fd336cf40 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f1f0127d90 0x55f1f010c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:01.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.870+0000 7f6fd336cf40 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f1f0128170 0x55f1f01af070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:01.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.870+0000 7f6fd336cf40 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55f1f01b38d0 con 0x55f1f0127d90 2024-09-10T20:57:01.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.870+0000 7f6fd336cf40 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55f1f002dc60 con 0x55f1f0128170 2024-09-10T20:57:01.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.870+0000 7f6fd336cf40 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x55f1f01b5a60 con 0x55f1f00e0280 2024-09-10T20:57:01.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.871+0000 7f6fcfc00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f1f0127d90 0x55f1f010c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:01.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.871+0000 7f6fcfc00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f1f0127d90 0x55f1f010c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35044/0 (socket says 172.21.15.6:35044) 2024-09-10T20:57:01.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.871+0000 7f6fcfc00640 1 -- 172.21.15.6:0/3197794641 learned_addr learned my addr 172.21.15.6:0/3197794641 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:01.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.871+0000 7f6fd0600640 1 --2- 172.21.15.6:0/3197794641 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55f1f00e0280 0x55f1f010ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:01.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.871+0000 7f6fd1000640 1 --2- 172.21.15.6:0/3197794641 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f1f0128170 0x55f1f01af070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:01.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.871+0000 7f6fcfc00640 1 -- 172.21.15.6:0/3197794641 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55f1f00e0280 msgr2=0x55f1f010ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:01.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.871+0000 7f6fcfc00640 1 --2- 172.21.15.6:0/3197794641 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55f1f00e0280 0x55f1f010ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:01.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.871+0000 7f6fcfc00640 1 -- 172.21.15.6:0/3197794641 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f1f0128170 msgr2=0x55f1f01af070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:01.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.871+0000 7f6fcfc00640 1 --2- 172.21.15.6:0/3197794641 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f1f0128170 0x55f1f01af070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:01.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.871+0000 7f6fcfc00640 1 -- 172.21.15.6:0/3197794641 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1f0005f10 con 0x55f1f0127d90 2024-09-10T20:57:01.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.872+0000 7f6fcfc00640 1 --2- 172.21.15.6:0/3197794641 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f1f0127d90 0x55f1f010c3e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc00c550 tx=0x7f6fbc00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b47dc2be07044b40 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:01.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.872+0000 7f6fce800640 1 -- 172.21.15.6:0/3197794641 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc00a960 con 0x55f1f0127d90 2024-09-10T20:57:01.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.872+0000 7f6fce800640 1 -- 172.21.15.6:0/3197794641 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6fbc00ab00 con 0x55f1f0127d90 2024-09-10T20:57:01.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.872+0000 7f6fce800640 1 -- 172.21.15.6:0/3197794641 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc008420 con 0x55f1f0127d90 2024-09-10T20:57:01.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.872+0000 7f6fd336cf40 1 -- 172.21.15.6:0/3197794641 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f1f0127d90 msgr2=0x55f1f010c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:01.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.872+0000 7f6fd336cf40 1 --2- 172.21.15.6:0/3197794641 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f1f0127d90 0x55f1f010c3e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc00c550 tx=0x7f6fbc00c950 comp rx=0 tx=0).stop 2024-09-10T20:57:01.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.872+0000 7f6fd336cf40 1 -- 172.21.15.6:0/3197794641 shutdown_connections 2024-09-10T20:57:01.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.872+0000 7f6fd336cf40 1 --2- 172.21.15.6:0/3197794641 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f1f0127d90 0x55f1f010c3e0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:01.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.872+0000 7f6fd336cf40 1 --2- 172.21.15.6:0/3197794641 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f1f0128170 0x55f1f01af070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:01.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.872+0000 7f6fd336cf40 1 --2- 172.21.15.6:0/3197794641 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55f1f00e0280 0x55f1f010ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:01.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.872+0000 7f6fd336cf40 1 -- 172.21.15.6:0/3197794641 >> 172.21.15.6:0/3197794641 conn(0x55f1f00dd780 msgr2=0x55f1f00dc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:01.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.872+0000 7f6fd336cf40 1 -- 172.21.15.6:0/3197794641 shutdown_connections 2024-09-10T20:57:01.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.872+0000 7f6fd336cf40 1 -- 172.21.15.6:0/3197794641 wait complete. 2024-09-10T20:57:01.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.873+0000 7f6fd336cf40 1 Processor -- start 2024-09-10T20:57:01.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.873+0000 7f6fd336cf40 1 -- start start 2024-09-10T20:57:01.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.874+0000 7f6fd336cf40 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f1f00e0280 0x55f1f010c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:01.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.874+0000 7f6fd336cf40 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f1f0127d90 0x55f1f011de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:01.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.874+0000 7f6fd336cf40 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55f1f0128170 0x55f1f0194e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:01.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.874+0000 7f6fd336cf40 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55f1f010c920 con 0x55f1f00e0280 2024-09-10T20:57:01.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.874+0000 7f6fd336cf40 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55f1f01aa490 con 0x55f1f0127d90 2024-09-10T20:57:01.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.874+0000 7f6fd336cf40 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x55f1f01aa950 con 0x55f1f0128170 2024-09-10T20:57:01.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.874+0000 7f6fd0600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f1f00e0280 0x55f1f010c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:01.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.874+0000 7f6fd0600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f1f00e0280 0x55f1f010c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35052/0 (socket says 172.21.15.6:35052) 2024-09-10T20:57:01.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.874+0000 7f6fd0600640 1 -- 172.21.15.6:0/1631098968 learned_addr learned my addr 172.21.15.6:0/1631098968 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:01.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.875+0000 7f6fd1000640 1 --2- 172.21.15.6:0/1631098968 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55f1f0128170 0x55f1f0194e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:01.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.875+0000 7f6fcfc00640 1 --2- 172.21.15.6:0/1631098968 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f1f0127d90 0x55f1f011de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:01.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.875+0000 7f6fd0600640 1 -- 172.21.15.6:0/1631098968 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55f1f0128170 msgr2=0x55f1f0194e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:01.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.875+0000 7f6fd0600640 1 --2- 172.21.15.6:0/1631098968 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55f1f0128170 0x55f1f0194e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:01.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.875+0000 7f6fd0600640 1 -- 172.21.15.6:0/1631098968 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f1f0127d90 msgr2=0x55f1f011de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:01.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.875+0000 7f6fd0600640 1 --2- 172.21.15.6:0/1631098968 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f1f0127d90 0x55f1f011de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:01.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.875+0000 7f6fd0600640 1 -- 172.21.15.6:0/1631098968 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1f011ef00 con 0x55f1f00e0280 2024-09-10T20:57:01.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.875+0000 7f6fd1000640 1 --2- 172.21.15.6:0/1631098968 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55f1f0128170 0x55f1f0194e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:57:01.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.875+0000 7f6fd0600640 1 --2- 172.21.15.6:0/1631098968 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f1f00e0280 0x55f1f010c390 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6fc000a3d0 tx=0x7f6fc004d820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:01.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.875+0000 7f6fcd400640 1 -- 172.21.15.6:0/1631098968 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc0068070 con 0x55f1f00e0280 2024-09-10T20:57:01.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.875+0000 7f6fcd400640 1 -- 172.21.15.6:0/1631098968 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6fc0056620 con 0x55f1f00e0280 2024-09-10T20:57:01.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.875+0000 7f6fcd400640 1 -- 172.21.15.6:0/1631098968 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc0056a50 con 0x55f1f00e0280 2024-09-10T20:57:01.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.875+0000 7f6fd336cf40 1 -- 172.21.15.6:0/1631098968 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f1f011f1e0 con 0x55f1f00e0280 2024-09-10T20:57:01.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.876+0000 7f6fd336cf40 1 -- 172.21.15.6:0/1631098968 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1f00dcb90 con 0x55f1f00e0280 2024-09-10T20:57:01.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.878+0000 7f6fcd400640 1 -- 172.21.15.6:0/1631098968 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6fc0056bf0 con 0x55f1f00e0280 2024-09-10T20:57:01.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.879+0000 7f6fcd400640 1 --2- 172.21.15.6:0/1631098968 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6fb0076950 0x7f6fb0078e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:01.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.879+0000 7f6fcd400640 1 -- 172.21.15.6:0/1631098968 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6104+0+0 (secure 0 0 0) 0x7f6fc00dc7d0 con 0x55f1f00e0280 2024-09-10T20:57:01.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.879+0000 7f6fd336cf40 1 --2- 172.21.15.6:0/1631098968 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x55f1f024de40 0x55f1f024e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:01.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.879+0000 7f6fd336cf40 1 -- 172.21.15.6:0/1631098968 --> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] -- osd_op(unknown.0.0:1 6.13 6:ca8fdbba:::100000001fb.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38) -- 0x55f1f01a79e0 con 0x55f1f024de40 2024-09-10T20:57:01.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.879+0000 7f6fcfc00640 1 --2- 172.21.15.6:0/1631098968 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6fb0076950 0x7f6fb0078e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:01.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.879+0000 7f6fd1000640 1 --2- 172.21.15.6:0/1631098968 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x55f1f024de40 0x55f1f024e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:01.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.880+0000 7f6fcfc00640 1 --2- 172.21.15.6:0/1631098968 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6fb0076950 0x7f6fb0078e10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55f1f010e360 tx=0x7f6fbc002fb0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:01.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.880+0000 7f6fd1000640 1 --2- 172.21.15.6:0/1631098968 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x55f1f024de40 0x55f1f024e270 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:01.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.880+0000 7f6fd1000640 1 -- 172.21.15.6:0/1631098968 <== osd.3 v2:172.21.15.6:6816/3911674247 1 ==== osd_op_reply(1 100000001fb.00000000 [getxattr (103) out=103b] v0'0 uv2 ondisk = 0) ==== 164+0+103 (crc 0 0 0) 0x7f6fc800b040 con 0x55f1f024de40 2024-09-10T20:57:01.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.880+0000 7f6fd336cf40 1 -- 172.21.15.6:0/1631098968 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x55f1f024de40 msgr2=0x55f1f024e270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:01.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.880+0000 7f6fd336cf40 1 --2- 172.21.15.6:0/1631098968 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x55f1f024de40 0x55f1f024e270 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:01.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.880+0000 7f6fd336cf40 1 -- 172.21.15.6:0/1631098968 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6fb0076950 msgr2=0x7f6fb0078e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:01.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.880+0000 7f6fd336cf40 1 --2- 172.21.15.6:0/1631098968 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6fb0076950 0x7f6fb0078e10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55f1f010e360 tx=0x7f6fbc002fb0 comp rx=0 tx=0).stop 2024-09-10T20:57:01.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.880+0000 7f6fd336cf40 1 -- 172.21.15.6:0/1631098968 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f1f00e0280 msgr2=0x55f1f010c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:01.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.880+0000 7f6fd336cf40 1 --2- 172.21.15.6:0/1631098968 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f1f00e0280 0x55f1f010c390 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6fc000a3d0 tx=0x7f6fc004d820 comp rx=0 tx=0).stop 2024-09-10T20:57:01.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.880+0000 7f6fd1000640 1 -- 172.21.15.6:0/1631098968 reap_dead start 2024-09-10T20:57:01.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.880+0000 7f6fd336cf40 1 -- 172.21.15.6:0/1631098968 shutdown_connections 2024-09-10T20:57:01.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.880+0000 7f6fd336cf40 1 -- 172.21.15.6:0/1631098968 >> 172.21.15.6:0/1631098968 conn(0x55f1f00dd780 msgr2=0x55f1f01b2450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:01.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.881+0000 7f6fd336cf40 1 -- 172.21.15.6:0/1631098968 shutdown_connections 2024-09-10T20:57:01.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:01.881+0000 7f6fd336cf40 1 -- 172.21.15.6:0/1631098968 wait complete. 2024-09-10T20:57:01.886 INFO:teuthology.orchestra.run.smithi006.stdout:a��alpha 2024-09-10T20:57:01.888 INFO:teuthology.orchestra.run.smithi006.stdout:parent_c+ 2024-09-10T20:57:01.889 DEBUG:teuthology.orchestra.run.smithi006:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-09-10T20:57:01.970 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-10T20:57:01.970 INFO:teuthology.orchestra.run.smithi006.stdout: "ino": 1099511628283, 2024-09-10T20:57:01.970 INFO:teuthology.orchestra.run.smithi006.stdout: "ancestors": [ 2024-09-10T20:57:01.970 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-10T20:57:01.970 INFO:teuthology.orchestra.run.smithi006.stdout: "dirino": 1099511628285, 2024-09-10T20:57:01.971 INFO:teuthology.orchestra.run.smithi006.stdout: "dname": "alpha", 2024-09-10T20:57:01.971 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 10 2024-09-10T20:57:01.971 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-10T20:57:01.971 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-10T20:57:01.971 INFO:teuthology.orchestra.run.smithi006.stdout: "dirino": 1, 2024-09-10T20:57:01.971 INFO:teuthology.orchestra.run.smithi006.stdout: "dname": "parent_c", 2024-09-10T20:57:01.971 INFO:teuthology.orchestra.run.smithi006.stdout: "version": 43 2024-09-10T20:57:01.971 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-10T20:57:01.971 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-10T20:57:01.971 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 6, 2024-09-10T20:57:01.971 INFO:teuthology.orchestra.run.smithi006.stdout: "old_pools": [ 2024-09-10T20:57:01.971 INFO:teuthology.orchestra.run.smithi006.stdout: 5 2024-09-10T20:57:01.971 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-10T20:57:01.971 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-10T20:57:01.972 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:57:01.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:57:01.976 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.file.layout.object_size -v 8388608 ./parent_c/alpha) 2024-09-10T20:57:02.054 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:57:02.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.255+0000 7f9ef2800640 1 -- 172.21.15.6:0/4141948411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9eec0d0530 msgr2=0x7f9eec15fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:02.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.255+0000 7f9ef2800640 1 --2- 172.21.15.6:0/4141948411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9eec0d0530 0x7f9eec15fef0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4005fd0 tx=0x7f9ee402a4b0 comp rx=0 tx=0).stop 2024-09-10T20:57:02.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.256+0000 7f9ef2800640 1 -- 172.21.15.6:0/4141948411 shutdown_connections 2024-09-10T20:57:02.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.256+0000 7f9ef2800640 1 --2- 172.21.15.6:0/4141948411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9eec0d0530 0x7f9eec15fef0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:02.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.256+0000 7f9ef2800640 1 -- 172.21.15.6:0/4141948411 >> 172.21.15.6:0/4141948411 conn(0x7f9eec0d1ae0 msgr2=0x7f9eec0d1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:02.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.256+0000 7f9ef2800640 1 -- 172.21.15.6:0/4141948411 shutdown_connections 2024-09-10T20:57:02.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.256+0000 7f9ef2800640 1 -- 172.21.15.6:0/4141948411 wait complete. 2024-09-10T20:57:02.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.257+0000 7f9ef2800640 1 Processor -- start 2024-09-10T20:57:02.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.257+0000 7f9ef2800640 1 -- start start 2024-09-10T20:57:02.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.258+0000 7f9ef2800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9eec0d00c0 0x7f9eec150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:02.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.258+0000 7f9ef2800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9eec0d0530 0x7f9eec0afcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:02.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.258+0000 7f9ef2800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9eec15f1c0 0x7f9eec0b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:02.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.258+0000 7f9ef2800640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9eec0b0cc0 con 0x7f9eec0d0530 2024-09-10T20:57:02.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.258+0000 7f9ef2800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9eec0b0b40 con 0x7f9eec0d00c0 2024-09-10T20:57:02.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.258+0000 7f9ef2800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f9eec160430 con 0x7f9eec15f1c0 2024-09-10T20:57:02.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.259+0000 7f9ef0a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9eec0d0530 0x7f9eec0afcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:02.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.259+0000 7f9ef0a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9eec0d0530 0x7f9eec0afcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35080/0 (socket says 172.21.15.6:35080) 2024-09-10T20:57:02.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.259+0000 7f9ef0a00640 1 -- 172.21.15.6:0/1163070795 learned_addr learned my addr 172.21.15.6:0/1163070795 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:02.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.259+0000 7f9ef1400640 1 --2- 172.21.15.6:0/1163070795 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9eec0d00c0 0x7f9eec150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:02.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.259+0000 7f9ef1e00640 1 --2- 172.21.15.6:0/1163070795 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9eec15f1c0 0x7f9eec0b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:02.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.259+0000 7f9ef0a00640 1 -- 172.21.15.6:0/1163070795 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9eec15f1c0 msgr2=0x7f9eec0b01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:02.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.259+0000 7f9ef0a00640 1 --2- 172.21.15.6:0/1163070795 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9eec15f1c0 0x7f9eec0b01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:02.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.259+0000 7f9ef0a00640 1 -- 172.21.15.6:0/1163070795 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9eec0d00c0 msgr2=0x7f9eec150680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:02.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.259+0000 7f9ef0a00640 1 --2- 172.21.15.6:0/1163070795 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9eec0d00c0 0x7f9eec150680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:02.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.259+0000 7f9ef0a00640 1 -- 172.21.15.6:0/1163070795 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eec0ce570 con 0x7f9eec0d0530 2024-09-10T20:57:02.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.259+0000 7f9ef1e00640 1 --2- 172.21.15.6:0/1163070795 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9eec15f1c0 0x7f9eec0b01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:57:02.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.259+0000 7f9ef0a00640 1 --2- 172.21.15.6:0/1163070795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9eec0d0530 0x7f9eec0afcb0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9ed800c450 tx=0x7f9ed800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:02.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.260+0000 7f9ee9600640 1 -- 172.21.15.6:0/1163070795 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed80052d0 con 0x7f9eec0d0530 2024-09-10T20:57:02.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.260+0000 7f9ee9600640 1 -- 172.21.15.6:0/1163070795 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ed8005470 con 0x7f9eec0d0530 2024-09-10T20:57:02.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.260+0000 7f9ee9600640 1 -- 172.21.15.6:0/1163070795 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed8012870 con 0x7f9eec0d0530 2024-09-10T20:57:02.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.260+0000 7f9ef2800640 1 -- 172.21.15.6:0/1163070795 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9eec0cd7b0 con 0x7f9eec0d0530 2024-09-10T20:57:02.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.260+0000 7f9ef2800640 1 -- 172.21.15.6:0/1163070795 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9eec0cdd70 con 0x7f9eec0d0530 2024-09-10T20:57:02.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.261+0000 7f9ef2800640 1 -- 172.21.15.6:0/1163070795 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9eec0d0e00 con 0x7f9eec0d0530 2024-09-10T20:57:02.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.262+0000 7f9ee9600640 1 -- 172.21.15.6:0/1163070795 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f9ed80035f0 con 0x7f9eec0d0530 2024-09-10T20:57:02.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.263+0000 7f9ee9600640 1 --2- 172.21.15.6:0/1163070795 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f9ecc077f70 0x7f9ecc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:02.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.264+0000 7f9ee9600640 1 -- 172.21.15.6:0/1163070795 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6104+0+0 (secure 0 0 0) 0x7f9ed8099a40 con 0x7f9eec0d0530 2024-09-10T20:57:02.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.264+0000 7f9ef1400640 1 --2- 172.21.15.6:0/1163070795 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f9ecc077f70 0x7f9ecc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:02.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.265+0000 7f9ef1400640 1 --2- 172.21.15.6:0/1163070795 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f9ecc077f70 0x7f9ecc07a430 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9ee000b450 tx=0x7f9ee000d040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:02.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.268+0000 7f9ee9600640 1 -- 172.21.15.6:0/1163070795 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f9ed8062310 con 0x7f9eec0d0530 2024-09-10T20:57:02.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.498+0000 7f9ef2800640 1 -- 172.21.15.6:0/1163070795 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9eec0b7a60 con 0x7f9eec0d0530 2024-09-10T20:57:02.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.498+0000 7f9ee9600640 1 -- 172.21.15.6:0/1163070795 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5222 (secure 0 0 0) 0x7f9ed8061c10 con 0x7f9eec0d0530 2024-09-10T20:57:02.502 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:57:02.502 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":18,"btime":"2024-09-10T20:56:58:138800+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1675451102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1675451102},{"type":"v1","addr":"172.21.15.6:6834","nonce":1675451102}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4924,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/676153174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":676153174},{"type":"v1","addr":"172.21.15.150:6836","nonce":676153174}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4950,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4072260905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":4072260905},{"type":"v1","addr":"172.21.15.150:6837","nonce":4072260905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:56:37.566072+0000","modified":"2024-09-10T20:56:57.568755+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4956":{"gid":4956,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/1598644433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1598644433},{"type":"v1","addr":"172.21.15.6:6835","nonce":1598644433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5,6],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4956,"qdb_cluster":[4956]},"id":2}]} 2024-09-10T20:57:02.503 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 18 2024-09-10T20:57:02.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.501+0000 7f9ef2800640 1 -- 172.21.15.6:0/1163070795 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f9ecc077f70 msgr2=0x7f9ecc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:02.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.501+0000 7f9ef2800640 1 --2- 172.21.15.6:0/1163070795 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f9ecc077f70 0x7f9ecc07a430 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9ee000b450 tx=0x7f9ee000d040 comp rx=0 tx=0).stop 2024-09-10T20:57:02.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.501+0000 7f9ef2800640 1 -- 172.21.15.6:0/1163070795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9eec0d0530 msgr2=0x7f9eec0afcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:02.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.501+0000 7f9ef2800640 1 --2- 172.21.15.6:0/1163070795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9eec0d0530 0x7f9eec0afcb0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9ed800c450 tx=0x7f9ed800c910 comp rx=0 tx=0).stop 2024-09-10T20:57:02.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.501+0000 7f9ef2800640 1 -- 172.21.15.6:0/1163070795 shutdown_connections 2024-09-10T20:57:02.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.501+0000 7f9ef2800640 1 --2- 172.21.15.6:0/1163070795 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f9ecc077f70 0x7f9ecc07a430 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:02.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.501+0000 7f9ef2800640 1 --2- 172.21.15.6:0/1163070795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9eec0d0530 0x7f9eec0afcb0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:02.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.501+0000 7f9ef2800640 1 --2- 172.21.15.6:0/1163070795 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9eec15f1c0 0x7f9eec0b01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:02.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.501+0000 7f9ef2800640 1 --2- 172.21.15.6:0/1163070795 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9eec0d00c0 0x7f9eec150680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:02.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.501+0000 7f9ef2800640 1 -- 172.21.15.6:0/1163070795 >> 172.21.15.6:0/1163070795 conn(0x7f9eec0d1ae0 msgr2=0x7f9eec15f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:02.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.501+0000 7f9ef2800640 1 -- 172.21.15.6:0/1163070795 shutdown_connections 2024-09-10T20:57:02.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.501+0000 7f9ef2800640 1 -- 172.21.15.6:0/1163070795 wait complete. 2024-09-10T20:57:02.520 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-09-10T20:57:02.705 INFO:teuthology.orchestra.run.smithi006.stdout:{"message":"","return_code":0} 2024-09-10T20:57:02.705 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-10T20:57:02.705 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool data_new getxattr 100000001fb.00000000 layout 2024-09-10T20:57:02.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.779+0000 7f1743b98f40 1 Processor -- start 2024-09-10T20:57:02.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.779+0000 7f1743b98f40 1 -- start start 2024-09-10T20:57:02.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.779+0000 7f1743b98f40 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55bdc7493650 0x55bdc75f5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:02.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.779+0000 7f1743b98f40 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bdc74c3b70 0x55bdc7492d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:02.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.779+0000 7f1743b98f40 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bdc756a1e0 0x55bdc756c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:02.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.779+0000 7f1743b98f40 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55bdc74411d0 con 0x55bdc74c3b70 2024-09-10T20:57:02.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.779+0000 7f1743b98f40 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55bdc744df90 con 0x55bdc756a1e0 2024-09-10T20:57:02.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.779+0000 7f1743b98f40 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x55bdc73e2c60 con 0x55bdc7493650 2024-09-10T20:57:02.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.780+0000 7f173be00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bdc74c3b70 0x55bdc7492d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:02.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.780+0000 7f173be00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bdc74c3b70 0x55bdc7492d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35098/0 (socket says 172.21.15.6:35098) 2024-09-10T20:57:02.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.780+0000 7f173be00640 1 -- 172.21.15.6:0/3349910681 learned_addr learned my addr 172.21.15.6:0/3349910681 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:02.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.780+0000 7f1741800640 1 --2- 172.21.15.6:0/3349910681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bdc756a1e0 0x55bdc756c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:02.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.780+0000 7f1740e00640 1 --2- 172.21.15.6:0/3349910681 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55bdc7493650 0x55bdc75f5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:02.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.780+0000 7f173be00640 1 -- 172.21.15.6:0/3349910681 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55bdc7493650 msgr2=0x55bdc75f5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:02.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.780+0000 7f173be00640 1 --2- 172.21.15.6:0/3349910681 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55bdc7493650 0x55bdc75f5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:02.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.780+0000 7f173be00640 1 -- 172.21.15.6:0/3349910681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bdc756a1e0 msgr2=0x55bdc756c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:02.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.780+0000 7f173be00640 1 --2- 172.21.15.6:0/3349910681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bdc756a1e0 0x55bdc756c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:02.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.780+0000 7f173be00640 1 -- 172.21.15.6:0/3349910681 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdc755ed10 con 0x55bdc74c3b70 2024-09-10T20:57:02.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.780+0000 7f173be00640 1 --2- 172.21.15.6:0/3349910681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bdc74c3b70 0x55bdc7492d00 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f172c002de0 tx=0x7f172c00b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c120603b64adc23 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:02.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.781+0000 7f173aa00640 1 -- 172.21.15.6:0/3349910681 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172c00f400 con 0x55bdc74c3b70 2024-09-10T20:57:02.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.781+0000 7f173aa00640 1 -- 172.21.15.6:0/3349910681 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f172c014070 con 0x55bdc74c3b70 2024-09-10T20:57:02.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.781+0000 7f173aa00640 1 -- 172.21.15.6:0/3349910681 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172c00f840 con 0x55bdc74c3b70 2024-09-10T20:57:02.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.781+0000 7f1743b98f40 1 -- 172.21.15.6:0/3349910681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bdc74c3b70 msgr2=0x55bdc7492d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:02.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.781+0000 7f1743b98f40 1 --2- 172.21.15.6:0/3349910681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bdc74c3b70 0x55bdc7492d00 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f172c002de0 tx=0x7f172c00b5b0 comp rx=0 tx=0).stop 2024-09-10T20:57:02.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.781+0000 7f1743b98f40 1 -- 172.21.15.6:0/3349910681 shutdown_connections 2024-09-10T20:57:02.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.781+0000 7f1743b98f40 1 --2- 172.21.15.6:0/3349910681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bdc74c3b70 0x55bdc7492d00 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:02.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.781+0000 7f1743b98f40 1 --2- 172.21.15.6:0/3349910681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bdc756a1e0 0x55bdc756c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:02.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.781+0000 7f1743b98f40 1 --2- 172.21.15.6:0/3349910681 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55bdc7493650 0x55bdc75f5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:02.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.781+0000 7f1743b98f40 1 -- 172.21.15.6:0/3349910681 >> 172.21.15.6:0/3349910681 conn(0x55bdc74c2870 msgr2=0x55bdc74c1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:02.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.781+0000 7f1743b98f40 1 -- 172.21.15.6:0/3349910681 shutdown_connections 2024-09-10T20:57:02.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.781+0000 7f1743b98f40 1 -- 172.21.15.6:0/3349910681 wait complete. 2024-09-10T20:57:02.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.782+0000 7f1743b98f40 1 Processor -- start 2024-09-10T20:57:02.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.782+0000 7f1743b98f40 1 -- start start 2024-09-10T20:57:02.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.783+0000 7f1743b98f40 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55bdc7493650 0x55bdc755dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:02.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.783+0000 7f1743b98f40 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bdc74c3b70 0x55bdc755cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:02.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.783+0000 7f1743b98f40 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bdc756a1e0 0x55bdc75f5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:02.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.783+0000 7f1743b98f40 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55bdc7490fd0 con 0x55bdc74c3b70 2024-09-10T20:57:02.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.783+0000 7f1743b98f40 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55bdc755f1b0 con 0x55bdc756a1e0 2024-09-10T20:57:02.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.783+0000 7f1743b98f40 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x55bdc755f770 con 0x55bdc7493650 2024-09-10T20:57:02.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.783+0000 7f173be00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bdc74c3b70 0x55bdc755cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:02.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.783+0000 7f173be00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bdc74c3b70 0x55bdc755cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35110/0 (socket says 172.21.15.6:35110) 2024-09-10T20:57:02.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.783+0000 7f173be00640 1 -- 172.21.15.6:0/375320456 learned_addr learned my addr 172.21.15.6:0/375320456 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:02.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.784+0000 7f1740e00640 1 --2- 172.21.15.6:0/375320456 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55bdc7493650 0x55bdc755dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:02.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.784+0000 7f1741800640 1 --2- 172.21.15.6:0/375320456 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bdc756a1e0 0x55bdc75f5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:02.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.784+0000 7f173be00640 1 -- 172.21.15.6:0/375320456 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55bdc7493650 msgr2=0x55bdc755dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:02.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.784+0000 7f173be00640 1 --2- 172.21.15.6:0/375320456 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55bdc7493650 0x55bdc755dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:02.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.784+0000 7f173be00640 1 -- 172.21.15.6:0/375320456 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bdc756a1e0 msgr2=0x55bdc75f5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:02.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.784+0000 7f173be00640 1 --2- 172.21.15.6:0/375320456 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bdc756a1e0 0x55bdc75f5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:02.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.784+0000 7f173be00640 1 -- 172.21.15.6:0/375320456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdc76057c0 con 0x55bdc74c3b70 2024-09-10T20:57:02.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.784+0000 7f1741800640 1 --2- 172.21.15.6:0/375320456 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bdc756a1e0 0x55bdc75f5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:57:02.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.784+0000 7f1740e00640 1 --2- 172.21.15.6:0/375320456 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55bdc7493650 0x55bdc755dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:57:02.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.784+0000 7f173be00640 1 --2- 172.21.15.6:0/375320456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bdc74c3b70 0x55bdc755cf10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f172c010000 tx=0x7f172c00fdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:02.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.784+0000 7f1739600640 1 -- 172.21.15.6:0/375320456 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172c024670 con 0x55bdc74c3b70 2024-09-10T20:57:02.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.784+0000 7f1739600640 1 -- 172.21.15.6:0/375320456 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f172c01f070 con 0x55bdc74c3b70 2024-09-10T20:57:02.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.784+0000 7f1739600640 1 -- 172.21.15.6:0/375320456 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172c024ba0 con 0x55bdc74c3b70 2024-09-10T20:57:02.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.784+0000 7f1743b98f40 1 -- 172.21.15.6:0/375320456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bdc755d950 con 0x55bdc74c3b70 2024-09-10T20:57:02.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.785+0000 7f1743b98f40 1 -- 172.21.15.6:0/375320456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdc7494600 con 0x55bdc74c3b70 2024-09-10T20:57:02.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.787+0000 7f1739600640 1 -- 172.21.15.6:0/375320456 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f172c01a420 con 0x55bdc74c3b70 2024-09-10T20:57:02.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.787+0000 7f1739600640 1 --2- 172.21.15.6:0/375320456 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f1720076980 0x7f1720078e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:02.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.788+0000 7f1739600640 1 -- 172.21.15.6:0/375320456 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6104+0+0 (secure 0 0 0) 0x7f172c09ac10 con 0x55bdc74c3b70 2024-09-10T20:57:02.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.788+0000 7f1743b98f40 1 --2- 172.21.15.6:0/375320456 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x55bdc75f4a30 0x55bdc7604b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:02.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.788+0000 7f1743b98f40 1 -- 172.21.15.6:0/375320456 --> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] -- osd_op(unknown.0.0:1 6.13 6:ca8fdbba:::100000001fb.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38) -- 0x55bdc755d450 con 0x55bdc75f4a30 2024-09-10T20:57:02.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.788+0000 7f1740e00640 1 --2- 172.21.15.6:0/375320456 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f1720076980 0x7f1720078e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:02.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.788+0000 7f1741800640 1 --2- 172.21.15.6:0/375320456 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x55bdc75f4a30 0x55bdc7604b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:02.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.789+0000 7f1741800640 1 --2- 172.21.15.6:0/375320456 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x55bdc75f4a30 0x55bdc7604b10 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:02.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.789+0000 7f1740e00640 1 --2- 172.21.15.6:0/375320456 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f1720076980 0x7f1720078e40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1734055000 tx=0x7f1734058040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:02.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.789+0000 7f1741800640 1 -- 172.21.15.6:0/375320456 <== osd.3 v2:172.21.15.6:6816/3911674247 1 ==== osd_op_reply(1 100000001fb.00000000 [getxattr (30) out=30b] v0'0 uv3 ondisk = 0) ==== 164+0+30 (crc 0 0 0) 0x7f173c002030 con 0x55bdc75f4a30 2024-09-10T20:57:02.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.789+0000 7f1743b98f40 1 -- 172.21.15.6:0/375320456 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x55bdc75f4a30 msgr2=0x55bdc7604b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:02.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.789+0000 7f1743b98f40 1 --2- 172.21.15.6:0/375320456 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x55bdc75f4a30 0x55bdc7604b10 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:02.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.789+0000 7f1743b98f40 1 -- 172.21.15.6:0/375320456 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f1720076980 msgr2=0x7f1720078e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:02.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.789+0000 7f1743b98f40 1 --2- 172.21.15.6:0/375320456 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f1720076980 0x7f1720078e40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1734055000 tx=0x7f1734058040 comp rx=0 tx=0).stop 2024-09-10T20:57:02.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.789+0000 7f1743b98f40 1 -- 172.21.15.6:0/375320456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bdc74c3b70 msgr2=0x55bdc755cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:02.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.789+0000 7f1743b98f40 1 --2- 172.21.15.6:0/375320456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bdc74c3b70 0x55bdc755cf10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f172c010000 tx=0x7f172c00fdd0 comp rx=0 tx=0).stop 2024-09-10T20:57:02.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.789+0000 7f1741800640 1 -- 172.21.15.6:0/375320456 reap_dead start 2024-09-10T20:57:02.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.789+0000 7f1743b98f40 1 -- 172.21.15.6:0/375320456 shutdown_connections 2024-09-10T20:57:02.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.789+0000 7f1743b98f40 1 -- 172.21.15.6:0/375320456 >> 172.21.15.6:0/375320456 conn(0x55bdc74c2870 msgr2=0x55bdc74922f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:02.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.789+0000 7f1743b98f40 1 -- 172.21.15.6:0/375320456 shutdown_connections 2024-09-10T20:57:02.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.789+0000 7f1743b98f40 1 -- 172.21.15.6:0/375320456 wait complete. 2024-09-10T20:57:02.797 INFO:teuthology.orchestra.run.smithi006.stdout:@� 2024-09-10T20:57:02.798 DEBUG:teuthology.orchestra.run.smithi006:> ceph-dencoder type file_layout_t import - decode dump_json 2024-09-10T20:57:02.879 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-10T20:57:02.879 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_unit": 4194304, 2024-09-10T20:57:02.879 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_count": 1, 2024-09-10T20:57:02.879 INFO:teuthology.orchestra.run.smithi006.stdout: "object_size": 8388608, 2024-09-10T20:57:02.879 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_id": 6, 2024-09-10T20:57:02.879 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_ns": "" 2024-09-10T20:57:02.879 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-10T20:57:02.879 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:57:02.885 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001fb.00000000 layout 2024-09-10T20:57:03.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.997+0000 7f47c4126f40 1 Processor -- start 2024-09-10T20:57:03.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.998+0000 7f47c4126f40 1 -- start start 2024-09-10T20:57:03.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.998+0000 7f47c4126f40 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fbf5fe8650 0x55fbf60bfa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:03.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.998+0000 7f47c4126f40 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fbf6035020 0x55fbf60c13d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:03.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.998+0000 7f47c4126f40 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fbf60bf1e0 0x55fbf60c1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:03.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.998+0000 7f47c4126f40 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55fbf60340a0 con 0x55fbf6035020 2024-09-10T20:57:03.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.998+0000 7f47c4126f40 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55fbf5f37c60 con 0x55fbf5fe8650 2024-09-10T20:57:03.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.998+0000 7f47c4126f40 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x55fbf6034340 con 0x55fbf60bf1e0 2024-09-10T20:57:03.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.999+0000 7f47bfe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fbf6035020 0x55fbf60c13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:03.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.999+0000 7f47bfe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fbf6035020 0x55fbf60c13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35140/0 (socket says 172.21.15.6:35140) 2024-09-10T20:57:03.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.999+0000 7f47bfe00640 1 -- 172.21.15.6:0/1214156890 learned_addr learned my addr 172.21.15.6:0/1214156890 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:03.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.999+0000 7f47c0800640 1 --2- 172.21.15.6:0/1214156890 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fbf5fe8650 0x55fbf60bfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:03.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.999+0000 7f47c1200640 1 --2- 172.21.15.6:0/1214156890 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fbf60bf1e0 0x55fbf60c1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:03.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.999+0000 7f47bfe00640 1 -- 172.21.15.6:0/1214156890 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fbf60bf1e0 msgr2=0x55fbf60c1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:03.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.999+0000 7f47bfe00640 1 --2- 172.21.15.6:0/1214156890 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fbf60bf1e0 0x55fbf60c1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:03.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.999+0000 7f47bfe00640 1 -- 172.21.15.6:0/1214156890 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fbf5fe8650 msgr2=0x55fbf60bfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:03.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.999+0000 7f47bfe00640 1 --2- 172.21.15.6:0/1214156890 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fbf5fe8650 0x55fbf60bfa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:03.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.999+0000 7f47bfe00640 1 -- 172.21.15.6:0/1214156890 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbf5f0ff10 con 0x55fbf6035020 2024-09-10T20:57:03.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.999+0000 7f47bfe00640 1 --2- 172.21.15.6:0/1214156890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fbf6035020 0x55fbf60c13d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f47ac00b540 tx=0x7f47ac00ba00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=475e6d0ff31c066e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:03.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:02.999+0000 7f47bea00640 1 -- 172.21.15.6:0/1214156890 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ac0099f0 con 0x55fbf6035020 2024-09-10T20:57:03.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.000+0000 7f47bea00640 1 -- 172.21.15.6:0/1214156890 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f47ac009b90 con 0x55fbf6035020 2024-09-10T20:57:03.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.000+0000 7f47bea00640 1 -- 172.21.15.6:0/1214156890 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ac014440 con 0x55fbf6035020 2024-09-10T20:57:03.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.000+0000 7f47c4126f40 1 -- 172.21.15.6:0/1214156890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fbf6035020 msgr2=0x55fbf60c13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:03.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.000+0000 7f47c4126f40 1 --2- 172.21.15.6:0/1214156890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fbf6035020 0x55fbf60c13d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f47ac00b540 tx=0x7f47ac00ba00 comp rx=0 tx=0).stop 2024-09-10T20:57:03.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.000+0000 7f47c4126f40 1 -- 172.21.15.6:0/1214156890 shutdown_connections 2024-09-10T20:57:03.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.000+0000 7f47c4126f40 1 --2- 172.21.15.6:0/1214156890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fbf6035020 0x55fbf60c13d0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:03.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.000+0000 7f47c4126f40 1 --2- 172.21.15.6:0/1214156890 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fbf60bf1e0 0x55fbf60c1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:03.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.000+0000 7f47c4126f40 1 --2- 172.21.15.6:0/1214156890 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fbf5fe8650 0x55fbf60bfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:03.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.000+0000 7f47c4126f40 1 -- 172.21.15.6:0/1214156890 >> 172.21.15.6:0/1214156890 conn(0x55fbf6017870 msgr2=0x55fbf60c0520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:03.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.000+0000 7f47c4126f40 1 -- 172.21.15.6:0/1214156890 shutdown_connections 2024-09-10T20:57:03.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.000+0000 7f47c4126f40 1 -- 172.21.15.6:0/1214156890 wait complete. 2024-09-10T20:57:03.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.001+0000 7f47c4126f40 1 Processor -- start 2024-09-10T20:57:03.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.001+0000 7f47c4126f40 1 -- start start 2024-09-10T20:57:03.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.002+0000 7f47c4126f40 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fbf5fe8650 0x55fbf60adaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:03.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.002+0000 7f47c4126f40 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fbf6035020 0x55fbf60ae560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:03.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.002+0000 7f47c4126f40 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fbf60bf1e0 0x55fbf601a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:03.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.002+0000 7f47c4126f40 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55fbf60b4160 con 0x55fbf60bf1e0 2024-09-10T20:57:03.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.002+0000 7f47c4126f40 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55fbf60b4690 con 0x55fbf6035020 2024-09-10T20:57:03.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.002+0000 7f47c4126f40 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x55fbf61480e0 con 0x55fbf5fe8650 2024-09-10T20:57:03.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.002+0000 7f47c1200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fbf60bf1e0 0x55fbf601a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:03.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.002+0000 7f47c1200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fbf60bf1e0 0x55fbf601a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35146/0 (socket says 172.21.15.6:35146) 2024-09-10T20:57:03.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.002+0000 7f47c1200640 1 -- 172.21.15.6:0/1566996677 learned_addr learned my addr 172.21.15.6:0/1566996677 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:03.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.002+0000 7f47bfe00640 1 --2- 172.21.15.6:0/1566996677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fbf6035020 0x55fbf60ae560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:03.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.002+0000 7f47c0800640 1 --2- 172.21.15.6:0/1566996677 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fbf5fe8650 0x55fbf60adaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:03.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.003+0000 7f47c1200640 1 -- 172.21.15.6:0/1566996677 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fbf5fe8650 msgr2=0x55fbf60adaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:03.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.003+0000 7f47c1200640 1 --2- 172.21.15.6:0/1566996677 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fbf5fe8650 0x55fbf60adaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:03.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.003+0000 7f47c1200640 1 -- 172.21.15.6:0/1566996677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fbf6035020 msgr2=0x55fbf60ae560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:03.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.003+0000 7f47c1200640 1 --2- 172.21.15.6:0/1566996677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fbf6035020 0x55fbf60ae560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:03.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.003+0000 7f47c1200640 1 -- 172.21.15.6:0/1566996677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbf60ae280 con 0x55fbf60bf1e0 2024-09-10T20:57:03.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.003+0000 7f47c1200640 1 --2- 172.21.15.6:0/1566996677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fbf60bf1e0 0x55fbf601a1e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f47b800b740 tx=0x7f47b800bc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:03.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.003+0000 7f47bd600640 1 -- 172.21.15.6:0/1566996677 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b8009a90 con 0x55fbf60bf1e0 2024-09-10T20:57:03.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.003+0000 7f47bd600640 1 -- 172.21.15.6:0/1566996677 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f47b8009c30 con 0x55fbf60bf1e0 2024-09-10T20:57:03.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.003+0000 7f47bd600640 1 -- 172.21.15.6:0/1566996677 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b800f690 con 0x55fbf60bf1e0 2024-09-10T20:57:03.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.003+0000 7f47c4126f40 1 -- 172.21.15.6:0/1566996677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fbf60afb20 con 0x55fbf60bf1e0 2024-09-10T20:57:03.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.003+0000 7f47c4126f40 1 -- 172.21.15.6:0/1566996677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbf6018d10 con 0x55fbf60bf1e0 2024-09-10T20:57:03.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.005+0000 7f47bd600640 1 -- 172.21.15.6:0/1566996677 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f47b800f830 con 0x55fbf60bf1e0 2024-09-10T20:57:03.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.006+0000 7f47bd600640 1 --2- 172.21.15.6:0/1566996677 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f47a0076950 0x7f47a0078e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:03.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.006+0000 7f47bd600640 1 -- 172.21.15.6:0/1566996677 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6104+0+0 (secure 0 0 0) 0x7f47b8099a80 con 0x55fbf60bf1e0 2024-09-10T20:57:03.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.007+0000 7f47c4126f40 1 --2- 172.21.15.6:0/1566996677 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x55fbf60bd320 0x55fbf60bd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:03.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.007+0000 7f47c4126f40 1 -- 172.21.15.6:0/1566996677 --> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] -- osd_op(unknown.0.0:1 5.13 5:ca8fdbba:::100000001fb.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38) -- 0x55fbf60bdc40 con 0x55fbf60bd320 2024-09-10T20:57:03.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.007+0000 7f47c0800640 1 --2- 172.21.15.6:0/1566996677 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f47a0076950 0x7f47a0078e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:03.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.007+0000 7f47bfe00640 1 --2- 172.21.15.6:0/1566996677 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x55fbf60bd320 0x55fbf60bd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:03.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.008+0000 7f47bfe00640 1 --2- 172.21.15.6:0/1566996677 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x55fbf60bd320 0x55fbf60bd700 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:03.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.008+0000 7f47c0800640 1 --2- 172.21.15.6:0/1566996677 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f47a0076950 0x7f47a0078e10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f47b4055000 tx=0x7f47b4003020 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:03.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.008+0000 7f47bfe00640 1 -- 172.21.15.6:0/1566996677 <== osd.3 v2:172.21.15.6:6816/3911674247 1 ==== osd_op_reply(1 100000001fb.00000000 [getxattr (30) out=30b] v0'0 uv3 ondisk = 0) ==== 164+0+30 (crc 0 0 0) 0x7f47ac009870 con 0x55fbf60bd320 2024-09-10T20:57:03.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.008+0000 7f47c4126f40 1 -- 172.21.15.6:0/1566996677 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x55fbf60bd320 msgr2=0x55fbf60bd700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:03.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.008+0000 7f47c4126f40 1 --2- 172.21.15.6:0/1566996677 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x55fbf60bd320 0x55fbf60bd700 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:03.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.008+0000 7f47c4126f40 1 -- 172.21.15.6:0/1566996677 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f47a0076950 msgr2=0x7f47a0078e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:03.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.008+0000 7f47c4126f40 1 --2- 172.21.15.6:0/1566996677 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f47a0076950 0x7f47a0078e10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f47b4055000 tx=0x7f47b4003020 comp rx=0 tx=0).stop 2024-09-10T20:57:03.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.008+0000 7f47c4126f40 1 -- 172.21.15.6:0/1566996677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fbf60bf1e0 msgr2=0x55fbf601a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:03.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.008+0000 7f47c4126f40 1 --2- 172.21.15.6:0/1566996677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fbf60bf1e0 0x55fbf601a1e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f47b800b740 tx=0x7f47b800bc00 comp rx=0 tx=0).stop 2024-09-10T20:57:03.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.008+0000 7f47c1200640 1 -- 172.21.15.6:0/1566996677 reap_dead start 2024-09-10T20:57:03.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.008+0000 7f47c4126f40 1 -- 172.21.15.6:0/1566996677 shutdown_connections 2024-09-10T20:57:03.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.008+0000 7f47c4126f40 1 -- 172.21.15.6:0/1566996677 >> 172.21.15.6:0/1566996677 conn(0x55fbf6017870 msgr2=0x55fbf60c0520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:03.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.008+0000 7f47c4126f40 1 -- 172.21.15.6:0/1566996677 shutdown_connections 2024-09-10T20:57:03.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.008+0000 7f47c4126f40 1 -- 172.21.15.6:0/1566996677 wait complete. 2024-09-10T20:57:03.016 INFO:teuthology.orchestra.run.smithi006.stdout:@@ 2024-09-10T20:57:03.017 DEBUG:teuthology.orchestra.run.smithi006:> ceph-dencoder type file_layout_t import - decode dump_json 2024-09-10T20:57:03.098 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-10T20:57:03.098 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_unit": 4194304, 2024-09-10T20:57:03.098 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_count": 1, 2024-09-10T20:57:03.098 INFO:teuthology.orchestra.run.smithi006.stdout: "object_size": 4194304, 2024-09-10T20:57:03.098 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_id": 5, 2024-09-10T20:57:03.098 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_ns": "" 2024-09-10T20:57:03.098 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-10T20:57:03.098 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:57:03.104 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T20:57:03.104 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T20:57:03.220 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T20:57:03.318 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T20:57:03.318 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T20:57:03.319 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-10T20:57:03.319 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:57:03.354 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-10T20:57:03.354 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:57:03.430 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T20:57:03.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.628+0000 7f0668400640 1 -- 172.21.15.6:0/3820913716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0660070450 msgr2=0x7f06600b5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:03.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.628+0000 7f0668400640 1 --2- 172.21.15.6:0/3820913716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0660070450 0x7f06600b5020 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0658005fd0 tx=0x7f065802a8b0 comp rx=0 tx=0).stop 2024-09-10T20:57:03.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.628+0000 7f0668400640 1 -- 172.21.15.6:0/3820913716 shutdown_connections 2024-09-10T20:57:03.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.628+0000 7f0668400640 1 --2- 172.21.15.6:0/3820913716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0660070450 0x7f06600b5020 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:03.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.628+0000 7f0668400640 1 -- 172.21.15.6:0/3820913716 >> 172.21.15.6:0/3820913716 conn(0x7f06600cfa20 msgr2=0x7f06600cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:03.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.628+0000 7f0668400640 1 -- 172.21.15.6:0/3820913716 shutdown_connections 2024-09-10T20:57:03.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.628+0000 7f0668400640 1 -- 172.21.15.6:0/3820913716 wait complete. 2024-09-10T20:57:03.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.630+0000 7f0668400640 1 Processor -- start 2024-09-10T20:57:03.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.630+0000 7f0668400640 1 -- start start 2024-09-10T20:57:03.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.631+0000 7f0668400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0660070450 0x7f0660150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:03.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.631+0000 7f0668400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0660159670 0x7f06600c3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:03.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.631+0000 7f0668400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f066015c170 0x7f06600b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:03.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.631+0000 7f0668400640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0660074740 con 0x7f066015c170 2024-09-10T20:57:03.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.631+0000 7f0668400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f06600745c0 con 0x7f0660159670 2024-09-10T20:57:03.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.631+0000 7f0668400640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f06600cd920 con 0x7f0660070450 2024-09-10T20:57:03.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.631+0000 7f0666400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f066015c170 0x7f06600b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:03.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.631+0000 7f0666400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f066015c170 0x7f06600b3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35154/0 (socket says 172.21.15.6:35154) 2024-09-10T20:57:03.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.631+0000 7f0666400640 1 -- 172.21.15.6:0/934542793 learned_addr learned my addr 172.21.15.6:0/934542793 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:03.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.631+0000 7f0665a00640 1 --2- 172.21.15.6:0/934542793 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0660070450 0x7f0660150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:03.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.631+0000 7f0665000640 1 --2- 172.21.15.6:0/934542793 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0660159670 0x7f06600c3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:03.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.632+0000 7f0666400640 1 -- 172.21.15.6:0/934542793 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0660070450 msgr2=0x7f0660150ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:03.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.632+0000 7f0666400640 1 --2- 172.21.15.6:0/934542793 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0660070450 0x7f0660150ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:03.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.632+0000 7f0666400640 1 -- 172.21.15.6:0/934542793 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0660159670 msgr2=0x7f06600c3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:03.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.632+0000 7f0666400640 1 --2- 172.21.15.6:0/934542793 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0660159670 0x7f06600c3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:03.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.632+0000 7f0666400640 1 -- 172.21.15.6:0/934542793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06600c3f10 con 0x7f066015c170 2024-09-10T20:57:03.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.632+0000 7f0666400640 1 --2- 172.21.15.6:0/934542793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f066015c170 0x7f06600b3ba0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f065802aea0 tx=0x7f06580316f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:03.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.632+0000 7f065d600640 1 -- 172.21.15.6:0/934542793 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0658031990 con 0x7f066015c170 2024-09-10T20:57:03.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.633+0000 7f065d600640 1 -- 172.21.15.6:0/934542793 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0658031c40 con 0x7f066015c170 2024-09-10T20:57:03.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.633+0000 7f065d600640 1 -- 172.21.15.6:0/934542793 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0658033330 con 0x7f066015c170 2024-09-10T20:57:03.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.633+0000 7f0668400640 1 -- 172.21.15.6:0/934542793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06600c41f0 con 0x7f066015c170 2024-09-10T20:57:03.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.633+0000 7f0668400640 1 -- 172.21.15.6:0/934542793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06600c47b0 con 0x7f066015c170 2024-09-10T20:57:03.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.634+0000 7f0668400640 1 -- 172.21.15.6:0/934542793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f066006fd40 con 0x7f066015c170 2024-09-10T20:57:03.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.635+0000 7f065d600640 1 -- 172.21.15.6:0/934542793 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f06580334d0 con 0x7f066015c170 2024-09-10T20:57:03.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.636+0000 7f065d600640 1 --2- 172.21.15.6:0/934542793 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f0640077f70 0x7f064007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:03.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.636+0000 7f065d600640 1 -- 172.21.15.6:0/934542793 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6104+0+0 (secure 0 0 0) 0x7f06580bb240 con 0x7f066015c170 2024-09-10T20:57:03.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.636+0000 7f0665a00640 1 --2- 172.21.15.6:0/934542793 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f0640077f70 0x7f064007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:03.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.637+0000 7f0665a00640 1 --2- 172.21.15.6:0/934542793 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f0640077f70 0x7f064007a430 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f06540046b0 tx=0x7f0654007cc0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:03.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.640+0000 7f065d600640 1 -- 172.21.15.6:0/934542793 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f065803f030 con 0x7f066015c170 2024-09-10T20:57:03.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.847+0000 7f0668400640 1 -- 172.21.15.6:0/934542793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0660069d20 con 0x7f066015c170 2024-09-10T20:57:03.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.847+0000 7f065d600640 1 -- 172.21.15.6:0/934542793 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v38) ==== 80+0+0 (secure 0 0 0) 0x7f06580834d0 con 0x7f066015c170 2024-09-10T20:57:03.851 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2024-09-10T20:57:03.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.850+0000 7f0668400640 1 -- 172.21.15.6:0/934542793 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f0640077f70 msgr2=0x7f064007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:03.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.850+0000 7f0668400640 1 --2- 172.21.15.6:0/934542793 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f0640077f70 0x7f064007a430 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f06540046b0 tx=0x7f0654007cc0 comp rx=0 tx=0).stop 2024-09-10T20:57:03.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.850+0000 7f0668400640 1 -- 172.21.15.6:0/934542793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f066015c170 msgr2=0x7f06600b3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:03.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.850+0000 7f0668400640 1 --2- 172.21.15.6:0/934542793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f066015c170 0x7f06600b3ba0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f065802aea0 tx=0x7f06580316f0 comp rx=0 tx=0).stop 2024-09-10T20:57:03.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.850+0000 7f0668400640 1 -- 172.21.15.6:0/934542793 shutdown_connections 2024-09-10T20:57:03.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.850+0000 7f0668400640 1 --2- 172.21.15.6:0/934542793 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f0640077f70 0x7f064007a430 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:03.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.850+0000 7f0668400640 1 --2- 172.21.15.6:0/934542793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f066015c170 0x7f06600b3ba0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:03.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.850+0000 7f0668400640 1 --2- 172.21.15.6:0/934542793 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0660159670 0x7f06600c3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:03.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.850+0000 7f0668400640 1 --2- 172.21.15.6:0/934542793 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0660070450 0x7f0660150ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:03.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.850+0000 7f0668400640 1 -- 172.21.15.6:0/934542793 >> 172.21.15.6:0/934542793 conn(0x7f06600cfa20 msgr2=0x7f06600cdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:03.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.850+0000 7f0668400640 1 -- 172.21.15.6:0/934542793 shutdown_connections 2024-09-10T20:57:03.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:03.850+0000 7f0668400640 1 -- 172.21.15.6:0/934542793 wait complete. 2024-09-10T20:57:03.870 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi006.front.sepia.ceph.com... 2024-09-10T20:57:03.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:57:03.870 DEBUG:teuthology.orchestra.run.smithi006:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-10T20:57:03.923 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[47982]: fuse finished with error 0 and tester_r 0 2024-09-10T20:57:03.928 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2024-09-10T20:57:03.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:57:03.929 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T20:57:04.110 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T20:57:04.110 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-10T20:57:04.110 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:57:04.150 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T20:57:04.150 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T20:57:04.150 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-10T20:57:04.150 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:57:04.189 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T20:57:04.189 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T20:57:04.190 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-10T20:57:04.190 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:57:04.228 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T20:57:04.229 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:57:04.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.386+0000 7f8589200640 1 -- 172.21.15.6:0/535083832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f858406e180 msgr2=0x7f858406e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:04.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.386+0000 7f8589200640 1 --2- 172.21.15.6:0/535083832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f858406e180 0x7f858406e5f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8584069430 tx=0x7f857c02a820 comp rx=0 tx=0).stop 2024-09-10T20:57:04.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.386+0000 7f8589200640 1 -- 172.21.15.6:0/535083832 shutdown_connections 2024-09-10T20:57:04.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.386+0000 7f8589200640 1 --2- 172.21.15.6:0/535083832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f858406e180 0x7f858406e5f0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:04.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.386+0000 7f8589200640 1 --2- 172.21.15.6:0/535083832 >> v2:172.21.15.150:3300/0 conn(0x7f85840cfd30 0x7f8584073d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:04.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.386+0000 7f8589200640 1 -- 172.21.15.6:0/535083832 >> 172.21.15.6:0/535083832 conn(0x7f858406cf90 msgr2=0x7f858406d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:04.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.386+0000 7f8589200640 1 -- 172.21.15.6:0/535083832 shutdown_connections 2024-09-10T20:57:04.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.386+0000 7f8589200640 1 -- 172.21.15.6:0/535083832 wait complete. 2024-09-10T20:57:04.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.387+0000 7f8589200640 1 Processor -- start 2024-09-10T20:57:04.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.387+0000 7f8589200640 1 -- start start 2024-09-10T20:57:04.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.388+0000 7f8589200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f858406e180 0x7f85841f51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:04.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.388+0000 7f8589200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85840cfd30 0x7f8584147490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:04.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.388+0000 7f8589200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f858415c990 0x7f8584144050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:04.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.388+0000 7f8589200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8584072cf0 con 0x7f858415c990 2024-09-10T20:57:04.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.388+0000 7f8589200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8584072b70 con 0x7f85840cfd30 2024-09-10T20:57:04.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.388+0000 7f8589200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8584072e70 con 0x7f858406e180 2024-09-10T20:57:04.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.389+0000 7f8583400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f858406e180 0x7f85841f51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:04.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.389+0000 7f8583e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f858415c990 0x7f8584144050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:04.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.389+0000 7f8583400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f858406e180 0x7f85841f51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.6:33234/0 (socket says 172.21.15.6:33234) 2024-09-10T20:57:04.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.389+0000 7f8583400640 1 -- 172.21.15.6:0/2358189725 learned_addr learned my addr 172.21.15.6:0/2358189725 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:04.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.389+0000 7f857aa00640 1 --2- 172.21.15.6:0/2358189725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85840cfd30 0x7f8584147490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:04.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.389+0000 7f8583e00640 1 -- 172.21.15.6:0/2358189725 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f858406e180 msgr2=0x7f85841f51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:04.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.389+0000 7f8583e00640 1 --2- 172.21.15.6:0/2358189725 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f858406e180 0x7f85841f51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:04.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.389+0000 7f8583e00640 1 -- 172.21.15.6:0/2358189725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85840cfd30 msgr2=0x7f8584147490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:04.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.389+0000 7f8583e00640 1 --2- 172.21.15.6:0/2358189725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85840cfd30 0x7f8584147490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:04.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.389+0000 7f8583e00640 1 -- 172.21.15.6:0/2358189725 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85840af3f0 con 0x7f858415c990 2024-09-10T20:57:04.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.390+0000 7f8583e00640 1 --2- 172.21.15.6:0/2358189725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f858415c990 0x7f8584144050 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f8584073ce0 tx=0x7f857c032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:04.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.390+0000 7f857be00640 1 -- 172.21.15.6:0/2358189725 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857c037040 con 0x7f858415c990 2024-09-10T20:57:04.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.390+0000 7f857be00640 1 -- 172.21.15.6:0/2358189725 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f857c042070 con 0x7f858415c990 2024-09-10T20:57:04.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.390+0000 7f857be00640 1 -- 172.21.15.6:0/2358189725 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857c0042a0 con 0x7f858415c990 2024-09-10T20:57:04.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.390+0000 7f8589200640 1 -- 172.21.15.6:0/2358189725 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85840af6d0 con 0x7f858415c990 2024-09-10T20:57:04.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.390+0000 7f8589200640 1 -- 172.21.15.6:0/2358189725 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8584146c90 con 0x7f858415c990 2024-09-10T20:57:04.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.391+0000 7f8589200640 1 -- 172.21.15.6:0/2358189725 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8584146a80 con 0x7f858415c990 2024-09-10T20:57:04.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.392+0000 7f857be00640 1 -- 172.21.15.6:0/2358189725 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f857c03a030 con 0x7f858415c990 2024-09-10T20:57:04.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.393+0000 7f857be00640 1 --2- 172.21.15.6:0/2358189725 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f8560077f70 0x7f856007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:04.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.393+0000 7f857be00640 1 -- 172.21.15.6:0/2358189725 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6104+0+0 (secure 0 0 0) 0x7f857c0ba760 con 0x7f858415c990 2024-09-10T20:57:04.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.394+0000 7f8583400640 1 --2- 172.21.15.6:0/2358189725 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f8560077f70 0x7f856007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:04.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.394+0000 7f8583400640 1 --2- 172.21.15.6:0/2358189725 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f8560077f70 0x7f856007a430 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8574005fd0 tx=0x7f857400b480 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:04.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.397+0000 7f857be00640 1 -- 172.21.15.6:0/2358189725 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f857c0829e0 con 0x7f858415c990 2024-09-10T20:57:04.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.631+0000 7f8589200640 1 -- 172.21.15.6:0/2358189725 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85840732f0 con 0x7f858415c990 2024-09-10T20:57:04.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.631+0000 7f857be00640 1 -- 172.21.15.6:0/2358189725 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5222 (secure 0 0 0) 0x7f857c087410 con 0x7f858415c990 2024-09-10T20:57:04.636 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:57:04.636 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":18,"btime":"2024-09-10T20:56:58:138800+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1675451102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1675451102},{"type":"v1","addr":"172.21.15.6:6834","nonce":1675451102}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4924,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/676153174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":676153174},{"type":"v1","addr":"172.21.15.150:6836","nonce":676153174}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4950,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4072260905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":4072260905},{"type":"v1","addr":"172.21.15.150:6837","nonce":4072260905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:56:37.566072+0000","modified":"2024-09-10T20:56:57.568755+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4956":{"gid":4956,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/1598644433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1598644433},{"type":"v1","addr":"172.21.15.6:6835","nonce":1598644433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5,6],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4956,"qdb_cluster":[4956]},"id":2}]} 2024-09-10T20:57:04.636 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 18 2024-09-10T20:57:04.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.634+0000 7f8589200640 1 -- 172.21.15.6:0/2358189725 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f8560077f70 msgr2=0x7f856007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:04.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.634+0000 7f8589200640 1 --2- 172.21.15.6:0/2358189725 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f8560077f70 0x7f856007a430 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8574005fd0 tx=0x7f857400b480 comp rx=0 tx=0).stop 2024-09-10T20:57:04.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.634+0000 7f8589200640 1 -- 172.21.15.6:0/2358189725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f858415c990 msgr2=0x7f8584144050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:04.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.634+0000 7f8589200640 1 --2- 172.21.15.6:0/2358189725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f858415c990 0x7f8584144050 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f8584073ce0 tx=0x7f857c032d10 comp rx=0 tx=0).stop 2024-09-10T20:57:04.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.634+0000 7f8589200640 1 -- 172.21.15.6:0/2358189725 shutdown_connections 2024-09-10T20:57:04.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.634+0000 7f8589200640 1 --2- 172.21.15.6:0/2358189725 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f8560077f70 0x7f856007a430 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:04.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.634+0000 7f8589200640 1 --2- 172.21.15.6:0/2358189725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f858415c990 0x7f8584144050 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:04.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.634+0000 7f8589200640 1 --2- 172.21.15.6:0/2358189725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85840cfd30 0x7f8584147490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:04.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.634+0000 7f8589200640 1 --2- 172.21.15.6:0/2358189725 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f858406e180 0x7f85841f51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:04.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.634+0000 7f8589200640 1 -- 172.21.15.6:0/2358189725 >> 172.21.15.6:0/2358189725 conn(0x7f858406cf90 msgr2=0x7f858406d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:04.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.634+0000 7f8589200640 1 -- 172.21.15.6:0/2358189725 shutdown_connections 2024-09-10T20:57:04.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.634+0000 7f8589200640 1 -- 172.21.15.6:0/2358189725 wait complete. 2024-09-10T20:57:04.655 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:57:04.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.811+0000 7f57ea000640 1 -- 172.21.15.6:0/1346385154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57e4070450 msgr2=0x7f57e40cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:04.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.811+0000 7f57ea000640 1 --2- 172.21.15.6:0/1346385154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57e4070450 0x7f57e40cd920 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f57dc005fd0 tx=0x7f57dc02a820 comp rx=0 tx=0).stop 2024-09-10T20:57:04.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.811+0000 7f57ea000640 1 -- 172.21.15.6:0/1346385154 shutdown_connections 2024-09-10T20:57:04.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.811+0000 7f57ea000640 1 --2- 172.21.15.6:0/1346385154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57e4070450 0x7f57e40cd920 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:04.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.811+0000 7f57ea000640 1 --2- 172.21.15.6:0/1346385154 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57e415c170 0x7f57e40743b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:04.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.811+0000 7f57ea000640 1 -- 172.21.15.6:0/1346385154 >> 172.21.15.6:0/1346385154 conn(0x7f57e40cfa20 msgr2=0x7f57e40cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:04.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.812+0000 7f57ea000640 1 -- 172.21.15.6:0/1346385154 shutdown_connections 2024-09-10T20:57:04.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.812+0000 7f57ea000640 1 -- 172.21.15.6:0/1346385154 wait complete. 2024-09-10T20:57:04.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.813+0000 7f57ea000640 1 Processor -- start 2024-09-10T20:57:04.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.813+0000 7f57ea000640 1 -- start start 2024-09-10T20:57:04.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.814+0000 7f57ea000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57e4070450 0x7f57e40b0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:04.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.814+0000 7f57ea000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57e4159670 0x7f57e4154f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:04.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.814+0000 7f57ea000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57e415c170 0x7f57e4155490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:04.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.814+0000 7f57ea000640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f57e40b4ca0 con 0x7f57e4159670 2024-09-10T20:57:04.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.814+0000 7f57ea000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f57e40b4b20 con 0x7f57e415c170 2024-09-10T20:57:04.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.814+0000 7f57ea000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f57e40b4e20 con 0x7f57e4070450 2024-09-10T20:57:04.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.814+0000 7f57daa00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57e4159670 0x7f57e4154f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:04.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.814+0000 7f57daa00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57e4159670 0x7f57e4154f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35186/0 (socket says 172.21.15.6:35186) 2024-09-10T20:57:04.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.814+0000 7f57daa00640 1 -- 172.21.15.6:0/2810525279 learned_addr learned my addr 172.21.15.6:0/2810525279 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:04.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.815+0000 7f57e3e00640 1 --2- 172.21.15.6:0/2810525279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57e415c170 0x7f57e4155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:04.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.815+0000 7f57e3400640 1 --2- 172.21.15.6:0/2810525279 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57e4070450 0x7f57e40b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:04.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.815+0000 7f57daa00640 1 -- 172.21.15.6:0/2810525279 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57e4070450 msgr2=0x7f57e40b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:04.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.815+0000 7f57daa00640 1 --2- 172.21.15.6:0/2810525279 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57e4070450 0x7f57e40b0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:04.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.815+0000 7f57daa00640 1 -- 172.21.15.6:0/2810525279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57e415c170 msgr2=0x7f57e4155490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:04.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.815+0000 7f57daa00640 1 --2- 172.21.15.6:0/2810525279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57e415c170 0x7f57e4155490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:04.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.815+0000 7f57daa00640 1 -- 172.21.15.6:0/2810525279 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57e40cbd70 con 0x7f57e4159670 2024-09-10T20:57:04.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.815+0000 7f57daa00640 1 --2- 172.21.15.6:0/2810525279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57e4159670 0x7f57e4154f50 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f57cc00e9f0 tx=0x7f57cc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:04.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.815+0000 7f57dbe00640 1 -- 172.21.15.6:0/2810525279 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57cc00cd80 con 0x7f57e4159670 2024-09-10T20:57:04.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.815+0000 7f57dbe00640 1 -- 172.21.15.6:0/2810525279 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f57cc010430 con 0x7f57e4159670 2024-09-10T20:57:04.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.815+0000 7f57dbe00640 1 -- 172.21.15.6:0/2810525279 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57cc010840 con 0x7f57e4159670 2024-09-10T20:57:04.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.815+0000 7f57ea000640 1 -- 172.21.15.6:0/2810525279 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57e41f8300 con 0x7f57e4159670 2024-09-10T20:57:04.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.816+0000 7f57ea000640 1 -- 172.21.15.6:0/2810525279 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57e41f88c0 con 0x7f57e4159670 2024-09-10T20:57:04.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.817+0000 7f57ea000640 1 -- 172.21.15.6:0/2810525279 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57e406a150 con 0x7f57e4159670 2024-09-10T20:57:04.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.818+0000 7f57dbe00640 1 -- 172.21.15.6:0/2810525279 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f57cc0109e0 con 0x7f57e4159670 2024-09-10T20:57:04.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.819+0000 7f57dbe00640 1 --2- 172.21.15.6:0/2810525279 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f57c0077f70 0x7f57c007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:04.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.819+0000 7f57dbe00640 1 -- 172.21.15.6:0/2810525279 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6104+0+0 (secure 0 0 0) 0x7f57cc09a920 con 0x7f57e4159670 2024-09-10T20:57:04.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.819+0000 7f57e3400640 1 --2- 172.21.15.6:0/2810525279 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f57c0077f70 0x7f57c007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:04.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.820+0000 7f57e3400640 1 --2- 172.21.15.6:0/2810525279 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f57c0077f70 0x7f57c007a430 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f57d40016b0 tx=0x7f57d4009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:04.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:04.823+0000 7f57dbe00640 1 -- 172.21.15.6:0/2810525279 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f57cc062d90 con 0x7f57e4159670 2024-09-10T20:57:05.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.056+0000 7f57ea000640 1 -- 172.21.15.6:0/2810525279 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f57e4069d20 con 0x7f57e4159670 2024-09-10T20:57:05.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.057+0000 7f57dbe00640 1 -- 172.21.15.6:0/2810525279 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5222 (secure 0 0 0) 0x7f57cc0677c0 con 0x7f57e4159670 2024-09-10T20:57:05.061 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:57:05.061 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":18,"btime":"2024-09-10T20:56:58:138800+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1675451102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1675451102},{"type":"v1","addr":"172.21.15.6:6834","nonce":1675451102}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4924,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/676153174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":676153174},{"type":"v1","addr":"172.21.15.150:6836","nonce":676153174}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4950,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4072260905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":4072260905},{"type":"v1","addr":"172.21.15.150:6837","nonce":4072260905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:56:37.566072+0000","modified":"2024-09-10T20:56:57.568755+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4956":{"gid":4956,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/1598644433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1598644433},{"type":"v1","addr":"172.21.15.6:6835","nonce":1598644433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5,6],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4956,"qdb_cluster":[4956]},"id":2}]} 2024-09-10T20:57:05.061 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 18 2024-09-10T20:57:05.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.059+0000 7f57ea000640 1 -- 172.21.15.6:0/2810525279 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f57c0077f70 msgr2=0x7f57c007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:05.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.059+0000 7f57ea000640 1 --2- 172.21.15.6:0/2810525279 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f57c0077f70 0x7f57c007a430 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f57d40016b0 tx=0x7f57d4009040 comp rx=0 tx=0).stop 2024-09-10T20:57:05.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.059+0000 7f57ea000640 1 -- 172.21.15.6:0/2810525279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57e4159670 msgr2=0x7f57e4154f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:05.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.059+0000 7f57ea000640 1 --2- 172.21.15.6:0/2810525279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57e4159670 0x7f57e4154f50 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f57cc00e9f0 tx=0x7f57cc00eeb0 comp rx=0 tx=0).stop 2024-09-10T20:57:05.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.059+0000 7f57ea000640 1 -- 172.21.15.6:0/2810525279 shutdown_connections 2024-09-10T20:57:05.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.059+0000 7f57ea000640 1 --2- 172.21.15.6:0/2810525279 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f57c0077f70 0x7f57c007a430 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:05.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.059+0000 7f57ea000640 1 --2- 172.21.15.6:0/2810525279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57e4159670 0x7f57e4154f50 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:05.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.059+0000 7f57ea000640 1 --2- 172.21.15.6:0/2810525279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57e415c170 0x7f57e4155490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:05.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.059+0000 7f57ea000640 1 --2- 172.21.15.6:0/2810525279 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57e4070450 0x7f57e40b0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:05.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.059+0000 7f57ea000640 1 -- 172.21.15.6:0/2810525279 >> 172.21.15.6:0/2810525279 conn(0x7f57e40cfa20 msgr2=0x7f57e4074050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:05.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.059+0000 7f57ea000640 1 -- 172.21.15.6:0/2810525279 shutdown_connections 2024-09-10T20:57:05.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.059+0000 7f57ea000640 1 -- 172.21.15.6:0/2810525279 wait complete. 2024-09-10T20:57:05.080 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T20:57:05.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.236+0000 7f5905400640 1 -- 172.21.15.6:0/3837664695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f590015c170 msgr2=0x7f59000cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:05.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.236+0000 7f5905400640 1 --2- 172.21.15.6:0/3837664695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f590015c170 0x7f59000cd920 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5900051860 tx=0x7f58e802a560 comp rx=0 tx=0).stop 2024-09-10T20:57:05.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.236+0000 7f5905400640 1 -- 172.21.15.6:0/3837664695 shutdown_connections 2024-09-10T20:57:05.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.236+0000 7f5905400640 1 --2- 172.21.15.6:0/3837664695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f590015c170 0x7f59000cd920 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:05.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.236+0000 7f5905400640 1 --2- 172.21.15.6:0/3837664695 >> v2:172.21.15.150:3300/0 conn(0x7f5900159670 0x7f59000743b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:05.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.236+0000 7f5905400640 1 -- 172.21.15.6:0/3837664695 >> 172.21.15.6:0/3837664695 conn(0x7f59000cfa20 msgr2=0x7f59000cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:05.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.236+0000 7f5905400640 1 -- 172.21.15.6:0/3837664695 shutdown_connections 2024-09-10T20:57:05.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.236+0000 7f5905400640 1 -- 172.21.15.6:0/3837664695 wait complete. 2024-09-10T20:57:05.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.238+0000 7f5905400640 1 Processor -- start 2024-09-10T20:57:05.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.238+0000 7f5905400640 1 -- start start 2024-09-10T20:57:05.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.239+0000 7f5905400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f590006fd40 0x7f59000c9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:05.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.239+0000 7f5905400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5900159670 0x7f5900151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:05.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.239+0000 7f5905400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f590015c170 0x7f59000ad880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:05.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.239+0000 7f5905400640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f59000b4a90 con 0x7f590015c170 2024-09-10T20:57:05.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.239+0000 7f5905400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f59000b4910 con 0x7f590006fd40 2024-09-10T20:57:05.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.239+0000 7f5905400640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f59000b4c10 con 0x7f5900159670 2024-09-10T20:57:05.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.239+0000 7f58fe800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f590006fd40 0x7f59000c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:05.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.239+0000 7f58ff200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f590015c170 0x7f59000ad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:05.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.239+0000 7f58fe800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f590006fd40 0x7f59000c9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.6:45242/0 (socket says 172.21.15.6:45242) 2024-09-10T20:57:05.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.239+0000 7f58fe800640 1 -- 172.21.15.6:0/3883395598 learned_addr learned my addr 172.21.15.6:0/3883395598 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:05.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.239+0000 7f58f7e00640 1 --2- 172.21.15.6:0/3883395598 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5900159670 0x7f5900151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:05.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.240+0000 7f58ff200640 1 -- 172.21.15.6:0/3883395598 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5900159670 msgr2=0x7f5900151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:05.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.240+0000 7f58ff200640 1 --2- 172.21.15.6:0/3883395598 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5900159670 0x7f5900151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:05.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.240+0000 7f58ff200640 1 -- 172.21.15.6:0/3883395598 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f590006fd40 msgr2=0x7f59000c9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:05.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.240+0000 7f58ff200640 1 --2- 172.21.15.6:0/3883395598 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f590006fd40 0x7f59000c9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:05.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.240+0000 7f58ff200640 1 -- 172.21.15.6:0/3883395598 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59001f7e60 con 0x7f590015c170 2024-09-10T20:57:05.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.240+0000 7f58fe800640 1 --2- 172.21.15.6:0/3883395598 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f590006fd40 0x7f59000c9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:57:05.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.240+0000 7f58ff200640 1 --2- 172.21.15.6:0/3883395598 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f590015c170 0x7f59000ad880 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f58f800c700 tx=0x7f58f800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:05.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.240+0000 7f58f6a00640 1 -- 172.21.15.6:0/3883395598 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f8003b90 con 0x7f590015c170 2024-09-10T20:57:05.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.240+0000 7f58f6a00640 1 -- 172.21.15.6:0/3883395598 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f58f8003d50 con 0x7f590015c170 2024-09-10T20:57:05.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.240+0000 7f58f6a00640 1 -- 172.21.15.6:0/3883395598 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f8005330 con 0x7f590015c170 2024-09-10T20:57:05.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.240+0000 7f5905400640 1 -- 172.21.15.6:0/3883395598 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59001f8140 con 0x7f590015c170 2024-09-10T20:57:05.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.241+0000 7f5905400640 1 -- 172.21.15.6:0/3883395598 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59001f8700 con 0x7f590015c170 2024-09-10T20:57:05.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.242+0000 7f5905400640 1 -- 172.21.15.6:0/3883395598 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59000b50c0 con 0x7f590015c170 2024-09-10T20:57:05.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.243+0000 7f58f6a00640 1 -- 172.21.15.6:0/3883395598 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f58f80054d0 con 0x7f590015c170 2024-09-10T20:57:05.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.244+0000 7f58f6a00640 1 --2- 172.21.15.6:0/3883395598 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f58dc077fa0 0x7f58dc07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:05.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.244+0000 7f58f6a00640 1 -- 172.21.15.6:0/3883395598 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6104+0+0 (secure 0 0 0) 0x7f58f8099ab0 con 0x7f590015c170 2024-09-10T20:57:05.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.245+0000 7f58fe800640 1 --2- 172.21.15.6:0/3883395598 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f58dc077fa0 0x7f58dc07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:05.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.246+0000 7f58fe800640 1 --2- 172.21.15.6:0/3883395598 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f58dc077fa0 0x7f58dc07a460 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f58f00104e0 tx=0x7f58f000b410 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:05.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.249+0000 7f58f6a00640 1 -- 172.21.15.6:0/3883395598 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f58f80057f0 con 0x7f590015c170 2024-09-10T20:57:05.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.446+0000 7f5905400640 1 -- 172.21.15.6:0/3883395598 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5900069d20 con 0x7f590015c170 2024-09-10T20:57:05.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.447+0000 7f58f6a00640 1 -- 172.21.15.6:0/3883395598 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+18505 (secure 0 0 0) 0x7f58f8061dc0 con 0x7f590015c170 2024-09-10T20:57:05.452 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:57:05.452 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":38,"fsid":"9e04309e-61c3-4c78-82db-9576e465d98a","created":"2024-09-10T20:55:17.972466+0000","modified":"2024-09-10T20:56:59.149135+0000","last_up_change":"2024-09-10T20:55:32.392769+0000","last_in_change":"2024-09-10T20:55:22.232252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:55:33.196464+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:56:35.128358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-10T20:56:36.534250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"data_new","create_time":"2024-09-10T20:56:57.111456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0918c5c8-a028-4987-bad2-406c412ec3f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6801","nonce":895515615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6803","nonce":895515615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6807","nonce":895515615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6805","nonce":895515615}]},"public_addr":"172.21.15.6:6801/895515615","cluster_addr":"172.21.15.6:6803/895515615","heartbeat_back_addr":"172.21.15.6:6807/895515615","heartbeat_front_addr":"172.21.15.6:6805/895515615","state":["exists","up"]},{"osd":1,"uuid":"415e9c78-c3d9-46d6-b277-348453f42155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6809","nonce":1129113250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6811","nonce":1129113250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6815","nonce":1129113250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6813","nonce":1129113250}]},"public_addr":"172.21.15.6:6809/1129113250","cluster_addr":"172.21.15.6:6811/1129113250","heartbeat_back_addr":"172.21.15.6:6815/1129113250","heartbeat_front_addr":"172.21.15.6:6813/1129113250","state":["exists","up"]},{"osd":2,"uuid":"763c1cf2-a43d-4c10-815d-eaf4a32afc1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6825","nonce":3847470051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6827","nonce":3847470051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6831","nonce":3847470051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6829","nonce":3847470051}]},"public_addr":"172.21.15.6:6825/3847470051","cluster_addr":"172.21.15.6:6827/3847470051","heartbeat_back_addr":"172.21.15.6:6831/3847470051","heartbeat_front_addr":"172.21.15.6:6829/3847470051","state":["exists","up"]},{"osd":3,"uuid":"877b1cc1-2434-4b32-af66-9c2485eac9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6817","nonce":3911674247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6819","nonce":3911674247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6823","nonce":3911674247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6821","nonce":3911674247}]},"public_addr":"172.21.15.6:6817/3911674247","cluster_addr":"172.21.15.6:6819/3911674247","heartbeat_back_addr":"172.21.15.6:6823/3911674247","heartbeat_front_addr":"172.21.15.6:6821/3911674247","state":["exists","up"]},{"osd":4,"uuid":"e0b27501-dfdc-4e7f-b73a-9573c869267a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6827","nonce":2568527750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6829","nonce":2568527750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6833","nonce":2568527750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6831","nonce":2568527750}]},"public_addr":"172.21.15.150:6827/2568527750","cluster_addr":"172.21.15.150:6829/2568527750","heartbeat_back_addr":"172.21.15.150:6833/2568527750","heartbeat_front_addr":"172.21.15.150:6831/2568527750","state":["exists","up"]},{"osd":5,"uuid":"67e48053-4f15-44fd-a30c-c9522f86d169","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6811","nonce":371417736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6813","nonce":371417736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6817","nonce":371417736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6815","nonce":371417736}]},"public_addr":"172.21.15.150:6811/371417736","cluster_addr":"172.21.15.150:6813/371417736","heartbeat_back_addr":"172.21.15.150:6817/371417736","heartbeat_front_addr":"172.21.15.150:6815/371417736","state":["exists","up"]},{"osd":6,"uuid":"1456df2e-ae91-45a4-bc3a-a06c753092af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6819","nonce":2329248366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6821","nonce":2329248366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6825","nonce":2329248366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6823","nonce":2329248366}]},"public_addr":"172.21.15.150:6819/2329248366","cluster_addr":"172.21.15.150:6821/2329248366","heartbeat_back_addr":"172.21.15.150:6825/2329248366","heartbeat_front_addr":"172.21.15.150:6823/2329248366","state":["exists","up"]},{"osd":7,"uuid":"a9daafcb-5ecd-43bd-ab0a-dc4b480cfc2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6803","nonce":527018351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6805","nonce":527018351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6809","nonce":527018351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6807","nonce":527018351}]},"public_addr":"172.21.15.150:6803/527018351","cluster_addr":"172.21.15.150:6805/527018351","heartbeat_back_addr":"172.21.15.150:6809/527018351","heartbeat_front_addr":"172.21.15.150:6807/527018351","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.710061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.024506+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.824320+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.431608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.637032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.054828+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.333290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.358875+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:57:05.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.450+0000 7f5905400640 1 -- 172.21.15.6:0/3883395598 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f58dc077fa0 msgr2=0x7f58dc07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:05.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.450+0000 7f5905400640 1 --2- 172.21.15.6:0/3883395598 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f58dc077fa0 0x7f58dc07a460 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f58f00104e0 tx=0x7f58f000b410 comp rx=0 tx=0).stop 2024-09-10T20:57:05.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.450+0000 7f5905400640 1 -- 172.21.15.6:0/3883395598 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f590015c170 msgr2=0x7f59000ad880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:05.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.450+0000 7f5905400640 1 --2- 172.21.15.6:0/3883395598 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f590015c170 0x7f59000ad880 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f58f800c700 tx=0x7f58f800cbc0 comp rx=0 tx=0).stop 2024-09-10T20:57:05.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.450+0000 7f5905400640 1 -- 172.21.15.6:0/3883395598 shutdown_connections 2024-09-10T20:57:05.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.450+0000 7f5905400640 1 --2- 172.21.15.6:0/3883395598 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f58dc077fa0 0x7f58dc07a460 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:05.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.450+0000 7f5905400640 1 --2- 172.21.15.6:0/3883395598 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f590015c170 0x7f59000ad880 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:05.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.450+0000 7f5905400640 1 --2- 172.21.15.6:0/3883395598 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5900159670 0x7f5900151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:05.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.450+0000 7f5905400640 1 --2- 172.21.15.6:0/3883395598 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f590006fd40 0x7f59000c9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:05.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.450+0000 7f5905400640 1 -- 172.21.15.6:0/3883395598 >> 172.21.15.6:0/3883395598 conn(0x7f59000cfa20 msgr2=0x7f59000ce720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:05.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.450+0000 7f5905400640 1 -- 172.21.15.6:0/3883395598 shutdown_connections 2024-09-10T20:57:05.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.450+0000 7f5905400640 1 -- 172.21.15.6:0/3883395598 wait complete. 2024-09-10T20:57:05.470 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T20:57:05.470 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:57:05.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.625+0000 7f9e64400640 1 -- 172.21.15.6:0/1025966856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e5c15bb30 msgr2=0x7f9e5c0cf340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:05.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.625+0000 7f9e64400640 1 --2- 172.21.15.6:0/1025966856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e5c15bb30 0x7f9e5c0cf340 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c0af390 tx=0x7f9e5002a560 comp rx=0 tx=0).stop 2024-09-10T20:57:05.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.625+0000 7f9e64400640 1 -- 172.21.15.6:0/1025966856 shutdown_connections 2024-09-10T20:57:05.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.625+0000 7f9e64400640 1 --2- 172.21.15.6:0/1025966856 >> v2:172.21.15.150:3300/0 conn(0x7f9e5c0caa40 0x7f9e5c161a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:05.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.625+0000 7f9e64400640 1 --2- 172.21.15.6:0/1025966856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e5c15bb30 0x7f9e5c0cf340 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:05.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.625+0000 7f9e64400640 1 -- 172.21.15.6:0/1025966856 >> 172.21.15.6:0/1025966856 conn(0x7f9e5c0cfa20 msgr2=0x7f9e5c0cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:05.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.626+0000 7f9e64400640 1 -- 172.21.15.6:0/1025966856 shutdown_connections 2024-09-10T20:57:05.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.626+0000 7f9e64400640 1 -- 172.21.15.6:0/1025966856 wait complete. 2024-09-10T20:57:05.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.627+0000 7f9e64400640 1 Processor -- start 2024-09-10T20:57:05.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.627+0000 7f9e64400640 1 -- start start 2024-09-10T20:57:05.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.628+0000 7f9e64400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e5c0caa40 0x7f9e5c160db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:05.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.628+0000 7f9e64400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e5c15bb30 0x7f9e5c1f7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:05.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.628+0000 7f9e64400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e5c161f60 0x7f9e5c159410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:05.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.628+0000 7f9e64400640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9e5c0aea10 con 0x7f9e5c15bb30 2024-09-10T20:57:05.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.628+0000 7f9e64400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9e5c0ae890 con 0x7f9e5c161f60 2024-09-10T20:57:05.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.628+0000 7f9e64400640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f9e5c15eb40 con 0x7f9e5c0caa40 2024-09-10T20:57:05.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.628+0000 7f9e61000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e5c15bb30 0x7f9e5c1f7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:05.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.628+0000 7f9e61000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e5c15bb30 0x7f9e5c1f7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35224/0 (socket says 172.21.15.6:35224) 2024-09-10T20:57:05.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.629+0000 7f9e61000640 1 -- 172.21.15.6:0/977589171 learned_addr learned my addr 172.21.15.6:0/977589171 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:05.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.629+0000 7f9e61a00640 1 --2- 172.21.15.6:0/977589171 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e5c0caa40 0x7f9e5c160db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:05.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.629+0000 7f9e62400640 1 --2- 172.21.15.6:0/977589171 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e5c161f60 0x7f9e5c159410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:05.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.629+0000 7f9e61000640 1 -- 172.21.15.6:0/977589171 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e5c0caa40 msgr2=0x7f9e5c160db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:05.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.629+0000 7f9e61000640 1 --2- 172.21.15.6:0/977589171 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e5c0caa40 0x7f9e5c160db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:05.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.629+0000 7f9e61000640 1 -- 172.21.15.6:0/977589171 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e5c161f60 msgr2=0x7f9e5c159410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:05.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.629+0000 7f9e61000640 1 --2- 172.21.15.6:0/977589171 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e5c161f60 0x7f9e5c159410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:05.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.629+0000 7f9e61000640 1 -- 172.21.15.6:0/977589171 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e5c159950 con 0x7f9e5c15bb30 2024-09-10T20:57:05.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.629+0000 7f9e62400640 1 --2- 172.21.15.6:0/977589171 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e5c161f60 0x7f9e5c159410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:57:05.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.629+0000 7f9e61000640 1 --2- 172.21.15.6:0/977589171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e5c15bb30 0x7f9e5c1f7cb0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9e4800d770 tx=0x7f9e4800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:05.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.629+0000 7f9e59600640 1 -- 172.21.15.6:0/977589171 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e48017070 con 0x7f9e5c15bb30 2024-09-10T20:57:05.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.630+0000 7f9e59600640 1 -- 172.21.15.6:0/977589171 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e48009d20 con 0x7f9e5c15bb30 2024-09-10T20:57:05.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.630+0000 7f9e59600640 1 -- 172.21.15.6:0/977589171 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e48005280 con 0x7f9e5c15bb30 2024-09-10T20:57:05.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.630+0000 7f9e64400640 1 -- 172.21.15.6:0/977589171 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e5c1f8430 con 0x7f9e5c15bb30 2024-09-10T20:57:05.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.630+0000 7f9e64400640 1 -- 172.21.15.6:0/977589171 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e5c1f89f0 con 0x7f9e5c15bb30 2024-09-10T20:57:05.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.631+0000 7f9e64400640 1 -- 172.21.15.6:0/977589171 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e5c15eff0 con 0x7f9e5c15bb30 2024-09-10T20:57:05.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.632+0000 7f9e59600640 1 -- 172.21.15.6:0/977589171 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f9e48005420 con 0x7f9e5c15bb30 2024-09-10T20:57:05.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.633+0000 7f9e59600640 1 --2- 172.21.15.6:0/977589171 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f9e3c077f70 0x7f9e3c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:05.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.633+0000 7f9e59600640 1 -- 172.21.15.6:0/977589171 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6104+0+0 (secure 0 0 0) 0x7f9e4809a140 con 0x7f9e5c15bb30 2024-09-10T20:57:05.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.633+0000 7f9e61a00640 1 --2- 172.21.15.6:0/977589171 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f9e3c077f70 0x7f9e3c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:05.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.634+0000 7f9e61a00640 1 --2- 172.21.15.6:0/977589171 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f9e3c077f70 0x7f9e3c07a430 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9e50033000 tx=0x7f9e50004730 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:05.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.637+0000 7f9e59600640 1 -- 172.21.15.6:0/977589171 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f9e48062340 con 0x7f9e5c15bb30 2024-09-10T20:57:05.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.866+0000 7f9e64400640 1 -- 172.21.15.6:0/977589171 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9e5c069d20 con 0x7f9e5c15bb30 2024-09-10T20:57:05.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.867+0000 7f9e59600640 1 -- 172.21.15.6:0/977589171 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5222 (secure 0 0 0) 0x7f9e4806b0b0 con 0x7f9e5c15bb30 2024-09-10T20:57:05.871 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:57:05.871 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":18,"btime":"2024-09-10T20:56:58:138800+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1675451102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1675451102},{"type":"v1","addr":"172.21.15.6:6834","nonce":1675451102}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4924,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/676153174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":676153174},{"type":"v1","addr":"172.21.15.150:6836","nonce":676153174}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4950,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4072260905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":4072260905},{"type":"v1","addr":"172.21.15.150:6837","nonce":4072260905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:56:37.566072+0000","modified":"2024-09-10T20:56:57.568755+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4956":{"gid":4956,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/1598644433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1598644433},{"type":"v1","addr":"172.21.15.6:6835","nonce":1598644433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5,6],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4956,"qdb_cluster":[4956]},"id":2}]} 2024-09-10T20:57:05.871 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 18 2024-09-10T20:57:05.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.869+0000 7f9e64400640 1 -- 172.21.15.6:0/977589171 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f9e3c077f70 msgr2=0x7f9e3c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:05.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.869+0000 7f9e64400640 1 --2- 172.21.15.6:0/977589171 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f9e3c077f70 0x7f9e3c07a430 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9e50033000 tx=0x7f9e50004730 comp rx=0 tx=0).stop 2024-09-10T20:57:05.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.869+0000 7f9e64400640 1 -- 172.21.15.6:0/977589171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e5c15bb30 msgr2=0x7f9e5c1f7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:05.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.869+0000 7f9e64400640 1 --2- 172.21.15.6:0/977589171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e5c15bb30 0x7f9e5c1f7cb0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9e4800d770 tx=0x7f9e4800dc30 comp rx=0 tx=0).stop 2024-09-10T20:57:05.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.869+0000 7f9e64400640 1 -- 172.21.15.6:0/977589171 shutdown_connections 2024-09-10T20:57:05.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.869+0000 7f9e64400640 1 --2- 172.21.15.6:0/977589171 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f9e3c077f70 0x7f9e3c07a430 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:05.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.869+0000 7f9e64400640 1 --2- 172.21.15.6:0/977589171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e5c15bb30 0x7f9e5c1f7cb0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:05.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.869+0000 7f9e64400640 1 --2- 172.21.15.6:0/977589171 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e5c161f60 0x7f9e5c159410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:05.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.869+0000 7f9e64400640 1 --2- 172.21.15.6:0/977589171 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e5c0caa40 0x7f9e5c160db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:05.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.869+0000 7f9e64400640 1 -- 172.21.15.6:0/977589171 >> 172.21.15.6:0/977589171 conn(0x7f9e5c0cfa20 msgr2=0x7f9e5c0731e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:05.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.869+0000 7f9e64400640 1 -- 172.21.15.6:0/977589171 shutdown_connections 2024-09-10T20:57:05.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:05.869+0000 7f9e64400640 1 -- 172.21.15.6:0/977589171 wait complete. 2024-09-10T20:57:05.889 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:57:06.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.046+0000 7fa9f3e00640 1 -- 172.21.15.6:0/2367241553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9ec159670 msgr2=0x7fa9ec0743b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:06.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.046+0000 7fa9f3e00640 1 --2- 172.21.15.6:0/2367241553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9ec159670 0x7fa9ec0743b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec0cc450 tx=0x7fa9e002a4d0 comp rx=0 tx=0).stop 2024-09-10T20:57:06.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.046+0000 7fa9f3e00640 1 -- 172.21.15.6:0/2367241553 shutdown_connections 2024-09-10T20:57:06.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.046+0000 7fa9f3e00640 1 --2- 172.21.15.6:0/2367241553 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9ec06fd40 0x7fa9ec070170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:06.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.046+0000 7fa9f3e00640 1 --2- 172.21.15.6:0/2367241553 >> v2:172.21.15.150:3300/0 conn(0x7fa9ec15c170 0x7fa9ec0cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:06.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.046+0000 7fa9f3e00640 1 --2- 172.21.15.6:0/2367241553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9ec159670 0x7fa9ec0743b0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:06.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.046+0000 7fa9f3e00640 1 -- 172.21.15.6:0/2367241553 >> 172.21.15.6:0/2367241553 conn(0x7fa9ec0cfa20 msgr2=0x7fa9ec0cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:06.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.046+0000 7fa9f3e00640 1 -- 172.21.15.6:0/2367241553 shutdown_connections 2024-09-10T20:57:06.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.046+0000 7fa9f3e00640 1 -- 172.21.15.6:0/2367241553 wait complete. 2024-09-10T20:57:06.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.048+0000 7fa9f3e00640 1 Processor -- start 2024-09-10T20:57:06.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.048+0000 7fa9f3e00640 1 -- start start 2024-09-10T20:57:06.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.049+0000 7fa9f3e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9ec06fd40 0x7fa9ec1f5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:06.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.049+0000 7fa9f3e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9ec159670 0x7fa9ec15ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:06.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.049+0000 7fa9f3e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9ec15c170 0x7fa9ec1f7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:06.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.049+0000 7fa9f3e00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa9ec0b4a90 con 0x7fa9ec15c170 2024-09-10T20:57:06.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.049+0000 7fa9f3e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa9ec0b4910 con 0x7fa9ec159670 2024-09-10T20:57:06.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.049+0000 7fa9f3e00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa9ec0b4c10 con 0x7fa9ec06fd40 2024-09-10T20:57:06.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.049+0000 7fa9f1e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9ec15c170 0x7fa9ec1f7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:06.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.049+0000 7fa9f1e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9ec15c170 0x7fa9ec1f7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35246/0 (socket says 172.21.15.6:35246) 2024-09-10T20:57:06.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.049+0000 7fa9f1e00640 1 -- 172.21.15.6:0/3939352372 learned_addr learned my addr 172.21.15.6:0/3939352372 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:06.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.049+0000 7fa9f1400640 1 --2- 172.21.15.6:0/3939352372 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9ec06fd40 0x7fa9ec1f5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:06.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.049+0000 7fa9f0a00640 1 --2- 172.21.15.6:0/3939352372 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9ec159670 0x7fa9ec15ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:06.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.050+0000 7fa9f1e00640 1 -- 172.21.15.6:0/3939352372 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9ec06fd40 msgr2=0x7fa9ec1f5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:06.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.050+0000 7fa9f1e00640 1 --2- 172.21.15.6:0/3939352372 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9ec06fd40 0x7fa9ec1f5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:06.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.050+0000 7fa9f1e00640 1 -- 172.21.15.6:0/3939352372 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9ec159670 msgr2=0x7fa9ec15ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:06.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.050+0000 7fa9f1e00640 1 --2- 172.21.15.6:0/3939352372 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9ec159670 0x7fa9ec15ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:06.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.050+0000 7fa9f1e00640 1 -- 172.21.15.6:0/3939352372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9ec1f89b0 con 0x7fa9ec15c170 2024-09-10T20:57:06.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.050+0000 7fa9f1e00640 1 --2- 172.21.15.6:0/3939352372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9ec15c170 0x7fa9ec1f7f30 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa9e400e8e0 tx=0x7fa9e400eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:06.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.050+0000 7fa9e9600640 1 -- 172.21.15.6:0/3939352372 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e4004d20 con 0x7fa9ec15c170 2024-09-10T20:57:06.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.050+0000 7fa9e9600640 1 -- 172.21.15.6:0/3939352372 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa9e400ca60 con 0x7fa9ec15c170 2024-09-10T20:57:06.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.050+0000 7fa9f3e00640 1 -- 172.21.15.6:0/3939352372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9ec1f8c90 con 0x7fa9ec15c170 2024-09-10T20:57:06.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.050+0000 7fa9e9600640 1 -- 172.21.15.6:0/3939352372 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e4005020 con 0x7fa9ec15c170 2024-09-10T20:57:06.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.050+0000 7fa9f3e00640 1 -- 172.21.15.6:0/3939352372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9ec15bb70 con 0x7fa9ec15c170 2024-09-10T20:57:06.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.051+0000 7fa9f3e00640 1 -- 172.21.15.6:0/3939352372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9ec0b51a0 con 0x7fa9ec15c170 2024-09-10T20:57:06.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.053+0000 7fa9e9600640 1 -- 172.21.15.6:0/3939352372 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa9e400f040 con 0x7fa9ec15c170 2024-09-10T20:57:06.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.054+0000 7fa9e9600640 1 --2- 172.21.15.6:0/3939352372 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa9cc077f70 0x7fa9cc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:06.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.054+0000 7fa9e9600640 1 -- 172.21.15.6:0/3939352372 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6104+0+0 (secure 0 0 0) 0x7fa9e409a490 con 0x7fa9ec15c170 2024-09-10T20:57:06.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.055+0000 7fa9f1400640 1 --2- 172.21.15.6:0/3939352372 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa9cc077f70 0x7fa9cc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:06.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.055+0000 7fa9f1400640 1 --2- 172.21.15.6:0/3939352372 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa9cc077f70 0x7fa9cc07a430 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0033000 tx=0x7fa9e0004730 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:06.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.058+0000 7fa9e9600640 1 -- 172.21.15.6:0/3939352372 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fa9e4016030 con 0x7fa9ec15c170 2024-09-10T20:57:06.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.292+0000 7fa9f3e00640 1 -- 172.21.15.6:0/3939352372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa9ec069d20 con 0x7fa9ec15c170 2024-09-10T20:57:06.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.293+0000 7fa9e9600640 1 -- 172.21.15.6:0/3939352372 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5222 (secure 0 0 0) 0x7fa9e40627a0 con 0x7fa9ec15c170 2024-09-10T20:57:06.297 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:57:06.297 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":18,"btime":"2024-09-10T20:56:58:138800+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1675451102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1675451102},{"type":"v1","addr":"172.21.15.6:6834","nonce":1675451102}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4924,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/676153174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":676153174},{"type":"v1","addr":"172.21.15.150:6836","nonce":676153174}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4950,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4072260905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":4072260905},{"type":"v1","addr":"172.21.15.150:6837","nonce":4072260905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:56:37.566072+0000","modified":"2024-09-10T20:56:57.568755+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4956":{"gid":4956,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/1598644433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1598644433},{"type":"v1","addr":"172.21.15.6:6835","nonce":1598644433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5,6],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4956,"qdb_cluster":[4956]},"id":2}]} 2024-09-10T20:57:06.297 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 18 2024-09-10T20:57:06.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.295+0000 7fa9f3e00640 1 -- 172.21.15.6:0/3939352372 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa9cc077f70 msgr2=0x7fa9cc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:06.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.295+0000 7fa9f3e00640 1 --2- 172.21.15.6:0/3939352372 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa9cc077f70 0x7fa9cc07a430 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0033000 tx=0x7fa9e0004730 comp rx=0 tx=0).stop 2024-09-10T20:57:06.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.295+0000 7fa9f3e00640 1 -- 172.21.15.6:0/3939352372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9ec15c170 msgr2=0x7fa9ec1f7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:06.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.295+0000 7fa9f3e00640 1 --2- 172.21.15.6:0/3939352372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9ec15c170 0x7fa9ec1f7f30 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa9e400e8e0 tx=0x7fa9e400eda0 comp rx=0 tx=0).stop 2024-09-10T20:57:06.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.295+0000 7fa9f3e00640 1 -- 172.21.15.6:0/3939352372 shutdown_connections 2024-09-10T20:57:06.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.295+0000 7fa9f3e00640 1 --2- 172.21.15.6:0/3939352372 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa9cc077f70 0x7fa9cc07a430 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:06.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.295+0000 7fa9f3e00640 1 --2- 172.21.15.6:0/3939352372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9ec15c170 0x7fa9ec1f7f30 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:06.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.295+0000 7fa9f3e00640 1 --2- 172.21.15.6:0/3939352372 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9ec159670 0x7fa9ec15ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:06.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.295+0000 7fa9f3e00640 1 --2- 172.21.15.6:0/3939352372 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9ec06fd40 0x7fa9ec1f5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:06.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.295+0000 7fa9f3e00640 1 -- 172.21.15.6:0/3939352372 >> 172.21.15.6:0/3939352372 conn(0x7fa9ec0cfa20 msgr2=0x7fa9ec073aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:06.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.296+0000 7fa9f3e00640 1 -- 172.21.15.6:0/3939352372 shutdown_connections 2024-09-10T20:57:06.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.296+0000 7fa9f3e00640 1 -- 172.21.15.6:0/3939352372 wait complete. 2024-09-10T20:57:06.315 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T20:57:06.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.471+0000 7f6640400640 1 -- 172.21.15.6:0/3904097321 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6620003aa0 msgr2=0x7f6620003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:06.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.471+0000 7f6640400640 1 --2- 172.21.15.6:0/3904097321 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6620003aa0 0x7f6620003ec0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f662c0016c0 tx=0x7f6620005830 comp rx=0 tx=0).stop 2024-09-10T20:57:06.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.471+0000 7f6640400640 1 -- 172.21.15.6:0/3904097321 shutdown_connections 2024-09-10T20:57:06.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.471+0000 7f6640400640 1 --2- 172.21.15.6:0/3904097321 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6620003aa0 0x7f6620003ec0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:06.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.471+0000 7f6640400640 1 -- 172.21.15.6:0/3904097321 >> 172.21.15.6:0/3904097321 conn(0x7f66380cfa20 msgr2=0x7f66380cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:06.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.471+0000 7f6640400640 1 -- 172.21.15.6:0/3904097321 shutdown_connections 2024-09-10T20:57:06.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.471+0000 7f6640400640 1 -- 172.21.15.6:0/3904097321 wait complete. 2024-09-10T20:57:06.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.473+0000 7f6640400640 1 Processor -- start 2024-09-10T20:57:06.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.473+0000 7f6640400640 1 -- start start 2024-09-10T20:57:06.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.474+0000 7f6640400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6620003aa0 0x7f663815bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:06.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.474+0000 7f6640400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66381f8450 0x7f66380c3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:06.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.474+0000 7f6640400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6638158660 0x7f66380ad880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:06.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.474+0000 7f6640400640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f663806f5f0 con 0x7f6620003aa0 2024-09-10T20:57:06.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.474+0000 7f6640400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f663806f470 con 0x7f6638158660 2024-09-10T20:57:06.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.474+0000 7f6640400640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f663806f770 con 0x7f66381f8450 2024-09-10T20:57:06.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.474+0000 7f663da00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6620003aa0 0x7f663815bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:06.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.474+0000 7f663da00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6620003aa0 0x7f663815bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35250/0 (socket says 172.21.15.6:35250) 2024-09-10T20:57:06.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.474+0000 7f663da00640 1 -- 172.21.15.6:0/198749129 learned_addr learned my addr 172.21.15.6:0/198749129 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:06.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.474+0000 7f663e400640 1 --2- 172.21.15.6:0/198749129 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6638158660 0x7f66380ad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:06.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.474+0000 7f663d000640 1 --2- 172.21.15.6:0/198749129 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66381f8450 0x7f66380c3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:06.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.474+0000 7f663da00640 1 -- 172.21.15.6:0/198749129 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66381f8450 msgr2=0x7f66380c3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:06.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.474+0000 7f663da00640 1 --2- 172.21.15.6:0/198749129 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66381f8450 0x7f66380c3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:06.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.474+0000 7f663da00640 1 -- 172.21.15.6:0/198749129 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6638158660 msgr2=0x7f66380ad880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:06.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.474+0000 7f663da00640 1 --2- 172.21.15.6:0/198749129 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6638158660 0x7f66380ad880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:06.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.474+0000 7f663da00640 1 -- 172.21.15.6:0/198749129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66381f89c0 con 0x7f6620003aa0 2024-09-10T20:57:06.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.475+0000 7f663da00640 1 --2- 172.21.15.6:0/198749129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6620003aa0 0x7f663815bd60 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f662c000c00 tx=0x7f662c006430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:06.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.475+0000 7f6635600640 1 -- 172.21.15.6:0/198749129 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f662c042070 con 0x7f6620003aa0 2024-09-10T20:57:06.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.475+0000 7f6635600640 1 -- 172.21.15.6:0/198749129 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f662c039070 con 0x7f6620003aa0 2024-09-10T20:57:06.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.475+0000 7f6635600640 1 -- 172.21.15.6:0/198749129 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f662c003d90 con 0x7f6620003aa0 2024-09-10T20:57:06.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.475+0000 7f6640400640 1 -- 172.21.15.6:0/198749129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66381f8ca0 con 0x7f6620003aa0 2024-09-10T20:57:06.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.475+0000 7f6640400640 1 -- 172.21.15.6:0/198749129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66381f9260 con 0x7f6620003aa0 2024-09-10T20:57:06.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.476+0000 7f6640400640 1 -- 172.21.15.6:0/198749129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6638070030 con 0x7f6620003aa0 2024-09-10T20:57:06.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.477+0000 7f6635600640 1 -- 172.21.15.6:0/198749129 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f662c033420 con 0x7f6620003aa0 2024-09-10T20:57:06.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.478+0000 7f6635600640 1 --2- 172.21.15.6:0/198749129 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6618077f70 0x7f661807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:06.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.478+0000 7f6635600640 1 -- 172.21.15.6:0/198749129 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6104+0+0 (secure 0 0 0) 0x7f662c0b9640 con 0x7f6620003aa0 2024-09-10T20:57:06.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.479+0000 7f663d000640 1 --2- 172.21.15.6:0/198749129 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6618077f70 0x7f661807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:06.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.480+0000 7f663d000640 1 --2- 172.21.15.6:0/198749129 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6618077f70 0x7f661807a430 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6624000fb0 tx=0x7f6624001c30 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:06.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.483+0000 7f6635600640 1 -- 172.21.15.6:0/198749129 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f6638070030 con 0x7f6620003aa0 2024-09-10T20:57:06.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.677+0000 7f6640400640 1 -- 172.21.15.6:0/198749129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f66380afa00 con 0x7f6620003aa0 2024-09-10T20:57:06.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.679+0000 7f6635600640 1 -- 172.21.15.6:0/198749129 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+18505 (secure 0 0 0) 0x7f66380afa00 con 0x7f6620003aa0 2024-09-10T20:57:06.683 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:57:06.683 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":38,"fsid":"9e04309e-61c3-4c78-82db-9576e465d98a","created":"2024-09-10T20:55:17.972466+0000","modified":"2024-09-10T20:56:59.149135+0000","last_up_change":"2024-09-10T20:55:32.392769+0000","last_in_change":"2024-09-10T20:55:22.232252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:55:33.196464+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:56:35.128358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-10T20:56:36.534250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"data_new","create_time":"2024-09-10T20:56:57.111456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0918c5c8-a028-4987-bad2-406c412ec3f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6801","nonce":895515615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6803","nonce":895515615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6807","nonce":895515615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6805","nonce":895515615}]},"public_addr":"172.21.15.6:6801/895515615","cluster_addr":"172.21.15.6:6803/895515615","heartbeat_back_addr":"172.21.15.6:6807/895515615","heartbeat_front_addr":"172.21.15.6:6805/895515615","state":["exists","up"]},{"osd":1,"uuid":"415e9c78-c3d9-46d6-b277-348453f42155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6809","nonce":1129113250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6811","nonce":1129113250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6815","nonce":1129113250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6813","nonce":1129113250}]},"public_addr":"172.21.15.6:6809/1129113250","cluster_addr":"172.21.15.6:6811/1129113250","heartbeat_back_addr":"172.21.15.6:6815/1129113250","heartbeat_front_addr":"172.21.15.6:6813/1129113250","state":["exists","up"]},{"osd":2,"uuid":"763c1cf2-a43d-4c10-815d-eaf4a32afc1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6825","nonce":3847470051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6827","nonce":3847470051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6831","nonce":3847470051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6829","nonce":3847470051}]},"public_addr":"172.21.15.6:6825/3847470051","cluster_addr":"172.21.15.6:6827/3847470051","heartbeat_back_addr":"172.21.15.6:6831/3847470051","heartbeat_front_addr":"172.21.15.6:6829/3847470051","state":["exists","up"]},{"osd":3,"uuid":"877b1cc1-2434-4b32-af66-9c2485eac9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6817","nonce":3911674247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6819","nonce":3911674247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6823","nonce":3911674247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6821","nonce":3911674247}]},"public_addr":"172.21.15.6:6817/3911674247","cluster_addr":"172.21.15.6:6819/3911674247","heartbeat_back_addr":"172.21.15.6:6823/3911674247","heartbeat_front_addr":"172.21.15.6:6821/3911674247","state":["exists","up"]},{"osd":4,"uuid":"e0b27501-dfdc-4e7f-b73a-9573c869267a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6827","nonce":2568527750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6829","nonce":2568527750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6833","nonce":2568527750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6831","nonce":2568527750}]},"public_addr":"172.21.15.150:6827/2568527750","cluster_addr":"172.21.15.150:6829/2568527750","heartbeat_back_addr":"172.21.15.150:6833/2568527750","heartbeat_front_addr":"172.21.15.150:6831/2568527750","state":["exists","up"]},{"osd":5,"uuid":"67e48053-4f15-44fd-a30c-c9522f86d169","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6811","nonce":371417736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6813","nonce":371417736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6817","nonce":371417736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6815","nonce":371417736}]},"public_addr":"172.21.15.150:6811/371417736","cluster_addr":"172.21.15.150:6813/371417736","heartbeat_back_addr":"172.21.15.150:6817/371417736","heartbeat_front_addr":"172.21.15.150:6815/371417736","state":["exists","up"]},{"osd":6,"uuid":"1456df2e-ae91-45a4-bc3a-a06c753092af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6819","nonce":2329248366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6821","nonce":2329248366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6825","nonce":2329248366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6823","nonce":2329248366}]},"public_addr":"172.21.15.150:6819/2329248366","cluster_addr":"172.21.15.150:6821/2329248366","heartbeat_back_addr":"172.21.15.150:6825/2329248366","heartbeat_front_addr":"172.21.15.150:6823/2329248366","state":["exists","up"]},{"osd":7,"uuid":"a9daafcb-5ecd-43bd-ab0a-dc4b480cfc2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6803","nonce":527018351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6805","nonce":527018351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6809","nonce":527018351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6807","nonce":527018351}]},"public_addr":"172.21.15.150:6803/527018351","cluster_addr":"172.21.15.150:6805/527018351","heartbeat_back_addr":"172.21.15.150:6809/527018351","heartbeat_front_addr":"172.21.15.150:6807/527018351","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.710061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.024506+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.824320+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.431608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.637032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.054828+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.333290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.358875+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:57:06.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.681+0000 7f6640400640 1 -- 172.21.15.6:0/198749129 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6618077f70 msgr2=0x7f661807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:06.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.681+0000 7f6640400640 1 --2- 172.21.15.6:0/198749129 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6618077f70 0x7f661807a430 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6624000fb0 tx=0x7f6624001c30 comp rx=0 tx=0).stop 2024-09-10T20:57:06.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.681+0000 7f6640400640 1 -- 172.21.15.6:0/198749129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6620003aa0 msgr2=0x7f663815bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:06.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.681+0000 7f6640400640 1 --2- 172.21.15.6:0/198749129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6620003aa0 0x7f663815bd60 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f662c000c00 tx=0x7f662c006430 comp rx=0 tx=0).stop 2024-09-10T20:57:06.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.681+0000 7f6640400640 1 -- 172.21.15.6:0/198749129 shutdown_connections 2024-09-10T20:57:06.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.681+0000 7f6640400640 1 --2- 172.21.15.6:0/198749129 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f6618077f70 0x7f661807a430 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:06.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.681+0000 7f6640400640 1 --2- 172.21.15.6:0/198749129 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6638158660 0x7f66380ad880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:06.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.681+0000 7f6640400640 1 --2- 172.21.15.6:0/198749129 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66381f8450 0x7f66380c3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:06.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.681+0000 7f6640400640 1 --2- 172.21.15.6:0/198749129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6620003aa0 0x7f663815bd60 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:06.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.681+0000 7f6640400640 1 -- 172.21.15.6:0/198749129 >> 172.21.15.6:0/198749129 conn(0x7f66380cfa20 msgr2=0x7f663815f300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:06.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.682+0000 7f6640400640 1 -- 172.21.15.6:0/198749129 shutdown_connections 2024-09-10T20:57:06.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.682+0000 7f6640400640 1 -- 172.21.15.6:0/198749129 wait complete. 2024-09-10T20:57:06.702 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T20:57:06.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.861+0000 7f43e5800640 1 -- 172.21.15.6:0/1808107882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43e00cb2e0 msgr2=0x7f43e006f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:06.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.861+0000 7f43e5800640 1 --2- 172.21.15.6:0/1808107882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43e00cb2e0 0x7f43e006f3a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f43d8005fd0 tx=0x7f43d802a820 comp rx=0 tx=0).stop 2024-09-10T20:57:06.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.861+0000 7f43e5800640 1 -- 172.21.15.6:0/1808107882 shutdown_connections 2024-09-10T20:57:06.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.861+0000 7f43e5800640 1 --2- 172.21.15.6:0/1808107882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43e00cb2e0 0x7f43e006f3a0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:06.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.861+0000 7f43e5800640 1 --2- 172.21.15.6:0/1808107882 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43e00cfa40 0x7f43e00738f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:06.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.861+0000 7f43e5800640 1 -- 172.21.15.6:0/1808107882 >> 172.21.15.6:0/1808107882 conn(0x7f43e00ccba0 msgr2=0x7f43e00ccf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:06.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.861+0000 7f43e5800640 1 -- 172.21.15.6:0/1808107882 shutdown_connections 2024-09-10T20:57:06.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.861+0000 7f43e5800640 1 -- 172.21.15.6:0/1808107882 wait complete. 2024-09-10T20:57:06.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.862+0000 7f43e5800640 1 Processor -- start 2024-09-10T20:57:06.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.863+0000 7f43e5800640 1 -- start start 2024-09-10T20:57:06.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.863+0000 7f43e5800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43e00ca770 0x7f43e01f2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:06.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.863+0000 7f43e5800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43e00cb2e0 0x7f43e00c97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:06.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.863+0000 7f43e5800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43e00cfa40 0x7f43e00c78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:06.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.863+0000 7f43e5800640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f43e006fc70 con 0x7f43e00ca770 2024-09-10T20:57:06.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.863+0000 7f43e5800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f43e006faf0 con 0x7f43e00cb2e0 2024-09-10T20:57:06.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.863+0000 7f43e5800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f43e006fdf0 con 0x7f43e00cfa40 2024-09-10T20:57:06.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.864+0000 7f43dfe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43e00ca770 0x7f43e01f2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:06.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.864+0000 7f43dfe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43e00ca770 0x7f43e01f2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35268/0 (socket says 172.21.15.6:35268) 2024-09-10T20:57:06.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.864+0000 7f43dfe00640 1 -- 172.21.15.6:0/1088640621 learned_addr learned my addr 172.21.15.6:0/1088640621 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:06.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.864+0000 7f43e4e00640 1 --2- 172.21.15.6:0/1088640621 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43e00cfa40 0x7f43e00c78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:06.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.864+0000 7f43d7400640 1 --2- 172.21.15.6:0/1088640621 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43e00cb2e0 0x7f43e00c97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:06.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.864+0000 7f43dfe00640 1 -- 172.21.15.6:0/1088640621 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43e00cfa40 msgr2=0x7f43e00c78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:06.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.864+0000 7f43dfe00640 1 --2- 172.21.15.6:0/1088640621 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43e00cfa40 0x7f43e00c78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:06.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.864+0000 7f43dfe00640 1 -- 172.21.15.6:0/1088640621 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43e00cb2e0 msgr2=0x7f43e00c97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:06.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.864+0000 7f43dfe00640 1 --2- 172.21.15.6:0/1088640621 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43e00cb2e0 0x7f43e00c97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:06.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.864+0000 7f43dfe00640 1 -- 172.21.15.6:0/1088640621 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43e00c8da0 con 0x7f43e00ca770 2024-09-10T20:57:06.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.864+0000 7f43dfe00640 1 --2- 172.21.15.6:0/1088640621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43e00ca770 0x7f43e01f2c10 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f43d000d770 tx=0x7f43d000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:06.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.865+0000 7f43dcc00640 1 -- 172.21.15.6:0/1088640621 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d0017070 con 0x7f43e00ca770 2024-09-10T20:57:06.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.865+0000 7f43dcc00640 1 -- 172.21.15.6:0/1088640621 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f43d0004310 con 0x7f43e00ca770 2024-09-10T20:57:06.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.865+0000 7f43dcc00640 1 -- 172.21.15.6:0/1088640621 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d0009c30 con 0x7f43e00ca770 2024-09-10T20:57:06.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.865+0000 7f43e5800640 1 -- 172.21.15.6:0/1088640621 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43e00b5ad0 con 0x7f43e00ca770 2024-09-10T20:57:06.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.865+0000 7f43e5800640 1 -- 172.21.15.6:0/1088640621 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43e00b5780 con 0x7f43e00ca770 2024-09-10T20:57:06.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.866+0000 7f43e5800640 1 -- 172.21.15.6:0/1088640621 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43e00702a0 con 0x7f43e00ca770 2024-09-10T20:57:06.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.867+0000 7f43dcc00640 1 -- 172.21.15.6:0/1088640621 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f43d0005020 con 0x7f43e00ca770 2024-09-10T20:57:06.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.868+0000 7f43dcc00640 1 --2- 172.21.15.6:0/1088640621 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f43bc077f70 0x7f43bc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:06.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.869+0000 7f43dcc00640 1 -- 172.21.15.6:0/1088640621 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6104+0+0 (secure 0 0 0) 0x7f43d009a2d0 con 0x7f43e00ca770 2024-09-10T20:57:06.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.869+0000 7f43d7400640 1 --2- 172.21.15.6:0/1088640621 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f43bc077f70 0x7f43bc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:06.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.870+0000 7f43d7400640 1 --2- 172.21.15.6:0/1088640621 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f43bc077f70 0x7f43bc07a430 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f43e00b5710 tx=0x7f43c8009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:06.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:06.873+0000 7f43dcc00640 1 -- 172.21.15.6:0/1088640621 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f43d0020020 con 0x7f43e00ca770 2024-09-10T20:57:07.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.102+0000 7f43e5800640 1 -- 172.21.15.6:0/1088640621 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f43e00cdcf0 con 0x7f43e00ca770 2024-09-10T20:57:07.106 INFO:tasks.ceph.mon.a.smithi006.stderr:2024-09-10T20:57:07.103+0000 7f7840600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T20:57:07.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.105+0000 7f43dcc00640 1 -- 172.21.15.6:0/1088640621 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) ==== 161+0+0 (secure 0 0 0) 0x7f43d0062c30 con 0x7f43e00ca770 2024-09-10T20:57:07.109 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T20:57:07.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.108+0000 7f43e5800640 1 -- 172.21.15.6:0/1088640621 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f43bc077f70 msgr2=0x7f43bc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:07.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.108+0000 7f43e5800640 1 --2- 172.21.15.6:0/1088640621 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f43bc077f70 0x7f43bc07a430 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f43e00b5710 tx=0x7f43c8009040 comp rx=0 tx=0).stop 2024-09-10T20:57:07.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.108+0000 7f43e5800640 1 -- 172.21.15.6:0/1088640621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43e00ca770 msgr2=0x7f43e01f2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:07.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.108+0000 7f43e5800640 1 --2- 172.21.15.6:0/1088640621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43e00ca770 0x7f43e01f2c10 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f43d000d770 tx=0x7f43d000dc30 comp rx=0 tx=0).stop 2024-09-10T20:57:07.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.108+0000 7f43e5800640 1 -- 172.21.15.6:0/1088640621 shutdown_connections 2024-09-10T20:57:07.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.108+0000 7f43e5800640 1 --2- 172.21.15.6:0/1088640621 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f43bc077f70 0x7f43bc07a430 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:07.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.108+0000 7f43e5800640 1 --2- 172.21.15.6:0/1088640621 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43e00cfa40 0x7f43e00c78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:07.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.108+0000 7f43e5800640 1 --2- 172.21.15.6:0/1088640621 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43e00cb2e0 0x7f43e00c97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:07.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.108+0000 7f43e5800640 1 --2- 172.21.15.6:0/1088640621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43e00ca770 0x7f43e01f2c10 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:07.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.108+0000 7f43e5800640 1 -- 172.21.15.6:0/1088640621 >> 172.21.15.6:0/1088640621 conn(0x7f43e00ccba0 msgr2=0x7f43e00ad710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:07.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.108+0000 7f43e5800640 1 -- 172.21.15.6:0/1088640621 shutdown_connections 2024-09-10T20:57:07.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.108+0000 7f43e5800640 1 -- 172.21.15.6:0/1088640621 wait complete. 2024-09-10T20:57:07.136 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T20:57:07.185 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2024-09-10T20:57:07.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.296+0000 7fb75b200640 1 -- 172.21.15.6:0/4267015584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb75c0d2a60 msgr2=0x7fb75c161930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:07.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.296+0000 7fb75b200640 1 --2- 172.21.15.6:0/4267015584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb75c0d2a60 0x7fb75c161930 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb75c08cf00 tx=0x7fb75402a9e0 comp rx=0 tx=0).stop 2024-09-10T20:57:07.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.296+0000 7fb75b200640 1 -- 172.21.15.6:0/4267015584 shutdown_connections 2024-09-10T20:57:07.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.296+0000 7fb75b200640 1 --2- 172.21.15.6:0/4267015584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb75c0d2a60 0x7fb75c161930 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:07.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.296+0000 7fb75b200640 1 --2- 172.21.15.6:0/4267015584 >> v2:172.21.15.150:3300/0 conn(0x7fb75c0cf380 0x7fb75c0d2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:07.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.296+0000 7fb75b200640 1 -- 172.21.15.6:0/4267015584 >> 172.21.15.6:0/4267015584 conn(0x7fb75c09d0a0 msgr2=0x7fb75c0d3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:07.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.296+0000 7fb75b200640 1 -- 172.21.15.6:0/4267015584 shutdown_connections 2024-09-10T20:57:07.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.296+0000 7fb75b200640 1 -- 172.21.15.6:0/4267015584 wait complete. 2024-09-10T20:57:07.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.298+0000 7fb75b200640 1 Processor -- start 2024-09-10T20:57:07.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.298+0000 7fb75b200640 1 -- start start 2024-09-10T20:57:07.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.299+0000 7fb75b200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb75c0cf380 0x7fb75c0cd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:07.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.299+0000 7fb75b200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb75c0d2a60 0x7fb75c1f8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:07.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.299+0000 7fb75b200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb75c15dc90 0x7fb75c0b6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:07.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.299+0000 7fb75b200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb75c162200 con 0x7fb75c0cf380 2024-09-10T20:57:07.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.299+0000 7fb75b200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb75c162080 con 0x7fb75c0d2a60 2024-09-10T20:57:07.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.299+0000 7fb75b200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb75c0b3350 con 0x7fb75c15dc90 2024-09-10T20:57:07.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.299+0000 7fb759e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb75c0cf380 0x7fb75c0cd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:07.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.299+0000 7fb759e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb75c0cf380 0x7fb75c0cd5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35312/0 (socket says 172.21.15.6:35312) 2024-09-10T20:57:07.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.299+0000 7fb759e00640 1 -- 172.21.15.6:0/2441960736 learned_addr learned my addr 172.21.15.6:0/2441960736 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:07.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.299+0000 7fb751400640 1 --2- 172.21.15.6:0/2441960736 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb75c0d2a60 0x7fb75c1f8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:07.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.299+0000 7fb75a800640 1 --2- 172.21.15.6:0/2441960736 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb75c15dc90 0x7fb75c0b6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:07.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.299+0000 7fb759e00640 1 -- 172.21.15.6:0/2441960736 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb75c15dc90 msgr2=0x7fb75c0b6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:07.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.299+0000 7fb759e00640 1 --2- 172.21.15.6:0/2441960736 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb75c15dc90 0x7fb75c0b6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:07.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.299+0000 7fb759e00640 1 -- 172.21.15.6:0/2441960736 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb75c0d2a60 msgr2=0x7fb75c1f8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:07.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.299+0000 7fb759e00640 1 --2- 172.21.15.6:0/2441960736 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb75c0d2a60 0x7fb75c1f8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:07.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.299+0000 7fb759e00640 1 -- 172.21.15.6:0/2441960736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb75c1f4950 con 0x7fb75c0cf380 2024-09-10T20:57:07.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.300+0000 7fb759e00640 1 --2- 172.21.15.6:0/2441960736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb75c0cf380 0x7fb75c0cd5b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb74c00b420 tx=0x7fb74c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:07.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.300+0000 7fb752a00640 1 -- 172.21.15.6:0/2441960736 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb74c011830 con 0x7fb75c0cf380 2024-09-10T20:57:07.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.300+0000 7fb752a00640 1 -- 172.21.15.6:0/2441960736 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb74c016070 con 0x7fb75c0cf380 2024-09-10T20:57:07.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.300+0000 7fb75b200640 1 -- 172.21.15.6:0/2441960736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb75c0cdfa0 con 0x7fb75c0cf380 2024-09-10T20:57:07.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.300+0000 7fb752a00640 1 -- 172.21.15.6:0/2441960736 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb74c011d60 con 0x7fb75c0cf380 2024-09-10T20:57:07.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.300+0000 7fb75b200640 1 -- 172.21.15.6:0/2441960736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb75c1f4ef0 con 0x7fb75c0cf380 2024-09-10T20:57:07.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.301+0000 7fb75b200640 1 -- 172.21.15.6:0/2441960736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb75c0d2520 con 0x7fb75c0cf380 2024-09-10T20:57:07.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.302+0000 7fb752a00640 1 -- 172.21.15.6:0/2441960736 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb74c01b460 con 0x7fb75c0cf380 2024-09-10T20:57:07.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.303+0000 7fb752a00640 1 --2- 172.21.15.6:0/2441960736 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb738077f70 0x7fb73807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:07.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.303+0000 7fb752a00640 1 -- 172.21.15.6:0/2441960736 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6190+0+0 (secure 0 0 0) 0x7fb74c0999f0 con 0x7fb75c0cf380 2024-09-10T20:57:07.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.304+0000 7fb751400640 1 --2- 172.21.15.6:0/2441960736 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb738077f70 0x7fb73807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:07.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.304+0000 7fb751400640 1 --2- 172.21.15.6:0/2441960736 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb738077f70 0x7fb73807a430 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb75c0cd370 tx=0x7fb74400b390 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:07.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.308+0000 7fb752a00640 1 -- 172.21.15.6:0/2441960736 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb74c020020 con 0x7fb75c0cf380 2024-09-10T20:57:07.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:07.540+0000 7fb75b200640 1 -- 172.21.15.6:0/2441960736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fb75c06e840 con 0x7fb75c0cf380 2024-09-10T20:57:08.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.195+0000 7fb752a00640 1 -- 172.21.15.6:0/2441960736 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) ==== 104+0+0 (secure 0 0 0) 0x7fb74c062300 con 0x7fb75c0cf380 2024-09-10T20:57:08.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.198+0000 7fb75b200640 1 -- 172.21.15.6:0/2441960736 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb738077f70 msgr2=0x7fb73807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:08.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.198+0000 7fb75b200640 1 --2- 172.21.15.6:0/2441960736 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb738077f70 0x7fb73807a430 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb75c0cd370 tx=0x7fb74400b390 comp rx=0 tx=0).stop 2024-09-10T20:57:08.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.198+0000 7fb75b200640 1 -- 172.21.15.6:0/2441960736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb75c0cf380 msgr2=0x7fb75c0cd5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:08.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.198+0000 7fb75b200640 1 --2- 172.21.15.6:0/2441960736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb75c0cf380 0x7fb75c0cd5b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb74c00b420 tx=0x7fb74c00b8e0 comp rx=0 tx=0).stop 2024-09-10T20:57:08.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.198+0000 7fb75b200640 1 -- 172.21.15.6:0/2441960736 shutdown_connections 2024-09-10T20:57:08.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.198+0000 7fb75b200640 1 --2- 172.21.15.6:0/2441960736 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb738077f70 0x7fb73807a430 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:08.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.198+0000 7fb75b200640 1 --2- 172.21.15.6:0/2441960736 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb75c15dc90 0x7fb75c0b6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:08.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.198+0000 7fb75b200640 1 --2- 172.21.15.6:0/2441960736 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb75c0d2a60 0x7fb75c1f8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:08.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.198+0000 7fb75b200640 1 --2- 172.21.15.6:0/2441960736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb75c0cf380 0x7fb75c0cd5b0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:08.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.198+0000 7fb75b200640 1 -- 172.21.15.6:0/2441960736 >> 172.21.15.6:0/2441960736 conn(0x7fb75c09d0a0 msgr2=0x7fb75c06d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:08.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.198+0000 7fb75b200640 1 -- 172.21.15.6:0/2441960736 shutdown_connections 2024-09-10T20:57:08.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.198+0000 7fb75b200640 1 -- 172.21.15.6:0/2441960736 wait complete. 2024-09-10T20:57:08.221 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T20:57:08.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.387+0000 7fbecf200640 1 -- 172.21.15.6:0/4013035450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbed0073550 msgr2=0x7fbed0168aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:08.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.387+0000 7fbecf200640 1 --2- 172.21.15.6:0/4013035450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbed0073550 0x7fbed0168aa0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fbec8005fd0 tx=0x7fbec802a940 comp rx=0 tx=0).stop 2024-09-10T20:57:08.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.387+0000 7fbecf200640 1 -- 172.21.15.6:0/4013035450 shutdown_connections 2024-09-10T20:57:08.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.387+0000 7fbecf200640 1 --2- 172.21.15.6:0/4013035450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbed0073550 0x7fbed0168aa0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:08.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.387+0000 7fbecf200640 1 -- 172.21.15.6:0/4013035450 >> 172.21.15.6:0/4013035450 conn(0x7fbed006cb70 msgr2=0x7fbed006cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:08.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.387+0000 7fbecf200640 1 -- 172.21.15.6:0/4013035450 shutdown_connections 2024-09-10T20:57:08.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.387+0000 7fbecf200640 1 -- 172.21.15.6:0/4013035450 wait complete. 2024-09-10T20:57:08.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.389+0000 7fbecf200640 1 Processor -- start 2024-09-10T20:57:08.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.389+0000 7fbecf200640 1 -- start start 2024-09-10T20:57:08.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.390+0000 7fbecf200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbed006f5f0 0x7fbed0157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:08.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.390+0000 7fbecf200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbed0073550 0x7fbed01578c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:08.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.390+0000 7fbecf200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbed0154cf0 0x7fbed013ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:08.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.390+0000 7fbecf200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbed0169370 con 0x7fbed0154cf0 2024-09-10T20:57:08.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.390+0000 7fbecf200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbed01691f0 con 0x7fbed006f5f0 2024-09-10T20:57:08.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.390+0000 7fbecf200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fbed01694f0 con 0x7fbed0073550 2024-09-10T20:57:08.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.390+0000 7fbece800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbed0154cf0 0x7fbed013ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:08.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.390+0000 7fbece800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbed0154cf0 0x7fbed013ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47330/0 (socket says 172.21.15.6:47330) 2024-09-10T20:57:08.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.390+0000 7fbece800640 1 -- 172.21.15.6:0/4006520753 learned_addr learned my addr 172.21.15.6:0/4006520753 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:08.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.390+0000 7fbecde00640 1 --2- 172.21.15.6:0/4006520753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbed006f5f0 0x7fbed0157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:08.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.390+0000 7fbec5400640 1 --2- 172.21.15.6:0/4006520753 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbed0073550 0x7fbed01578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:08.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.390+0000 7fbece800640 1 -- 172.21.15.6:0/4006520753 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbed0073550 msgr2=0x7fbed01578c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:08.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.390+0000 7fbece800640 1 --2- 172.21.15.6:0/4006520753 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbed0073550 0x7fbed01578c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:08.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.390+0000 7fbece800640 1 -- 172.21.15.6:0/4006520753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbed006f5f0 msgr2=0x7fbed0157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:08.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.390+0000 7fbece800640 1 --2- 172.21.15.6:0/4006520753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbed006f5f0 0x7fbed0157380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:08.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.391+0000 7fbece800640 1 -- 172.21.15.6:0/4006520753 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbed013f7c0 con 0x7fbed0154cf0 2024-09-10T20:57:08.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.391+0000 7fbece800640 1 --2- 172.21.15.6:0/4006520753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbed0154cf0 0x7fbed013ff10 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fbec8006010 tx=0x7fbec8031e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:08.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.391+0000 7fbec6a00640 1 -- 172.21.15.6:0/4006520753 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec8004240 con 0x7fbed0154cf0 2024-09-10T20:57:08.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.391+0000 7fbec6a00640 1 -- 172.21.15.6:0/4006520753 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbec80043e0 con 0x7fbed0154cf0 2024-09-10T20:57:08.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.391+0000 7fbec6a00640 1 -- 172.21.15.6:0/4006520753 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec8004830 con 0x7fbed0154cf0 2024-09-10T20:57:08.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.391+0000 7fbecf200640 1 -- 172.21.15.6:0/4006520753 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbed013faa0 con 0x7fbed0154cf0 2024-09-10T20:57:08.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.391+0000 7fbecf200640 1 -- 172.21.15.6:0/4006520753 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbed0140450 con 0x7fbed0154cf0 2024-09-10T20:57:08.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.392+0000 7fbecf200640 1 -- 172.21.15.6:0/4006520753 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbed013fce0 con 0x7fbed0154cf0 2024-09-10T20:57:08.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.393+0000 7fbec6a00640 1 -- 172.21.15.6:0/4006520753 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fbec802f070 con 0x7fbed0154cf0 2024-09-10T20:57:08.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.394+0000 7fbec6a00640 1 --2- 172.21.15.6:0/4006520753 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbeac077f70 0x7fbeac07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:08.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.395+0000 7fbec6a00640 1 -- 172.21.15.6:0/4006520753 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6190+0+0 (secure 0 0 0) 0x7fbec80bb760 con 0x7fbed0154cf0 2024-09-10T20:57:08.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.395+0000 7fbecde00640 1 --2- 172.21.15.6:0/4006520753 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbeac077f70 0x7fbeac07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:08.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.396+0000 7fbecde00640 1 --2- 172.21.15.6:0/4006520753 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbeac077f70 0x7fbeac07a430 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbec0000f60 tx=0x7fbec0009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:08.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.399+0000 7fbec6a00640 1 -- 172.21.15.6:0/4006520753 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fbed013fce0 con 0x7fbed0154cf0 2024-09-10T20:57:08.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:08.592+0000 7fbecf200640 1 -- 172.21.15.6:0/4006520753 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbed006fa40 con 0x7fbed0154cf0 2024-09-10T20:57:08.674 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T20:57:08.678 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T20:57:09.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.200+0000 7fbec6a00640 1 -- 172.21.15.6:0/4006520753 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v40) ==== 181+0+0 (secure 0 0 0) 0x7fbec8084070 con 0x7fbed0154cf0 2024-09-10T20:57:09.204 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2024-09-10T20:57:09.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.204+0000 7fbecf200640 1 -- 172.21.15.6:0/4006520753 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbeac077f70 msgr2=0x7fbeac07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:09.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.204+0000 7fbecf200640 1 --2- 172.21.15.6:0/4006520753 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbeac077f70 0x7fbeac07a430 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbec0000f60 tx=0x7fbec0009040 comp rx=0 tx=0).stop 2024-09-10T20:57:09.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.204+0000 7fbecf200640 1 -- 172.21.15.6:0/4006520753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbed0154cf0 msgr2=0x7fbed013ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:09.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.204+0000 7fbecf200640 1 --2- 172.21.15.6:0/4006520753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbed0154cf0 0x7fbed013ff10 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fbec8006010 tx=0x7fbec8031e20 comp rx=0 tx=0).stop 2024-09-10T20:57:09.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.204+0000 7fbecf200640 1 -- 172.21.15.6:0/4006520753 shutdown_connections 2024-09-10T20:57:09.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.204+0000 7fbecf200640 1 --2- 172.21.15.6:0/4006520753 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbeac077f70 0x7fbeac07a430 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:09.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.204+0000 7fbecf200640 1 --2- 172.21.15.6:0/4006520753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbed0154cf0 0x7fbed013ff10 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:09.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.204+0000 7fbecf200640 1 --2- 172.21.15.6:0/4006520753 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbed0073550 0x7fbed01578c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:09.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.204+0000 7fbecf200640 1 --2- 172.21.15.6:0/4006520753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbed006f5f0 0x7fbed0157380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:09.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.204+0000 7fbecf200640 1 -- 172.21.15.6:0/4006520753 >> 172.21.15.6:0/4006520753 conn(0x7fbed006cb70 msgr2=0x7fbed015f950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:09.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.205+0000 7fbecf200640 1 -- 172.21.15.6:0/4006520753 shutdown_connections 2024-09-10T20:57:09.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.205+0000 7fbecf200640 1 -- 172.21.15.6:0/4006520753 wait complete. 2024-09-10T20:57:09.229 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T20:57:09.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.391+0000 7faa12600640 1 -- 172.21.15.6:0/1753350664 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa0c06fe40 msgr2=0x7faa0c070220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:09.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.391+0000 7faa12600640 1 --2- 172.21.15.6:0/1753350664 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa0c06fe40 0x7faa0c070220 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc009830 tx=0x7fa9fc02a510 comp rx=0 tx=0).stop 2024-09-10T20:57:09.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.391+0000 7faa12600640 1 -- 172.21.15.6:0/1753350664 shutdown_connections 2024-09-10T20:57:09.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.391+0000 7faa12600640 1 --2- 172.21.15.6:0/1753350664 >> v2:172.21.15.150:3300/0 conn(0x7faa0c15bce0 0x7faa0c15cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:09.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.391+0000 7faa12600640 1 --2- 172.21.15.6:0/1753350664 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa0c06fe40 0x7faa0c070220 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:09.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.391+0000 7faa12600640 1 -- 172.21.15.6:0/1753350664 >> 172.21.15.6:0/1753350664 conn(0x7faa0c0cfa20 msgr2=0x7faa0c0cfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:09.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.392+0000 7faa12600640 1 -- 172.21.15.6:0/1753350664 shutdown_connections 2024-09-10T20:57:09.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.392+0000 7faa12600640 1 -- 172.21.15.6:0/1753350664 wait complete. 2024-09-10T20:57:09.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.393+0000 7faa12600640 1 Processor -- start 2024-09-10T20:57:09.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.393+0000 7faa12600640 1 -- start start 2024-09-10T20:57:09.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.394+0000 7faa12600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa0c06fe40 0x7faa0c151db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:09.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.394+0000 7faa12600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa0c072560 0x7faa0c0b3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:09.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.394+0000 7faa12600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa0c15bce0 0x7faa0c0b3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:09.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.394+0000 7faa12600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c073260 con 0x7faa0c15bce0 2024-09-10T20:57:09.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.394+0000 7faa12600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c0730e0 con 0x7faa0c072560 2024-09-10T20:57:09.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.394+0000 7faa12600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7faa0c1f7d40 con 0x7faa0c06fe40 2024-09-10T20:57:09.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.395+0000 7faa0be00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa0c15bce0 0x7faa0c0b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:09.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.395+0000 7faa0b400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa0c06fe40 0x7faa0c151db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:09.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.395+0000 7faa0b400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa0c06fe40 0x7faa0c151db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.6:42112/0 (socket says 172.21.15.6:42112) 2024-09-10T20:57:09.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.395+0000 7faa02a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa0c072560 0x7faa0c0b3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:09.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.395+0000 7faa0be00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa0c15bce0 0x7faa0c0b3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47338/0 (socket says 172.21.15.6:47338) 2024-09-10T20:57:09.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.395+0000 7faa0b400640 1 -- 172.21.15.6:0/221960034 learned_addr learned my addr 172.21.15.6:0/221960034 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:09.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.395+0000 7faa0b400640 1 -- 172.21.15.6:0/221960034 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa0c072560 msgr2=0x7faa0c0b3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:09.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.395+0000 7faa0b400640 1 --2- 172.21.15.6:0/221960034 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa0c072560 0x7faa0c0b3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:09.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.395+0000 7faa0b400640 1 -- 172.21.15.6:0/221960034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa0c15bce0 msgr2=0x7faa0c0b3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:09.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.395+0000 7faa0b400640 1 --2- 172.21.15.6:0/221960034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa0c15bce0 0x7faa0c0b3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:09.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.395+0000 7faa0b400640 1 -- 172.21.15.6:0/221960034 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa0c1f7f90 con 0x7faa0c06fe40 2024-09-10T20:57:09.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.396+0000 7faa0b400640 1 --2- 172.21.15.6:0/221960034 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa0c06fe40 0x7faa0c151db0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc02ab00 tx=0x7fa9fc032c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:09.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.396+0000 7faa03e00640 1 -- 172.21.15.6:0/221960034 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc040070 con 0x7faa0c06fe40 2024-09-10T20:57:09.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.396+0000 7faa03e00640 1 -- 172.21.15.6:0/221960034 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa9fc005310 con 0x7faa0c06fe40 2024-09-10T20:57:09.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.396+0000 7faa03e00640 1 -- 172.21.15.6:0/221960034 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc005c90 con 0x7faa0c06fe40 2024-09-10T20:57:09.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.396+0000 7faa12600640 1 -- 172.21.15.6:0/221960034 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa0c1f8270 con 0x7faa0c06fe40 2024-09-10T20:57:09.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.396+0000 7faa12600640 1 -- 172.21.15.6:0/221960034 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7faa0c1f8830 con 0x7faa0c06fe40 2024-09-10T20:57:09.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.397+0000 7faa12600640 1 -- 172.21.15.6:0/221960034 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa0c0cb550 con 0x7faa0c06fe40 2024-09-10T20:57:09.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.398+0000 7faa03e00640 1 -- 172.21.15.6:0/221960034 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa9fc0049b0 con 0x7faa0c06fe40 2024-09-10T20:57:09.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.399+0000 7faa03e00640 1 --2- 172.21.15.6:0/221960034 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa9e8077f70 0x7fa9e807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:09.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.399+0000 7faa03e00640 1 -- 172.21.15.6:0/221960034 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(40..40 src has 1..40) ==== 5752+0+0 (secure 0 0 0) 0x7fa9fc0bb130 con 0x7faa0c06fe40 2024-09-10T20:57:09.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.399+0000 7faa02a00640 1 --2- 172.21.15.6:0/221960034 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa9e8077f70 0x7fa9e807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:09.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.400+0000 7faa02a00640 1 --2- 172.21.15.6:0/221960034 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa9e8077f70 0x7fa9e807a430 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7faa0c1f7ca0 tx=0x7fa9f4005f90 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:09.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.404+0000 7faa03e00640 1 -- 172.21.15.6:0/221960034 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fa9fc0835a0 con 0x7faa0c06fe40 2024-09-10T20:57:09.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:09.597+0000 7faa12600640 1 -- 172.21.15.6:0/221960034 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7faa0c0b44c0 con 0x7faa0c06fe40 2024-09-10T20:57:10.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.209+0000 7faa03e00640 1 -- 172.21.15.6:0/221960034 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v41) ==== 169+0+0 (secure 0 0 0) 0x7fa9fc087fd0 con 0x7faa0c06fe40 2024-09-10T20:57:10.214 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2024-09-10T20:57:10.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.212+0000 7faa12600640 1 -- 172.21.15.6:0/221960034 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa9e8077f70 msgr2=0x7fa9e807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:10.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.212+0000 7faa12600640 1 --2- 172.21.15.6:0/221960034 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa9e8077f70 0x7fa9e807a430 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7faa0c1f7ca0 tx=0x7fa9f4005f90 comp rx=0 tx=0).stop 2024-09-10T20:57:10.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.212+0000 7faa12600640 1 -- 172.21.15.6:0/221960034 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa0c06fe40 msgr2=0x7faa0c151db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:10.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.212+0000 7faa12600640 1 --2- 172.21.15.6:0/221960034 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa0c06fe40 0x7faa0c151db0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc02ab00 tx=0x7fa9fc032c10 comp rx=0 tx=0).stop 2024-09-10T20:57:10.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.213+0000 7faa12600640 1 -- 172.21.15.6:0/221960034 shutdown_connections 2024-09-10T20:57:10.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.213+0000 7faa12600640 1 --2- 172.21.15.6:0/221960034 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa9e8077f70 0x7fa9e807a430 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:10.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.213+0000 7faa12600640 1 --2- 172.21.15.6:0/221960034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa0c15bce0 0x7faa0c0b3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:10.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.213+0000 7faa12600640 1 --2- 172.21.15.6:0/221960034 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa0c072560 0x7faa0c0b3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:10.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.213+0000 7faa12600640 1 --2- 172.21.15.6:0/221960034 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa0c06fe40 0x7faa0c151db0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:10.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.213+0000 7faa12600640 1 -- 172.21.15.6:0/221960034 >> 172.21.15.6:0/221960034 conn(0x7faa0c0cfa20 msgr2=0x7faa0c0b4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:10.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.213+0000 7faa12600640 1 -- 172.21.15.6:0/221960034 shutdown_connections 2024-09-10T20:57:10.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.213+0000 7faa12600640 1 -- 172.21.15.6:0/221960034 wait complete. 2024-09-10T20:57:10.235 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm data_new data_new --yes-i-really-really-mean-it 2024-09-10T20:57:10.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.400+0000 7f93e6600640 1 -- 172.21.15.6:0/2298443031 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93e00aeb90 msgr2=0x7f93e015ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:10.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.400+0000 7f93e6600640 1 --2- 172.21.15.6:0/2298443031 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93e00aeb90 0x7f93e015ca80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f93d0005fd0 tx=0x7f93d002a4d0 comp rx=0 tx=0).stop 2024-09-10T20:57:10.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.400+0000 7f93e6600640 1 -- 172.21.15.6:0/2298443031 shutdown_connections 2024-09-10T20:57:10.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.400+0000 7f93e6600640 1 --2- 172.21.15.6:0/2298443031 >> v2:172.21.15.150:3300/0 conn(0x7f93e006f4b0 0x7f93e00b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:10.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.400+0000 7f93e6600640 1 --2- 172.21.15.6:0/2298443031 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93e00aeb90 0x7f93e015ca80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:10.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.400+0000 7f93e6600640 1 -- 172.21.15.6:0/2298443031 >> 172.21.15.6:0/2298443031 conn(0x7f93e006cb70 msgr2=0x7f93e006cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:10.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.400+0000 7f93e6600640 1 -- 172.21.15.6:0/2298443031 shutdown_connections 2024-09-10T20:57:10.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.400+0000 7f93e6600640 1 -- 172.21.15.6:0/2298443031 wait complete. 2024-09-10T20:57:10.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.402+0000 7f93e6600640 1 Processor -- start 2024-09-10T20:57:10.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.402+0000 7f93e6600640 1 -- start start 2024-09-10T20:57:10.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.403+0000 7f93e6600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93e006f4b0 0x7f93e014cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:10.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.403+0000 7f93e6600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e00aeb90 0x7f93e0146280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:10.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.403+0000 7f93e6600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93e00cc070 0x7f93e01f5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:10.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.403+0000 7f93e6600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f93e00b3c90 con 0x7f93e00aeb90 2024-09-10T20:57:10.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.403+0000 7f93e6600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f93e00af230 con 0x7f93e00cc070 2024-09-10T20:57:10.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.403+0000 7f93e6600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f93e00b3e10 con 0x7f93e006f4b0 2024-09-10T20:57:10.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.404+0000 7f93d7e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e00aeb90 0x7f93e0146280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:10.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.404+0000 7f93e5c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93e00cc070 0x7f93e01f5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:10.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.404+0000 7f93d7e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e00aeb90 0x7f93e0146280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47350/0 (socket says 172.21.15.6:47350) 2024-09-10T20:57:10.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.404+0000 7f93e5200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93e006f4b0 0x7f93e014cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:10.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.404+0000 7f93d7e00640 1 -- 172.21.15.6:0/3819341331 learned_addr learned my addr 172.21.15.6:0/3819341331 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:10.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.404+0000 7f93e5c00640 1 -- 172.21.15.6:0/3819341331 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93e006f4b0 msgr2=0x7f93e014cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:10.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.404+0000 7f93e5c00640 1 --2- 172.21.15.6:0/3819341331 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93e006f4b0 0x7f93e014cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:10.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.404+0000 7f93e5c00640 1 -- 172.21.15.6:0/3819341331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e00aeb90 msgr2=0x7f93e0146280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:10.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.404+0000 7f93e5c00640 1 --2- 172.21.15.6:0/3819341331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e00aeb90 0x7f93e0146280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:10.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.404+0000 7f93e5c00640 1 -- 172.21.15.6:0/3819341331 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93e01f66c0 con 0x7f93e00cc070 2024-09-10T20:57:10.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.404+0000 7f93d7e00640 1 --2- 172.21.15.6:0/3819341331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e00aeb90 0x7f93e0146280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:57:10.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.404+0000 7f93e5c00640 1 --2- 172.21.15.6:0/3819341331 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93e00cc070 0x7f93e01f5ce0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f93d8005fd0 tx=0x7f93d800ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:10.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.405+0000 7f93dd600640 1 -- 172.21.15.6:0/3819341331 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d800cdf0 con 0x7f93e00cc070 2024-09-10T20:57:10.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.405+0000 7f93dd600640 1 -- 172.21.15.6:0/3819341331 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f93d8004c10 con 0x7f93e00cc070 2024-09-10T20:57:10.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.405+0000 7f93dd600640 1 -- 172.21.15.6:0/3819341331 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d8005020 con 0x7f93e00cc070 2024-09-10T20:57:10.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.405+0000 7f93e6600640 1 -- 172.21.15.6:0/3819341331 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93e01f69a0 con 0x7f93e00cc070 2024-09-10T20:57:10.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.405+0000 7f93e6600640 1 -- 172.21.15.6:0/3819341331 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93e014c5a0 con 0x7f93e00cc070 2024-09-10T20:57:10.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.406+0000 7f93e6600640 1 -- 172.21.15.6:0/3819341331 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93e01f6be0 con 0x7f93e00cc070 2024-09-10T20:57:10.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.407+0000 7f93dd600640 1 -- 172.21.15.6:0/3819341331 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f93d80051c0 con 0x7f93e00cc070 2024-09-10T20:57:10.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.408+0000 7f93dd600640 1 --2- 172.21.15.6:0/3819341331 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f93bc077f70 0x7f93bc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:10.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.408+0000 7f93dd600640 1 -- 172.21.15.6:0/3819341331 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5338+0+0 (secure 0 0 0) 0x7f93d809a940 con 0x7f93e00cc070 2024-09-10T20:57:10.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.408+0000 7f93e5200640 1 --2- 172.21.15.6:0/3819341331 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f93bc077f70 0x7f93bc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:10.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.409+0000 7f93e5200640 1 --2- 172.21.15.6:0/3819341331 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f93bc077f70 0x7f93bc07a430 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f93d0033000 tx=0x7f93d0004730 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:10.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.415+0000 7f93dd600640 1 -- 172.21.15.6:0/3819341331 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f93e01f6be0 con 0x7f93e00cc070 2024-09-10T20:57:10.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:10.615+0000 7f93e6600640 1 -- 172.21.15.6:0/3819341331 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "data_new", "pool2": "data_new", "yes_i_really_really_mean_it": true} v 0) -- 0x7f93e00b3750 con 0x7f93e00cc070 2024-09-10T20:57:11.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.220+0000 7f93dd600640 1 -- 172.21.15.6:0/3819341331 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "data_new", "pool2": "data_new", "yes_i_really_really_mean_it": true}]=0 pool 'data_new' removed v42) ==== 160+0+0 (secure 0 0 0) 0x7f93d8062ec0 con 0x7f93e00cc070 2024-09-10T20:57:11.225 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'data_new' removed 2024-09-10T20:57:11.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.223+0000 7f93e6600640 1 -- 172.21.15.6:0/3819341331 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f93bc077f70 msgr2=0x7f93bc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:11.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.223+0000 7f93e6600640 1 --2- 172.21.15.6:0/3819341331 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f93bc077f70 0x7f93bc07a430 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f93d0033000 tx=0x7f93d0004730 comp rx=0 tx=0).stop 2024-09-10T20:57:11.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.223+0000 7f93e6600640 1 -- 172.21.15.6:0/3819341331 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93e00cc070 msgr2=0x7f93e01f5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:11.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.223+0000 7f93e6600640 1 --2- 172.21.15.6:0/3819341331 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93e00cc070 0x7f93e01f5ce0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f93d8005fd0 tx=0x7f93d800ef10 comp rx=0 tx=0).stop 2024-09-10T20:57:11.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.224+0000 7f93e6600640 1 -- 172.21.15.6:0/3819341331 shutdown_connections 2024-09-10T20:57:11.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.224+0000 7f93e6600640 1 --2- 172.21.15.6:0/3819341331 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f93bc077f70 0x7f93bc07a430 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:11.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.224+0000 7f93e6600640 1 --2- 172.21.15.6:0/3819341331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e00aeb90 0x7f93e0146280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:11.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.224+0000 7f93e6600640 1 --2- 172.21.15.6:0/3819341331 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93e00cc070 0x7f93e01f5ce0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:11.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.224+0000 7f93e6600640 1 --2- 172.21.15.6:0/3819341331 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93e006f4b0 0x7f93e014cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:11.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.224+0000 7f93e6600640 1 -- 172.21.15.6:0/3819341331 >> 172.21.15.6:0/3819341331 conn(0x7f93e006cb70 msgr2=0x7f93e00b0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:11.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.224+0000 7f93e6600640 1 -- 172.21.15.6:0/3819341331 shutdown_connections 2024-09-10T20:57:11.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.224+0000 7f93e6600640 1 -- 172.21.15.6:0/3819341331 wait complete. 2024-09-10T20:57:11.244 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-10T20:57:11.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.403+0000 7f2efea00640 1 -- 172.21.15.6:0/3707958496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ef815e090 msgr2=0x7f2ef80d0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:11.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.403+0000 7f2efea00640 1 --2- 172.21.15.6:0/3707958496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ef815e090 0x7f2ef80d0f60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4009830 tx=0x7f2ee402a510 comp rx=0 tx=0).stop 2024-09-10T20:57:11.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.403+0000 7f2efea00640 1 -- 172.21.15.6:0/3707958496 shutdown_connections 2024-09-10T20:57:11.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.403+0000 7f2efea00640 1 --2- 172.21.15.6:0/3707958496 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ef80cf7a0 0x7f2ef81619c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:11.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.403+0000 7f2efea00640 1 --2- 172.21.15.6:0/3707958496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ef815e090 0x7f2ef80d0f60 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:11.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.403+0000 7f2efea00640 1 -- 172.21.15.6:0/3707958496 >> 172.21.15.6:0/3707958496 conn(0x7f2ef809d100 msgr2=0x7f2ef80d3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:11.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.403+0000 7f2efea00640 1 -- 172.21.15.6:0/3707958496 shutdown_connections 2024-09-10T20:57:11.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.403+0000 7f2efea00640 1 -- 172.21.15.6:0/3707958496 wait complete. 2024-09-10T20:57:11.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.405+0000 7f2efea00640 1 Processor -- start 2024-09-10T20:57:11.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.405+0000 7f2efea00640 1 -- start start 2024-09-10T20:57:11.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.406+0000 7f2efea00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ef80cf7a0 0x7f2ef81521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:11.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.406+0000 7f2efea00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ef815dcb0 0x7f2ef8160530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:11.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.406+0000 7f2efea00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ef815e090 0x7f2ef8160a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:11.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.406+0000 7f2efea00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef80b6dc0 con 0x7f2ef815e090 2024-09-10T20:57:11.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.406+0000 7f2efea00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef80b6c40 con 0x7f2ef80cf7a0 2024-09-10T20:57:11.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.406+0000 7f2efea00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f2ef80b6f40 con 0x7f2ef815dcb0 2024-09-10T20:57:11.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.406+0000 7f2efe000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ef815e090 0x7f2ef8160a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:11.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.406+0000 7f2efe000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ef815e090 0x7f2ef8160a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47352/0 (socket says 172.21.15.6:47352) 2024-09-10T20:57:11.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.406+0000 7f2efe000640 1 -- 172.21.15.6:0/116502878 learned_addr learned my addr 172.21.15.6:0/116502878 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:11.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.406+0000 7f2efd600640 1 --2- 172.21.15.6:0/116502878 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ef80cf7a0 0x7f2ef81521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:11.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.406+0000 7f2efcc00640 1 --2- 172.21.15.6:0/116502878 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ef815dcb0 0x7f2ef8160530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:11.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.406+0000 7f2efe000640 1 -- 172.21.15.6:0/116502878 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ef815dcb0 msgr2=0x7f2ef8160530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:11.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.406+0000 7f2efe000640 1 --2- 172.21.15.6:0/116502878 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ef815dcb0 0x7f2ef8160530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:11.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.406+0000 7f2efe000640 1 -- 172.21.15.6:0/116502878 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ef80cf7a0 msgr2=0x7f2ef81521e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:11.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.406+0000 7f2efe000640 1 --2- 172.21.15.6:0/116502878 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ef80cf7a0 0x7f2ef81521e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:11.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.406+0000 7f2efe000640 1 -- 172.21.15.6:0/116502878 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ef80c8630 con 0x7f2ef815e090 2024-09-10T20:57:11.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.407+0000 7f2efe000640 1 --2- 172.21.15.6:0/116502878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ef815e090 0x7f2ef8160a70 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2ef000eb10 tx=0x7f2ef000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:11.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.407+0000 7f2ef5600640 1 -- 172.21.15.6:0/116502878 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef0004b20 con 0x7f2ef815e090 2024-09-10T20:57:11.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.407+0000 7f2ef5600640 1 -- 172.21.15.6:0/116502878 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ef0004ce0 con 0x7f2ef815e090 2024-09-10T20:57:11.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.407+0000 7f2efea00640 1 -- 172.21.15.6:0/116502878 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ef815e510 con 0x7f2ef815e090 2024-09-10T20:57:11.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.407+0000 7f2ef5600640 1 -- 172.21.15.6:0/116502878 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef0005280 con 0x7f2ef815e090 2024-09-10T20:57:11.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.407+0000 7f2efea00640 1 -- 172.21.15.6:0/116502878 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ef8152720 con 0x7f2ef815e090 2024-09-10T20:57:11.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.408+0000 7f2efea00640 1 -- 172.21.15.6:0/116502878 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ef81619c0 con 0x7f2ef815e090 2024-09-10T20:57:11.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.409+0000 7f2ef5600640 1 -- 172.21.15.6:0/116502878 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2ef0005420 con 0x7f2ef815e090 2024-09-10T20:57:11.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.410+0000 7f2ef5600640 1 --2- 172.21.15.6:0/116502878 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2ed8077f70 0x7f2ed807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:11.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.410+0000 7f2ef5600640 1 -- 172.21.15.6:0/116502878 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4943+0+0 (secure 0 0 0) 0x7f2ef009a720 con 0x7f2ef815e090 2024-09-10T20:57:11.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.411+0000 7f2efd600640 1 --2- 172.21.15.6:0/116502878 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2ed8077f70 0x7f2ed807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:11.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.412+0000 7f2efd600640 1 --2- 172.21.15.6:0/116502878 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2ed8077f70 0x7f2ed807a430 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2ef815c8e0 tx=0x7f2eec007e30 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:11.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.415+0000 7f2ef5600640 1 -- 172.21.15.6:0/116502878 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2ef0062e30 con 0x7f2ef815e090 2024-09-10T20:57:11.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.614+0000 7f2efea00640 1 -- 172.21.15.6:0/116502878 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f2ef8069d10 con 0x7f2ef815e090 2024-09-10T20:57:11.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.618+0000 7f2ef5600640 1 -- 172.21.15.6:0/116502878 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v31) ==== 71+0+0 (secure 0 0 0) 0x7f2ef0067860 con 0x7f2ef815e090 2024-09-10T20:57:11.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.621+0000 7f2efea00640 1 -- 172.21.15.6:0/116502878 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2ed8077f70 msgr2=0x7f2ed807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:11.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.621+0000 7f2efea00640 1 --2- 172.21.15.6:0/116502878 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2ed8077f70 0x7f2ed807a430 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2ef815c8e0 tx=0x7f2eec007e30 comp rx=0 tx=0).stop 2024-09-10T20:57:11.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.621+0000 7f2efea00640 1 -- 172.21.15.6:0/116502878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ef815e090 msgr2=0x7f2ef8160a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:11.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.621+0000 7f2efea00640 1 --2- 172.21.15.6:0/116502878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ef815e090 0x7f2ef8160a70 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2ef000eb10 tx=0x7f2ef000c2d0 comp rx=0 tx=0).stop 2024-09-10T20:57:11.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.621+0000 7f2efea00640 1 -- 172.21.15.6:0/116502878 shutdown_connections 2024-09-10T20:57:11.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.621+0000 7f2efea00640 1 --2- 172.21.15.6:0/116502878 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2ed8077f70 0x7f2ed807a430 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:11.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.621+0000 7f2efea00640 1 --2- 172.21.15.6:0/116502878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ef815e090 0x7f2ef8160a70 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:11.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.621+0000 7f2efea00640 1 --2- 172.21.15.6:0/116502878 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ef815dcb0 0x7f2ef8160530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:11.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.621+0000 7f2efea00640 1 --2- 172.21.15.6:0/116502878 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ef80cf7a0 0x7f2ef81521e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:11.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.621+0000 7f2efea00640 1 -- 172.21.15.6:0/116502878 >> 172.21.15.6:0/116502878 conn(0x7f2ef809d100 msgr2=0x7f2ef806ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:11.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.621+0000 7f2efea00640 1 -- 172.21.15.6:0/116502878 shutdown_connections 2024-09-10T20:57:11.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.621+0000 7f2efea00640 1 -- 172.21.15.6:0/116502878 wait complete. 2024-09-10T20:57:11.640 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_backtrace.TestBacktrace.test_backtrace' 2024-09-10T20:57:11.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.798+0000 7f5161c00640 1 -- 172.21.15.6:0/1942607879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f515c159670 msgr2=0x7f515c0743b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:11.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.798+0000 7f5161c00640 1 --2- 172.21.15.6:0/1942607879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f515c159670 0x7f515c0743b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f514c005fd0 tx=0x7f514c02a970 comp rx=0 tx=0).stop 2024-09-10T20:57:11.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.798+0000 7f5161c00640 1 -- 172.21.15.6:0/1942607879 shutdown_connections 2024-09-10T20:57:11.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.798+0000 7f5161c00640 1 --2- 172.21.15.6:0/1942607879 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f515c070450 0x7f515c0cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:11.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.798+0000 7f5161c00640 1 --2- 172.21.15.6:0/1942607879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f515c159670 0x7f515c0743b0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:11.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.798+0000 7f5161c00640 1 -- 172.21.15.6:0/1942607879 >> 172.21.15.6:0/1942607879 conn(0x7f515c0cfa20 msgr2=0x7f515c0cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:11.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.798+0000 7f5161c00640 1 -- 172.21.15.6:0/1942607879 shutdown_connections 2024-09-10T20:57:11.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.798+0000 7f5161c00640 1 -- 172.21.15.6:0/1942607879 wait complete. 2024-09-10T20:57:11.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.799+0000 7f5161c00640 1 Processor -- start 2024-09-10T20:57:11.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.800+0000 7f5161c00640 1 -- start start 2024-09-10T20:57:11.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.800+0000 7f5161c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f515c070450 0x7f515c1f8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:11.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.801+0000 7f5161c00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f515c159670 0x7f515c158090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:11.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.801+0000 7f5161c00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f515c15c170 0x7f515c0ad880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:11.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.801+0000 7f5161c00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f515c0b4ca0 con 0x7f515c15c170 2024-09-10T20:57:11.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.801+0000 7f5161c00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f515c0b4b20 con 0x7f515c070450 2024-09-10T20:57:11.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.801+0000 7f5161c00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f515c0b4e20 con 0x7f515c159670 2024-09-10T20:57:11.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.801+0000 7f515b400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f515c15c170 0x7f515c0ad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:11.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.801+0000 7f515b400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f515c15c170 0x7f515c0ad880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47370/0 (socket says 172.21.15.6:47370) 2024-09-10T20:57:11.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.801+0000 7f515b400640 1 -- 172.21.15.6:0/1619958383 learned_addr learned my addr 172.21.15.6:0/1619958383 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:11.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.801+0000 7f5152000640 1 --2- 172.21.15.6:0/1619958383 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f515c159670 0x7f515c158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:11.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.801+0000 7f515aa00640 1 --2- 172.21.15.6:0/1619958383 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f515c070450 0x7f515c1f8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:11.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.801+0000 7f515b400640 1 -- 172.21.15.6:0/1619958383 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f515c159670 msgr2=0x7f515c158090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:11.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.801+0000 7f515b400640 1 --2- 172.21.15.6:0/1619958383 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f515c159670 0x7f515c158090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:11.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.801+0000 7f515b400640 1 -- 172.21.15.6:0/1619958383 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f515c070450 msgr2=0x7f515c1f8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:11.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.801+0000 7f515b400640 1 --2- 172.21.15.6:0/1619958383 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f515c070450 0x7f515c1f8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:11.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.801+0000 7f515b400640 1 -- 172.21.15.6:0/1619958383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f515c1585d0 con 0x7f515c15c170 2024-09-10T20:57:11.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.802+0000 7f515b400640 1 --2- 172.21.15.6:0/1619958383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f515c15c170 0x7f515c0ad880 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f515400d690 tx=0x7f515400db50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:11.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.802+0000 7f5153400640 1 -- 172.21.15.6:0/1619958383 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5154017070 con 0x7f515c15c170 2024-09-10T20:57:11.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.802+0000 7f5153400640 1 -- 172.21.15.6:0/1619958383 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5154005310 con 0x7f515c15c170 2024-09-10T20:57:11.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.802+0000 7f5161c00640 1 -- 172.21.15.6:0/1619958383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f515c1f4b40 con 0x7f515c15c170 2024-09-10T20:57:11.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.802+0000 7f5153400640 1 -- 172.21.15.6:0/1619958383 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5154009820 con 0x7f515c15c170 2024-09-10T20:57:11.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.802+0000 7f5161c00640 1 -- 172.21.15.6:0/1619958383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f515c1f5100 con 0x7f515c15c170 2024-09-10T20:57:11.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.803+0000 7f5161c00640 1 -- 172.21.15.6:0/1619958383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f515c0b52d0 con 0x7f515c15c170 2024-09-10T20:57:11.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.804+0000 7f5153400640 1 -- 172.21.15.6:0/1619958383 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f51540099c0 con 0x7f515c15c170 2024-09-10T20:57:11.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.805+0000 7f5153400640 1 --2- 172.21.15.6:0/1619958383 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5138077f70 0x7f513807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:11.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.805+0000 7f5153400640 1 -- 172.21.15.6:0/1619958383 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4943+0+0 (secure 0 0 0) 0x7f5154099a00 con 0x7f515c15c170 2024-09-10T20:57:11.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.806+0000 7f515aa00640 1 --2- 172.21.15.6:0/1619958383 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5138077f70 0x7f513807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:11.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.806+0000 7f515aa00640 1 --2- 172.21.15.6:0/1619958383 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5138077f70 0x7f513807a430 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f514c035000 tx=0x7f514c03c040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:11.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:11.809+0000 7f5153400640 1 -- 172.21.15.6:0/1619958383 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f51540621a0 con 0x7f515c15c170 2024-09-10T20:57:12.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:12.079+0000 7f5161c00640 1 -- 172.21.15.6:0/1619958383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_backtrace.TestBacktrace.test_backtrace"]} v 0) -- 0x7f515c069d20 con 0x7f515c15c170 2024-09-10T20:57:12.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:12.214+0000 7f5153400640 1 -- 172.21.15.6:0/1619958383 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_backtrace.TestBacktrace.test_backtrace"]}]=0 v104) ==== 135+0+0 (secure 0 0 0) 0x7f5154066bd0 con 0x7f515c15c170 2024-09-10T20:57:12.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:12.217+0000 7f5161c00640 1 -- 172.21.15.6:0/1619958383 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5138077f70 msgr2=0x7f513807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:12.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:12.217+0000 7f5161c00640 1 --2- 172.21.15.6:0/1619958383 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5138077f70 0x7f513807a430 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f514c035000 tx=0x7f514c03c040 comp rx=0 tx=0).stop 2024-09-10T20:57:12.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:12.217+0000 7f5161c00640 1 -- 172.21.15.6:0/1619958383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f515c15c170 msgr2=0x7f515c0ad880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:12.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:12.217+0000 7f5161c00640 1 --2- 172.21.15.6:0/1619958383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f515c15c170 0x7f515c0ad880 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f515400d690 tx=0x7f515400db50 comp rx=0 tx=0).stop 2024-09-10T20:57:12.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:12.217+0000 7f5161c00640 1 -- 172.21.15.6:0/1619958383 shutdown_connections 2024-09-10T20:57:12.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:12.217+0000 7f5161c00640 1 --2- 172.21.15.6:0/1619958383 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f5138077f70 0x7f513807a430 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:12.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:12.217+0000 7f5161c00640 1 --2- 172.21.15.6:0/1619958383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f515c15c170 0x7f515c0ad880 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:12.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:12.217+0000 7f5161c00640 1 --2- 172.21.15.6:0/1619958383 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f515c159670 0x7f515c158090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:12.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:12.217+0000 7f5161c00640 1 --2- 172.21.15.6:0/1619958383 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f515c070450 0x7f515c1f8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:12.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:12.217+0000 7f5161c00640 1 -- 172.21.15.6:0/1619958383 >> 172.21.15.6:0/1619958383 conn(0x7f515c0cfa20 msgr2=0x7f515c0cfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:12.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:12.217+0000 7f5161c00640 1 -- 172.21.15.6:0/1619958383 shutdown_connections 2024-09-10T20:57:12.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:12.217+0000 7f5161c00640 1 -- 172.21.15.6:0/1619958383 wait complete. 2024-09-10T20:57:12.236 INFO:tasks.cephfs_test_runner:That the 'parent' 'layout' and 'symlink' xattrs on the head objects of files ... ok 2024-09-10T20:57:12.237 INFO:tasks.cephfs_test_runner: 2024-09-10T20:57:12.237 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-10T20:57:12.237 INFO:tasks.cephfs_test_runner:Ran 1 test in 56.491s 2024-09-10T20:57:12.237 INFO:tasks.cephfs_test_runner: 2024-09-10T20:57:12.237 INFO:tasks.cephfs_test_runner:OK 2024-09-10T20:57:12.237 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-10T20:57:12.247 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-10T20:57:12.267 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-10T20:57:12.268 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-10T20:57:12.268 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:57:12.304 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T20:57:12.304 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-10T20:57:12.304 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:57:12.378 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T20:57:12.379 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-10T20:57:12.379 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:57:12.419 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T20:57:12.419 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-10T20:57:12.420 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:57:12.498 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T20:57:12.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:57:12.498 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-09-10T20:57:12.534 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T20:57:12.534 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T20:57:12.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:57:12.534 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T20:57:12.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:57:12.632 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T20:57:12.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:57:12.885 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link delete ceph-brx 2024-09-10T20:57:13.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:57:13.178 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2024-09-10T20:57:13.218 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-10T20:57:13.218 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-10T20:57:13.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:57:13.219 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T20:57:13.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:57:13.321 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T20:57:13.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:57:13.562 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link delete ceph-brx 2024-09-10T20:57:13.827 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-10T20:57:13.838 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T20:57:13.839 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T20:57:14.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.002+0000 7f226e000640 1 -- 172.21.15.6:0/808975921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22680cfd30 msgr2=0x7f2268073d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:14.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.002+0000 7f226e000640 1 --2- 172.21.15.6:0/808975921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22680cfd30 0x7f2268073d50 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2258009830 tx=0x7f225802a520 comp rx=0 tx=0).stop 2024-09-10T20:57:14.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.002+0000 7f226e000640 1 -- 172.21.15.6:0/808975921 shutdown_connections 2024-09-10T20:57:14.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.002+0000 7f226e000640 1 --2- 172.21.15.6:0/808975921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22680cfd30 0x7f2268073d50 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:14.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.002+0000 7f226e000640 1 -- 172.21.15.6:0/808975921 >> 172.21.15.6:0/808975921 conn(0x7f226806cf90 msgr2=0x7f226806d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:14.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.002+0000 7f226e000640 1 -- 172.21.15.6:0/808975921 shutdown_connections 2024-09-10T20:57:14.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.002+0000 7f226e000640 1 -- 172.21.15.6:0/808975921 wait complete. 2024-09-10T20:57:14.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.004+0000 7f226e000640 1 Processor -- start 2024-09-10T20:57:14.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.004+0000 7f226e000640 1 -- start start 2024-09-10T20:57:14.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.005+0000 7f226e000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f226806e180 0x7f22681f4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:14.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.005+0000 7f226e000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22680cfd30 0x7f2268152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:14.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.005+0000 7f226e000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f226815c990 0x7f22680af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:14.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.005+0000 7f226e000640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f226806e5f0 con 0x7f226806e180 2024-09-10T20:57:14.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.005+0000 7f226e000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2268073490 con 0x7f226815c990 2024-09-10T20:57:14.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.005+0000 7f226e000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f226806e770 con 0x7f22680cfd30 2024-09-10T20:57:14.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.005+0000 7f226cc00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f226806e180 0x7f22681f4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:14.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.005+0000 7f226cc00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f226806e180 0x7f22681f4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47378/0 (socket says 172.21.15.6:47378) 2024-09-10T20:57:14.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.005+0000 7f226cc00640 1 -- 172.21.15.6:0/2509147352 learned_addr learned my addr 172.21.15.6:0/2509147352 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:14.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.006+0000 7f226d600640 1 --2- 172.21.15.6:0/2509147352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f226815c990 0x7f22680af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:14.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.006+0000 7f225fe00640 1 --2- 172.21.15.6:0/2509147352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22680cfd30 0x7f2268152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:14.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.006+0000 7f226cc00640 1 -- 172.21.15.6:0/2509147352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22680cfd30 msgr2=0x7f2268152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:14.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.006+0000 7f226cc00640 1 --2- 172.21.15.6:0/2509147352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22680cfd30 0x7f2268152680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:14.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.006+0000 7f226cc00640 1 -- 172.21.15.6:0/2509147352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f226815c990 msgr2=0x7f22680af4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:14.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.006+0000 7f226cc00640 1 --2- 172.21.15.6:0/2509147352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f226815c990 0x7f22680af4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:14.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.006+0000 7f226cc00640 1 -- 172.21.15.6:0/2509147352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22680afc40 con 0x7f226806e180 2024-09-10T20:57:14.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.006+0000 7f226d600640 1 --2- 172.21.15.6:0/2509147352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f226815c990 0x7f22680af4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:57:14.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.006+0000 7f226cc00640 1 --2- 172.21.15.6:0/2509147352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f226806e180 0x7f22681f4f60 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f2258000c00 tx=0x7f2258032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:14.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.006+0000 7f2265600640 1 -- 172.21.15.6:0/2509147352 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2258040070 con 0x7f226806e180 2024-09-10T20:57:14.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.007+0000 7f2265600640 1 -- 172.21.15.6:0/2509147352 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2258003af0 con 0x7f226806e180 2024-09-10T20:57:14.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.007+0000 7f226e000640 1 -- 172.21.15.6:0/2509147352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22680aff20 con 0x7f226806e180 2024-09-10T20:57:14.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.007+0000 7f2265600640 1 -- 172.21.15.6:0/2509147352 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2258045460 con 0x7f226806e180 2024-09-10T20:57:14.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.007+0000 7f226e000640 1 -- 172.21.15.6:0/2509147352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22680b04e0 con 0x7f226806e180 2024-09-10T20:57:14.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.008+0000 7f226e000640 1 -- 172.21.15.6:0/2509147352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2268073d50 con 0x7f226806e180 2024-09-10T20:57:14.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.009+0000 7f2265600640 1 -- 172.21.15.6:0/2509147352 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f225804d030 con 0x7f226806e180 2024-09-10T20:57:14.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.010+0000 7f2265600640 1 --2- 172.21.15.6:0/2509147352 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2244077f70 0x7f224407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:14.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.010+0000 7f2265600640 1 -- 172.21.15.6:0/2509147352 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4943+0+0 (secure 0 0 0) 0x7f22580bb050 con 0x7f226806e180 2024-09-10T20:57:14.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.010+0000 7f225fe00640 1 --2- 172.21.15.6:0/2509147352 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2244077f70 0x7f224407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:14.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.011+0000 7f225fe00640 1 --2- 172.21.15.6:0/2509147352 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2244077f70 0x7f224407a430 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f22681540c0 tx=0x7f2250009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:14.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.014+0000 7f2265600640 1 -- 172.21.15.6:0/2509147352 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2258083e40 con 0x7f226806e180 2024-09-10T20:57:14.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.204+0000 7f226e000640 1 -- 172.21.15.6:0/2509147352 --> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f226815c770 con 0x7f2244077f70 2024-09-10T20:57:14.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.205+0000 7f2265600640 1 -- 172.21.15.6:0/2509147352 <== mgr.4120 v2:172.21.15.150:6800/1238179351 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13478 (secure 0 0 0) 0x7f226815c770 con 0x7f2244077f70 2024-09-10T20:57:14.209 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:57:14.210 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-10T20:57:14.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.207+0000 7f226e000640 1 -- 172.21.15.6:0/2509147352 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2244077f70 msgr2=0x7f224407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:14.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.207+0000 7f226e000640 1 --2- 172.21.15.6:0/2509147352 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2244077f70 0x7f224407a430 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f22681540c0 tx=0x7f2250009040 comp rx=0 tx=0).stop 2024-09-10T20:57:14.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.207+0000 7f226e000640 1 -- 172.21.15.6:0/2509147352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f226806e180 msgr2=0x7f22681f4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:14.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.207+0000 7f226e000640 1 --2- 172.21.15.6:0/2509147352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f226806e180 0x7f22681f4f60 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f2258000c00 tx=0x7f2258032d50 comp rx=0 tx=0).stop 2024-09-10T20:57:14.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.208+0000 7f226e000640 1 -- 172.21.15.6:0/2509147352 shutdown_connections 2024-09-10T20:57:14.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.208+0000 7f226e000640 1 --2- 172.21.15.6:0/2509147352 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f2244077f70 0x7f224407a430 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:14.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.208+0000 7f226e000640 1 --2- 172.21.15.6:0/2509147352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f226815c990 0x7f22680af4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:14.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.208+0000 7f226e000640 1 --2- 172.21.15.6:0/2509147352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22680cfd30 0x7f2268152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:14.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.208+0000 7f226e000640 1 --2- 172.21.15.6:0/2509147352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f226806e180 0x7f22681f4f60 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:14.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.208+0000 7f226e000640 1 -- 172.21.15.6:0/2509147352 >> 172.21.15.6:0/2509147352 conn(0x7f226806cf90 msgr2=0x7f226815bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:14.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.208+0000 7f226e000640 1 -- 172.21.15.6:0/2509147352 shutdown_connections 2024-09-10T20:57:14.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.208+0000 7f226e000640 1 -- 172.21.15.6:0/2509147352 wait complete. 2024-09-10T20:57:14.229 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":86,"stamp":"2024-09-10T20:57:13.193541+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":107,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":229552,"kb_used_data":4968,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754745168,"statfs":{"total":773094113280,"available":772859052032,"internally_reserved":0,"allocated":5087232,"data_stored":2759032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-55843,"num_objects":-33,"num_object_clones":0,"num_object_copies":-66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-33,"num_whiteouts":0,"num_read":-23,"num_read_kb":-11,"num_write":-193,"num_write_kb":-134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001139"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":148,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T20:57:11.222343+0000","last_change":"2024-09-10T20:55:34.718784+0000","last_active":"2024-09-10T20:57:11.222343+0000","last_peered":"2024-09-10T20:57:11.222343+0000","last_clean":"2024-09-10T20:57:11.222343+0000","last_became_active":"2024-09-10T20:55:34.717616+0000","last_became_peered":"2024-09-10T20:55:34.717616+0000","last_unstale":"2024-09-10T20:57:11.222343+0000","last_undegraded":"2024-09-10T20:57:11.222343+0000","last_fullsized":"2024-09-10T20:57:11.222343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:33.618098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:33.618098+0000","last_clean_scrub_stamp":"2024-09-10T20:55:33.618098+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:17.442729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509464,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28092,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343748,"statfs":{"total":96636764160,"available":96607997952,"internally_reserved":0,"allocated":1081344,"data_stored":787655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509462,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27508,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":487424,"data_stored":197287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509463,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27504,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":487424,"data_stored":197287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31664,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340176,"statfs":{"total":96636764160,"available":96604340224,"internally_reserved":0,"allocated":487424,"data_stored":197287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509462,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27512,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":487424,"data_stored":197287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27512,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":487424,"data_stored":197287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28088,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":1081344,"data_stored":787655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542167,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31672,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340168,"statfs":{"total":96636764160,"available":96604332032,"internally_reserved":0,"allocated":487424,"data_stored":197287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T20:57:14.230 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T20:57:14.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.387+0000 7f1b9cc00640 1 -- 172.21.15.6:0/3637258623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b980b0e00 msgr2=0x7f1b980cf800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:14.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.387+0000 7f1b9cc00640 1 --2- 172.21.15.6:0/3637258623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b980b0e00 0x7f1b980cf800 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f1b98070490 tx=0x7f1b8002a4a0 comp rx=0 tx=0).stop 2024-09-10T20:57:14.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.387+0000 7f1b9cc00640 1 -- 172.21.15.6:0/3637258623 shutdown_connections 2024-09-10T20:57:14.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.387+0000 7f1b9cc00640 1 --2- 172.21.15.6:0/3637258623 >> v2:172.21.15.150:3300/0 conn(0x7f1b9806e0a0 0x7f1b9806e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:14.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.387+0000 7f1b9cc00640 1 --2- 172.21.15.6:0/3637258623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b980b0e00 0x7f1b980cf800 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:14.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.387+0000 7f1b9cc00640 1 -- 172.21.15.6:0/3637258623 >> 172.21.15.6:0/3637258623 conn(0x7f1b9809aa00 msgr2=0x7f1b9809ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:14.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.387+0000 7f1b9cc00640 1 -- 172.21.15.6:0/3637258623 shutdown_connections 2024-09-10T20:57:14.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.387+0000 7f1b9cc00640 1 -- 172.21.15.6:0/3637258623 wait complete. 2024-09-10T20:57:14.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.388+0000 7f1b9cc00640 1 Processor -- start 2024-09-10T20:57:14.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.389+0000 7f1b9cc00640 1 -- start start 2024-09-10T20:57:14.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.389+0000 7f1b9cc00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b9806e0a0 0x7f1b981f4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:14.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.389+0000 7f1b9cc00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b980b0e00 0x7f1b9809ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:14.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.389+0000 7f1b9cc00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b98161430 0x7f1b9815b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:14.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.389+0000 7f1b9cc00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1b980d1c40 con 0x7f1b9806e0a0 2024-09-10T20:57:14.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.389+0000 7f1b9cc00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f1b980d1ac0 con 0x7f1b980b0e00 2024-09-10T20:57:14.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.389+0000 7f1b9cc00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f1b980d1dc0 con 0x7f1b98161430 2024-09-10T20:57:14.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.390+0000 7f1b97400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b9806e0a0 0x7f1b981f4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:14.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.390+0000 7f1b97400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b9806e0a0 0x7f1b981f4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47410/0 (socket says 172.21.15.6:47410) 2024-09-10T20:57:14.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.390+0000 7f1b97400640 1 -- 172.21.15.6:0/3540970201 learned_addr learned my addr 172.21.15.6:0/3540970201 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:14.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.390+0000 7f1b8ea00640 1 --2- 172.21.15.6:0/3540970201 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b980b0e00 0x7f1b9809ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:14.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.390+0000 7f1b97e00640 1 --2- 172.21.15.6:0/3540970201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b98161430 0x7f1b9815b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:14.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.390+0000 7f1b97400640 1 -- 172.21.15.6:0/3540970201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b98161430 msgr2=0x7f1b9815b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:14.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.390+0000 7f1b97400640 1 --2- 172.21.15.6:0/3540970201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b98161430 0x7f1b9815b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:14.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.390+0000 7f1b97400640 1 -- 172.21.15.6:0/3540970201 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b980b0e00 msgr2=0x7f1b9809ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:14.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.390+0000 7f1b97400640 1 --2- 172.21.15.6:0/3540970201 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b980b0e00 0x7f1b9809ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:14.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.390+0000 7f1b97400640 1 -- 172.21.15.6:0/3540970201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b9809f5d0 con 0x7f1b9806e0a0 2024-09-10T20:57:14.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.390+0000 7f1b97e00640 1 --2- 172.21.15.6:0/3540970201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b98161430 0x7f1b9815b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:57:14.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.390+0000 7f1b97400640 1 --2- 172.21.15.6:0/3540970201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b9806e0a0 0x7f1b981f4f60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f1b8800cbc0 tx=0x7f1b8800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:14.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.391+0000 7f1b8fe00640 1 -- 172.21.15.6:0/3540970201 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b88016020 con 0x7f1b9806e0a0 2024-09-10T20:57:14.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.391+0000 7f1b9cc00640 1 -- 172.21.15.6:0/3540970201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b9809f8b0 con 0x7f1b9806e0a0 2024-09-10T20:57:14.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.391+0000 7f1b8fe00640 1 -- 172.21.15.6:0/3540970201 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b8800ad90 con 0x7f1b9806e0a0 2024-09-10T20:57:14.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.391+0000 7f1b8fe00640 1 -- 172.21.15.6:0/3540970201 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b88012680 con 0x7f1b9806e0a0 2024-09-10T20:57:14.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.391+0000 7f1b9cc00640 1 -- 172.21.15.6:0/3540970201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b9809f290 con 0x7f1b9806e0a0 2024-09-10T20:57:14.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.392+0000 7f1b9cc00640 1 -- 172.21.15.6:0/3540970201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b9809faf0 con 0x7f1b9806e0a0 2024-09-10T20:57:14.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.393+0000 7f1b8fe00640 1 -- 172.21.15.6:0/3540970201 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f1b8801b400 con 0x7f1b9806e0a0 2024-09-10T20:57:14.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.394+0000 7f1b8fe00640 1 --2- 172.21.15.6:0/3540970201 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f1b74077f70 0x7f1b7407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:14.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.394+0000 7f1b8fe00640 1 -- 172.21.15.6:0/3540970201 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4943+0+0 (secure 0 0 0) 0x7f1b8809a330 con 0x7f1b9806e0a0 2024-09-10T20:57:14.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.394+0000 7f1b8ea00640 1 --2- 172.21.15.6:0/3540970201 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f1b74077f70 0x7f1b7407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:14.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.395+0000 7f1b8ea00640 1 --2- 172.21.15.6:0/3540970201 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f1b74077f70 0x7f1b7407a430 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1b80034000 tx=0x7f1b80004730 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:14.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.398+0000 7f1b8fe00640 1 -- 172.21.15.6:0/3540970201 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f1b9809faf0 con 0x7f1b9806e0a0 2024-09-10T20:57:14.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.590+0000 7f1b9cc00640 1 -- 172.21.15.6:0/3540970201 --> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1b980d2320 con 0x7f1b74077f70 2024-09-10T20:57:14.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.591+0000 7f1b8fe00640 1 -- 172.21.15.6:0/3540970201 <== mgr.4120 v2:172.21.15.150:6800/1238179351 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13478 (secure 0 0 0) 0x7f1b980d2320 con 0x7f1b74077f70 2024-09-10T20:57:14.630 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:57:14.631 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-10T20:57:14.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.593+0000 7f1b9cc00640 1 -- 172.21.15.6:0/3540970201 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f1b74077f70 msgr2=0x7f1b7407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:14.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.593+0000 7f1b9cc00640 1 --2- 172.21.15.6:0/3540970201 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f1b74077f70 0x7f1b7407a430 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1b80034000 tx=0x7f1b80004730 comp rx=0 tx=0).stop 2024-09-10T20:57:14.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.593+0000 7f1b9cc00640 1 -- 172.21.15.6:0/3540970201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b9806e0a0 msgr2=0x7f1b981f4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:14.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.593+0000 7f1b9cc00640 1 --2- 172.21.15.6:0/3540970201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b9806e0a0 0x7f1b981f4f60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f1b8800cbc0 tx=0x7f1b8800a060 comp rx=0 tx=0).stop 2024-09-10T20:57:14.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.593+0000 7f1b9cc00640 1 -- 172.21.15.6:0/3540970201 shutdown_connections 2024-09-10T20:57:14.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.593+0000 7f1b9cc00640 1 --2- 172.21.15.6:0/3540970201 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f1b74077f70 0x7f1b7407a430 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:14.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.593+0000 7f1b9cc00640 1 --2- 172.21.15.6:0/3540970201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b98161430 0x7f1b9815b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:14.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.593+0000 7f1b9cc00640 1 --2- 172.21.15.6:0/3540970201 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b980b0e00 0x7f1b9809ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:14.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.593+0000 7f1b9cc00640 1 --2- 172.21.15.6:0/3540970201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b9806e0a0 0x7f1b981f4f60 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:14.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.593+0000 7f1b9cc00640 1 -- 172.21.15.6:0/3540970201 >> 172.21.15.6:0/3540970201 conn(0x7f1b9809aa00 msgr2=0x7f1b980ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:14.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.593+0000 7f1b9cc00640 1 -- 172.21.15.6:0/3540970201 shutdown_connections 2024-09-10T20:57:14.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.593+0000 7f1b9cc00640 1 -- 172.21.15.6:0/3540970201 wait complete. 2024-09-10T20:57:14.633 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":86,"stamp":"2024-09-10T20:57:13.193541+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":107,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":229552,"kb_used_data":4968,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754745168,"statfs":{"total":773094113280,"available":772859052032,"internally_reserved":0,"allocated":5087232,"data_stored":2759032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-55843,"num_objects":-33,"num_object_clones":0,"num_object_copies":-66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-33,"num_whiteouts":0,"num_read":-23,"num_read_kb":-11,"num_write":-193,"num_write_kb":-134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001139"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":148,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T20:57:11.222343+0000","last_change":"2024-09-10T20:55:34.718784+0000","last_active":"2024-09-10T20:57:11.222343+0000","last_peered":"2024-09-10T20:57:11.222343+0000","last_clean":"2024-09-10T20:57:11.222343+0000","last_became_active":"2024-09-10T20:55:34.717616+0000","last_became_peered":"2024-09-10T20:55:34.717616+0000","last_unstale":"2024-09-10T20:57:11.222343+0000","last_undegraded":"2024-09-10T20:57:11.222343+0000","last_fullsized":"2024-09-10T20:57:11.222343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:33.618098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:33.618098+0000","last_clean_scrub_stamp":"2024-09-10T20:55:33.618098+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:17.442729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509464,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28092,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343748,"statfs":{"total":96636764160,"available":96607997952,"internally_reserved":0,"allocated":1081344,"data_stored":787655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509462,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27508,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":487424,"data_stored":197287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509463,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27504,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":487424,"data_stored":197287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31664,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340176,"statfs":{"total":96636764160,"available":96604340224,"internally_reserved":0,"allocated":487424,"data_stored":197287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509462,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27512,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":487424,"data_stored":197287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27512,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":487424,"data_stored":197287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28088,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":1081344,"data_stored":787655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542167,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31672,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340168,"statfs":{"total":96636764160,"available":96604332032,"internally_reserved":0,"allocated":487424,"data_stored":197287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T20:57:14.633 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T20:57:14.633 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T20:57:14.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.790+0000 7fa0d0600640 1 -- 172.21.15.6:0/2967852478 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0c8159670 msgr2=0x7fa0c80743b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:14.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.790+0000 7fa0d0600640 1 --2- 172.21.15.6:0/2967852478 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0c8159670 0x7fa0c80743b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc009830 tx=0x7fa0bc02a520 comp rx=0 tx=0).stop 2024-09-10T20:57:14.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.790+0000 7fa0d0600640 1 -- 172.21.15.6:0/2967852478 shutdown_connections 2024-09-10T20:57:14.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.790+0000 7fa0d0600640 1 --2- 172.21.15.6:0/2967852478 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0c8159670 0x7fa0c80743b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:14.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.790+0000 7fa0d0600640 1 -- 172.21.15.6:0/2967852478 >> 172.21.15.6:0/2967852478 conn(0x7fa0c80cfa20 msgr2=0x7fa0c80cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:14.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.790+0000 7fa0d0600640 1 -- 172.21.15.6:0/2967852478 shutdown_connections 2024-09-10T20:57:14.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.790+0000 7fa0d0600640 1 -- 172.21.15.6:0/2967852478 wait complete. 2024-09-10T20:57:14.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.791+0000 7fa0d0600640 1 Processor -- start 2024-09-10T20:57:14.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.792+0000 7fa0d0600640 1 -- start start 2024-09-10T20:57:14.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.792+0000 7fa0d0600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0c8070450 0x7fa0c8158630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:14.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.792+0000 7fa0d0600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0c8159670 0x7fa0c8157d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:14.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.793+0000 7fa0d0600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0c815c170 0x7fa0c8159d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:14.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.793+0000 7fa0d0600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c80b53b0 con 0x7fa0c815c170 2024-09-10T20:57:14.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.793+0000 7fa0d0600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c80b5230 con 0x7fa0c8070450 2024-09-10T20:57:14.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.793+0000 7fa0d0600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa0c80c7ab0 con 0x7fa0c8159670 2024-09-10T20:57:14.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.793+0000 7fa0ce600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0c815c170 0x7fa0c8159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:14.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.793+0000 7fa0ce600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0c815c170 0x7fa0c8159d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47414/0 (socket says 172.21.15.6:47414) 2024-09-10T20:57:14.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.793+0000 7fa0ce600640 1 -- 172.21.15.6:0/1143401753 learned_addr learned my addr 172.21.15.6:0/1143401753 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:14.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.793+0000 7fa0cd200640 1 --2- 172.21.15.6:0/1143401753 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0c8159670 0x7fa0c8157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:14.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.793+0000 7fa0cdc00640 1 --2- 172.21.15.6:0/1143401753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0c8070450 0x7fa0c8158630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:14.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.793+0000 7fa0ce600640 1 -- 172.21.15.6:0/1143401753 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0c8159670 msgr2=0x7fa0c8157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:14.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.793+0000 7fa0ce600640 1 --2- 172.21.15.6:0/1143401753 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0c8159670 0x7fa0c8157d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:14.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.793+0000 7fa0ce600640 1 -- 172.21.15.6:0/1143401753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0c8070450 msgr2=0x7fa0c8158630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:14.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.793+0000 7fa0ce600640 1 --2- 172.21.15.6:0/1143401753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0c8070450 0x7fa0c8158630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:14.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.793+0000 7fa0ce600640 1 -- 172.21.15.6:0/1143401753 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0c80c7530 con 0x7fa0c815c170 2024-09-10T20:57:14.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.793+0000 7fa0cd200640 1 --2- 172.21.15.6:0/1143401753 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0c8159670 0x7fa0c8157d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:57:14.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.793+0000 7fa0ce600640 1 --2- 172.21.15.6:0/1143401753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0c815c170 0x7fa0c8159d70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa0c000c730 tx=0x7fa0c000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:14.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.794+0000 7fa0c5600640 1 -- 172.21.15.6:0/1143401753 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c0003b70 con 0x7fa0c815c170 2024-09-10T20:57:14.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.794+0000 7fa0c5600640 1 -- 172.21.15.6:0/1143401753 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa0c0003d10 con 0x7fa0c815c170 2024-09-10T20:57:14.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.794+0000 7fa0c5600640 1 -- 172.21.15.6:0/1143401753 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c000aab0 con 0x7fa0c815c170 2024-09-10T20:57:14.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.794+0000 7fa0d0600640 1 -- 172.21.15.6:0/1143401753 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0c81f32e0 con 0x7fa0c815c170 2024-09-10T20:57:14.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.794+0000 7fa0d0600640 1 -- 172.21.15.6:0/1143401753 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0c81f35c0 con 0x7fa0c815c170 2024-09-10T20:57:14.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.795+0000 7fa0d0600640 1 -- 172.21.15.6:0/1143401753 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0c80cdbc0 con 0x7fa0c815c170 2024-09-10T20:57:14.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.796+0000 7fa0c5600640 1 -- 172.21.15.6:0/1143401753 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa0c000ac50 con 0x7fa0c815c170 2024-09-10T20:57:14.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.798+0000 7fa0c5600640 1 --2- 172.21.15.6:0/1143401753 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa0a8077f70 0x7fa0a807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:14.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.798+0000 7fa0c5600640 1 -- 172.21.15.6:0/1143401753 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4943+0+0 (secure 0 0 0) 0x7fa0c00998c0 con 0x7fa0c815c170 2024-09-10T20:57:14.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.798+0000 7fa0cdc00640 1 --2- 172.21.15.6:0/1143401753 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa0a8077f70 0x7fa0a807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:14.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.799+0000 7fa0cdc00640 1 --2- 172.21.15.6:0/1143401753 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa0a8077f70 0x7fa0a807a430 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc034000 tx=0x7fa0bc004730 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:14.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.802+0000 7fa0c5600640 1 -- 172.21.15.6:0/1143401753 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fa0c0062620 con 0x7fa0c815c170 2024-09-10T20:57:15.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.998+0000 7fa0d0600640 1 -- 172.21.15.6:0/1143401753 --> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa0c806e810 con 0x7fa0a8077f70 2024-09-10T20:57:15.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:14.999+0000 7fa0c5600640 1 -- 172.21.15.6:0/1143401753 <== mgr.4120 v2:172.21.15.150:6800/1238179351 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13478 (secure 0 0 0) 0x7fa0bc004250 con 0x7fa0a8077f70 2024-09-10T20:57:15.003 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:57:15.003 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-10T20:57:15.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.001+0000 7fa0d0600640 1 -- 172.21.15.6:0/1143401753 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa0a8077f70 msgr2=0x7fa0a807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:15.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.001+0000 7fa0d0600640 1 --2- 172.21.15.6:0/1143401753 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa0a8077f70 0x7fa0a807a430 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc034000 tx=0x7fa0bc004730 comp rx=0 tx=0).stop 2024-09-10T20:57:15.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.001+0000 7fa0d0600640 1 -- 172.21.15.6:0/1143401753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0c815c170 msgr2=0x7fa0c8159d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:15.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.001+0000 7fa0d0600640 1 --2- 172.21.15.6:0/1143401753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0c815c170 0x7fa0c8159d70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa0c000c730 tx=0x7fa0c000cbf0 comp rx=0 tx=0).stop 2024-09-10T20:57:15.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.001+0000 7fa0d0600640 1 -- 172.21.15.6:0/1143401753 shutdown_connections 2024-09-10T20:57:15.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.001+0000 7fa0d0600640 1 --2- 172.21.15.6:0/1143401753 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fa0a8077f70 0x7fa0a807a430 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:15.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.001+0000 7fa0d0600640 1 --2- 172.21.15.6:0/1143401753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0c815c170 0x7fa0c8159d70 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:15.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.001+0000 7fa0d0600640 1 --2- 172.21.15.6:0/1143401753 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0c8159670 0x7fa0c8157d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:15.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.001+0000 7fa0d0600640 1 --2- 172.21.15.6:0/1143401753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0c8070450 0x7fa0c8158630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:15.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.001+0000 7fa0d0600640 1 -- 172.21.15.6:0/1143401753 >> 172.21.15.6:0/1143401753 conn(0x7fa0c80cfa20 msgr2=0x7fa0c815d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:15.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.001+0000 7fa0d0600640 1 -- 172.21.15.6:0/1143401753 shutdown_connections 2024-09-10T20:57:15.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.002+0000 7fa0d0600640 1 -- 172.21.15.6:0/1143401753 wait complete. 2024-09-10T20:57:15.021 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":86,"stamp":"2024-09-10T20:57:13.193541+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":107,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":229552,"kb_used_data":4968,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754745168,"statfs":{"total":773094113280,"available":772859052032,"internally_reserved":0,"allocated":5087232,"data_stored":2759032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-55843,"num_objects":-33,"num_object_clones":0,"num_object_copies":-66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-33,"num_whiteouts":0,"num_read":-23,"num_read_kb":-11,"num_write":-193,"num_write_kb":-134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001139"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":148,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T20:57:11.222343+0000","last_change":"2024-09-10T20:55:34.718784+0000","last_active":"2024-09-10T20:57:11.222343+0000","last_peered":"2024-09-10T20:57:11.222343+0000","last_clean":"2024-09-10T20:57:11.222343+0000","last_became_active":"2024-09-10T20:55:34.717616+0000","last_became_peered":"2024-09-10T20:55:34.717616+0000","last_unstale":"2024-09-10T20:57:11.222343+0000","last_undegraded":"2024-09-10T20:57:11.222343+0000","last_fullsized":"2024-09-10T20:57:11.222343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:33.618098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:33.618098+0000","last_clean_scrub_stamp":"2024-09-10T20:55:33.618098+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:17.442729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509464,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28092,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343748,"statfs":{"total":96636764160,"available":96607997952,"internally_reserved":0,"allocated":1081344,"data_stored":787655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509462,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27508,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":487424,"data_stored":197287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509463,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27504,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":487424,"data_stored":197287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31664,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340176,"statfs":{"total":96636764160,"available":96604340224,"internally_reserved":0,"allocated":487424,"data_stored":197287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509462,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27512,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":487424,"data_stored":197287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27512,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":487424,"data_stored":197287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28088,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":1081344,"data_stored":787655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542167,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31672,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340168,"statfs":{"total":96636764160,"available":96604332032,"internally_reserved":0,"allocated":487424,"data_stored":197287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T20:57:15.022 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T20:57:15.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.178+0000 7f3050e00640 1 -- 172.21.15.6:0/630651156 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f304c0b53e0 msgr2=0x7f304c0d4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:15.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.178+0000 7f3050e00640 1 --2- 172.21.15.6:0/630651156 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f304c0b53e0 0x7f304c0d4500 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3044009be0 tx=0x7f304402a8b0 comp rx=0 tx=0).stop 2024-09-10T20:57:15.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.178+0000 7f3050e00640 1 -- 172.21.15.6:0/630651156 shutdown_connections 2024-09-10T20:57:15.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.178+0000 7f3050e00640 1 --2- 172.21.15.6:0/630651156 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f304c0b53e0 0x7f304c0d4500 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:15.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.178+0000 7f3050e00640 1 -- 172.21.15.6:0/630651156 >> 172.21.15.6:0/630651156 conn(0x7f304c09d0f0 msgr2=0x7f304c0d3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:15.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.178+0000 7f3050e00640 1 -- 172.21.15.6:0/630651156 shutdown_connections 2024-09-10T20:57:15.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.178+0000 7f3050e00640 1 -- 172.21.15.6:0/630651156 wait complete. 2024-09-10T20:57:15.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.180+0000 7f3050e00640 1 Processor -- start 2024-09-10T20:57:15.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.180+0000 7f3050e00640 1 -- start start 2024-09-10T20:57:15.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.181+0000 7f3050e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f304c0b53e0 0x7f304c06eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:15.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.181+0000 7f3050e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f304c0d0f10 0x7f304c1501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:15.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.181+0000 7f3050e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f304c161610 0x7f304c0cd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:15.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.181+0000 7f3050e00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f304c0b4510 con 0x7f304c0b53e0 2024-09-10T20:57:15.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.181+0000 7f3050e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f304c0b4390 con 0x7f304c161610 2024-09-10T20:57:15.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.181+0000 7f3050e00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f304c0b4690 con 0x7f304c0d0f10 2024-09-10T20:57:15.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.181+0000 7f304b400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f304c0b53e0 0x7f304c06eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:15.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.181+0000 7f304b400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f304c0b53e0 0x7f304c06eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47422/0 (socket says 172.21.15.6:47422) 2024-09-10T20:57:15.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.181+0000 7f304b400640 1 -- 172.21.15.6:0/2494092689 learned_addr learned my addr 172.21.15.6:0/2494092689 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:15.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.181+0000 7f3042a00640 1 --2- 172.21.15.6:0/2494092689 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f304c0d0f10 0x7f304c1501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:15.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.181+0000 7f304be00640 1 --2- 172.21.15.6:0/2494092689 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f304c161610 0x7f304c0cd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:15.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.182+0000 7f304b400640 1 -- 172.21.15.6:0/2494092689 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f304c0d0f10 msgr2=0x7f304c1501c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:15.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.182+0000 7f304b400640 1 --2- 172.21.15.6:0/2494092689 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f304c0d0f10 0x7f304c1501c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:15.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.182+0000 7f304b400640 1 -- 172.21.15.6:0/2494092689 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f304c161610 msgr2=0x7f304c0cd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:15.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.182+0000 7f304b400640 1 --2- 172.21.15.6:0/2494092689 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f304c161610 0x7f304c0cd0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:15.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.182+0000 7f304b400640 1 -- 172.21.15.6:0/2494092689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f304c15bb20 con 0x7f304c0b53e0 2024-09-10T20:57:15.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.182+0000 7f3042a00640 1 --2- 172.21.15.6:0/2494092689 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f304c0d0f10 0x7f304c1501c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:57:15.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.182+0000 7f304b400640 1 --2- 172.21.15.6:0/2494092689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f304c0b53e0 0x7f304c06eb00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f303c00c690 tx=0x7f303c00cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:15.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.182+0000 7f3043e00640 1 -- 172.21.15.6:0/2494092689 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f303c016020 con 0x7f304c0b53e0 2024-09-10T20:57:15.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.182+0000 7f3043e00640 1 -- 172.21.15.6:0/2494092689 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f303c00a930 con 0x7f304c0b53e0 2024-09-10T20:57:15.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.182+0000 7f3043e00640 1 -- 172.21.15.6:0/2494092689 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f303c00ad80 con 0x7f304c0b53e0 2024-09-10T20:57:15.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.182+0000 7f3050e00640 1 -- 172.21.15.6:0/2494092689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f304c0cc920 con 0x7f304c0b53e0 2024-09-10T20:57:15.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.182+0000 7f3050e00640 1 -- 172.21.15.6:0/2494092689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f304c1606e0 con 0x7f304c0b53e0 2024-09-10T20:57:15.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.184+0000 7f3050e00640 1 -- 172.21.15.6:0/2494092689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f304c0d4500 con 0x7f304c0b53e0 2024-09-10T20:57:15.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.185+0000 7f3043e00640 1 -- 172.21.15.6:0/2494092689 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f303c012420 con 0x7f304c0b53e0 2024-09-10T20:57:15.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.186+0000 7f3043e00640 1 --2- 172.21.15.6:0/2494092689 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3028077f70 0x7f302807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:15.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.186+0000 7f3043e00640 1 -- 172.21.15.6:0/2494092689 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4943+0+0 (secure 0 0 0) 0x7f303c099e90 con 0x7f304c0b53e0 2024-09-10T20:57:15.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.187+0000 7f3042a00640 1 --2- 172.21.15.6:0/2494092689 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3028077f70 0x7f302807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:15.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.187+0000 7f3042a00640 1 --2- 172.21.15.6:0/2494092689 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3028077f70 0x7f302807a430 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f304c0d2700 tx=0x7f3034009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:15.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.190+0000 7f3043e00640 1 -- 172.21.15.6:0/2494092689 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f303c020020 con 0x7f304c0b53e0 2024-09-10T20:57:15.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.385+0000 7f3050e00640 1 -- 172.21.15.6:0/2494092689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f304c15c9a0 con 0x7f304c0b53e0 2024-09-10T20:57:15.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.386+0000 7f3043e00640 1 -- 172.21.15.6:0/2494092689 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) ==== 74+0+12970 (secure 0 0 0) 0x7f304c15bb20 con 0x7f304c0b53e0 2024-09-10T20:57:15.390 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:57:15.390 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":42,"fsid":"9e04309e-61c3-4c78-82db-9576e465d98a","created":"2024-09-10T20:55:17.972466+0000","modified":"2024-09-10T20:57:11.206729+0000","last_up_change":"2024-09-10T20:55:32.392769+0000","last_in_change":"2024-09-10T20:55:22.232252+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:55:33.196464+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0918c5c8-a028-4987-bad2-406c412ec3f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6801","nonce":895515615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6803","nonce":895515615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6807","nonce":895515615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":895515615},{"type":"v1","addr":"172.21.15.6:6805","nonce":895515615}]},"public_addr":"172.21.15.6:6801/895515615","cluster_addr":"172.21.15.6:6803/895515615","heartbeat_back_addr":"172.21.15.6:6807/895515615","heartbeat_front_addr":"172.21.15.6:6805/895515615","state":["exists","up"]},{"osd":1,"uuid":"415e9c78-c3d9-46d6-b277-348453f42155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6809","nonce":1129113250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6811","nonce":1129113250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6815","nonce":1129113250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1129113250},{"type":"v1","addr":"172.21.15.6:6813","nonce":1129113250}]},"public_addr":"172.21.15.6:6809/1129113250","cluster_addr":"172.21.15.6:6811/1129113250","heartbeat_back_addr":"172.21.15.6:6815/1129113250","heartbeat_front_addr":"172.21.15.6:6813/1129113250","state":["exists","up"]},{"osd":2,"uuid":"763c1cf2-a43d-4c10-815d-eaf4a32afc1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6825","nonce":3847470051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6827","nonce":3847470051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6831","nonce":3847470051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3847470051},{"type":"v1","addr":"172.21.15.6:6829","nonce":3847470051}]},"public_addr":"172.21.15.6:6825/3847470051","cluster_addr":"172.21.15.6:6827/3847470051","heartbeat_back_addr":"172.21.15.6:6831/3847470051","heartbeat_front_addr":"172.21.15.6:6829/3847470051","state":["exists","up"]},{"osd":3,"uuid":"877b1cc1-2434-4b32-af66-9c2485eac9e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6817","nonce":3911674247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6819","nonce":3911674247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6823","nonce":3911674247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3911674247},{"type":"v1","addr":"172.21.15.6:6821","nonce":3911674247}]},"public_addr":"172.21.15.6:6817/3911674247","cluster_addr":"172.21.15.6:6819/3911674247","heartbeat_back_addr":"172.21.15.6:6823/3911674247","heartbeat_front_addr":"172.21.15.6:6821/3911674247","state":["exists","up"]},{"osd":4,"uuid":"e0b27501-dfdc-4e7f-b73a-9573c869267a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6827","nonce":2568527750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6829","nonce":2568527750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6833","nonce":2568527750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2568527750},{"type":"v1","addr":"172.21.15.150:6831","nonce":2568527750}]},"public_addr":"172.21.15.150:6827/2568527750","cluster_addr":"172.21.15.150:6829/2568527750","heartbeat_back_addr":"172.21.15.150:6833/2568527750","heartbeat_front_addr":"172.21.15.150:6831/2568527750","state":["exists","up"]},{"osd":5,"uuid":"67e48053-4f15-44fd-a30c-c9522f86d169","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6811","nonce":371417736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6813","nonce":371417736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6817","nonce":371417736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":371417736},{"type":"v1","addr":"172.21.15.150:6815","nonce":371417736}]},"public_addr":"172.21.15.150:6811/371417736","cluster_addr":"172.21.15.150:6813/371417736","heartbeat_back_addr":"172.21.15.150:6817/371417736","heartbeat_front_addr":"172.21.15.150:6815/371417736","state":["exists","up"]},{"osd":6,"uuid":"1456df2e-ae91-45a4-bc3a-a06c753092af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6819","nonce":2329248366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6821","nonce":2329248366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6825","nonce":2329248366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2329248366},{"type":"v1","addr":"172.21.15.150:6823","nonce":2329248366}]},"public_addr":"172.21.15.150:6819/2329248366","cluster_addr":"172.21.15.150:6821/2329248366","heartbeat_back_addr":"172.21.15.150:6825/2329248366","heartbeat_front_addr":"172.21.15.150:6823/2329248366","state":["exists","up"]},{"osd":7,"uuid":"a9daafcb-5ecd-43bd-ab0a-dc4b480cfc2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6803","nonce":527018351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6805","nonce":527018351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6809","nonce":527018351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":527018351},{"type":"v1","addr":"172.21.15.150:6807","nonce":527018351}]},"public_addr":"172.21.15.150:6803/527018351","cluster_addr":"172.21.15.150:6805/527018351","heartbeat_back_addr":"172.21.15.150:6809/527018351","heartbeat_front_addr":"172.21.15.150:6807/527018351","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.710061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.024506+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.824320+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:28.431608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.637032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.054828+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.333290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:55:29.358875+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6835/1598644433":"2024-09-11T20:57:07.103740+0000","172.21.15.6:6833/1598644433":"2024-09-11T20:57:07.103740+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:57:15.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.388+0000 7f3050e00640 1 -- 172.21.15.6:0/2494092689 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3028077f70 msgr2=0x7f302807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:15.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.388+0000 7f3050e00640 1 --2- 172.21.15.6:0/2494092689 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3028077f70 0x7f302807a430 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f304c0d2700 tx=0x7f3034009040 comp rx=0 tx=0).stop 2024-09-10T20:57:15.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.388+0000 7f3050e00640 1 -- 172.21.15.6:0/2494092689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f304c0b53e0 msgr2=0x7f304c06eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:15.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.388+0000 7f3050e00640 1 --2- 172.21.15.6:0/2494092689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f304c0b53e0 0x7f304c06eb00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f303c00c690 tx=0x7f303c00cb50 comp rx=0 tx=0).stop 2024-09-10T20:57:15.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.388+0000 7f3050e00640 1 -- 172.21.15.6:0/2494092689 shutdown_connections 2024-09-10T20:57:15.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.389+0000 7f3050e00640 1 --2- 172.21.15.6:0/2494092689 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3028077f70 0x7f302807a430 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:15.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.389+0000 7f3050e00640 1 --2- 172.21.15.6:0/2494092689 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f304c161610 0x7f304c0cd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:15.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.389+0000 7f3050e00640 1 --2- 172.21.15.6:0/2494092689 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f304c0d0f10 0x7f304c1501c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:15.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.389+0000 7f3050e00640 1 --2- 172.21.15.6:0/2494092689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f304c0b53e0 0x7f304c06eb00 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:15.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.389+0000 7f3050e00640 1 -- 172.21.15.6:0/2494092689 >> 172.21.15.6:0/2494092689 conn(0x7f304c09d0f0 msgr2=0x7f304c0d3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:15.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.389+0000 7f3050e00640 1 -- 172.21.15.6:0/2494092689 shutdown_connections 2024-09-10T20:57:15.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:15.389+0000 7f3050e00640 1 -- 172.21.15.6:0/2494092689 wait complete. 2024-09-10T20:57:16.411 INFO:tasks.ceph:Scrubbing osd.0 2024-09-10T20:57:16.411 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-10T20:57:16.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.584+0000 7fad41a00640 1 -- 172.21.15.6:0/2220346789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad3c06fe40 msgr2=0x7fad3c070220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:16.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.585+0000 7fad41a00640 1 --2- 172.21.15.6:0/2220346789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad3c06fe40 0x7fad3c070220 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fad2c009830 tx=0x7fad2c02a510 comp rx=0 tx=0).stop 2024-09-10T20:57:16.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.585+0000 7fad41a00640 1 -- 172.21.15.6:0/2220346789 shutdown_connections 2024-09-10T20:57:16.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.585+0000 7fad41a00640 1 --2- 172.21.15.6:0/2220346789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad3c06fe40 0x7fad3c070220 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:16.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.585+0000 7fad41a00640 1 -- 172.21.15.6:0/2220346789 >> 172.21.15.6:0/2220346789 conn(0x7fad3c0cfa20 msgr2=0x7fad3c0cfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:16.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.585+0000 7fad41a00640 1 -- 172.21.15.6:0/2220346789 shutdown_connections 2024-09-10T20:57:16.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.585+0000 7fad41a00640 1 -- 172.21.15.6:0/2220346789 wait complete. 2024-09-10T20:57:16.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.586+0000 7fad41a00640 1 Processor -- start 2024-09-10T20:57:16.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.586+0000 7fad41a00640 1 -- start start 2024-09-10T20:57:16.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.587+0000 7fad41a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad3c06fe40 0x7fad3c154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:16.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.587+0000 7fad41a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad3c0ca310 0x7fad3c0ae240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:16.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.587+0000 7fad41a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad3c15bce0 0x7fad3c0ae780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:16.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.587+0000 7fad41a00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fad3c0cb1e0 con 0x7fad3c06fe40 2024-09-10T20:57:16.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.587+0000 7fad41a00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fad3c0cb060 con 0x7fad3c15bce0 2024-09-10T20:57:16.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.587+0000 7fad41a00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fad3c0cb360 con 0x7fad3c0ca310 2024-09-10T20:57:16.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.588+0000 7fad3aa00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad3c06fe40 0x7fad3c154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:16.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.588+0000 7fad3aa00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad3c06fe40 0x7fad3c154f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47440/0 (socket says 172.21.15.6:47440) 2024-09-10T20:57:16.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.588+0000 7fad3aa00640 1 -- 172.21.15.6:0/3880451683 learned_addr learned my addr 172.21.15.6:0/3880451683 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:16.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.588+0000 7fad32000640 1 --2- 172.21.15.6:0/3880451683 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad3c0ca310 0x7fad3c0ae240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:16.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.588+0000 7fad3b400640 1 --2- 172.21.15.6:0/3880451683 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad3c15bce0 0x7fad3c0ae780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:16.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.588+0000 7fad3aa00640 1 -- 172.21.15.6:0/3880451683 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad3c0ca310 msgr2=0x7fad3c0ae240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:16.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.588+0000 7fad3aa00640 1 --2- 172.21.15.6:0/3880451683 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad3c0ca310 0x7fad3c0ae240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:16.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.588+0000 7fad3aa00640 1 -- 172.21.15.6:0/3880451683 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad3c15bce0 msgr2=0x7fad3c0ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:16.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.588+0000 7fad3aa00640 1 --2- 172.21.15.6:0/3880451683 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad3c15bce0 0x7fad3c0ae780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:16.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.588+0000 7fad3aa00640 1 -- 172.21.15.6:0/3880451683 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad3c155450 con 0x7fad3c06fe40 2024-09-10T20:57:16.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.588+0000 7fad3b400640 1 --2- 172.21.15.6:0/3880451683 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad3c15bce0 0x7fad3c0ae780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:57:16.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.588+0000 7fad3aa00640 1 --2- 172.21.15.6:0/3880451683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad3c06fe40 0x7fad3c154f10 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fad2c02ab00 tx=0x7fad2c032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:16.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.588+0000 7fad33400640 1 -- 172.21.15.6:0/3880451683 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad2c040070 con 0x7fad3c06fe40 2024-09-10T20:57:16.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.589+0000 7fad33400640 1 -- 172.21.15.6:0/3880451683 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fad2c005310 con 0x7fad3c06fe40 2024-09-10T20:57:16.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.589+0000 7fad33400640 1 -- 172.21.15.6:0/3880451683 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad2c0047a0 con 0x7fad3c06fe40 2024-09-10T20:57:16.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.589+0000 7fad41a00640 1 -- 172.21.15.6:0/3880451683 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad3c0c3ac0 con 0x7fad3c06fe40 2024-09-10T20:57:16.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.589+0000 7fad41a00640 1 -- 172.21.15.6:0/3880451683 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad3c0c4080 con 0x7fad3c06fe40 2024-09-10T20:57:16.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.589+0000 7fad41a00640 1 -- 172.21.15.6:0/3880451683 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fad3c0c4740 con 0x7fad3c06fe40 2024-09-10T20:57:16.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.591+0000 7fad33400640 1 -- 172.21.15.6:0/3880451683 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fad2c004940 con 0x7fad3c06fe40 2024-09-10T20:57:16.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.592+0000 7fad33400640 1 --2- 172.21.15.6:0/3880451683 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fad18077fa0 0x7fad1807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:16.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.592+0000 7fad33400640 1 -- 172.21.15.6:0/3880451683 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4943+0+0 (secure 0 0 0) 0x7fad2c0baf20 con 0x7fad3c06fe40 2024-09-10T20:57:16.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.592+0000 7fad33400640 1 --2- 172.21.15.6:0/3880451683 >> [v2:172.21.15.6:6800/895515615,v1:172.21.15.6:6801/895515615] conn(0x7fad1807de60 0x7fad18080280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:16.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.592+0000 7fad33400640 1 -- 172.21.15.6:0/3880451683 --> [v2:172.21.15.6:6800/895515615,v1:172.21.15.6:6801/895515615] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fad2c040e50 con 0x7fad1807de60 2024-09-10T20:57:16.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.592+0000 7fad33400640 1 -- 172.21.15.6:0/3880451683 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fad2c0c2050 con 0x7fad3c06fe40 2024-09-10T20:57:16.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.592+0000 7fad32000640 1 --2- 172.21.15.6:0/3880451683 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fad18077fa0 0x7fad1807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:16.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.592+0000 7fad3b400640 1 --2- 172.21.15.6:0/3880451683 >> [v2:172.21.15.6:6800/895515615,v1:172.21.15.6:6801/895515615] conn(0x7fad1807de60 0x7fad18080280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:16.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.593+0000 7fad32000640 1 --2- 172.21.15.6:0/3880451683 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fad18077fa0 0x7fad1807a460 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fad3c0d03f0 tx=0x7fad24009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:16.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.593+0000 7fad3b400640 1 --2- 172.21.15.6:0/3880451683 >> [v2:172.21.15.6:6800/895515615,v1:172.21.15.6:6801/895515615] conn(0x7fad1807de60 0x7fad18080280 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:16.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.594+0000 7fad33400640 1 -- 172.21.15.6:0/3880451683 <== osd.0 v2:172.21.15.6:6800/895515615 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fad2c040e50 con 0x7fad1807de60 2024-09-10T20:57:16.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.607+0000 7fad41a00640 1 -- 172.21.15.6:0/3880451683 --> [v2:172.21.15.6:6800/895515615,v1:172.21.15.6:6801/895515615] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fad3c070220 con 0x7fad1807de60 2024-09-10T20:57:16.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.607+0000 7fad33400640 1 -- 172.21.15.6:0/3880451683 <== osd.0 v2:172.21.15.6:6800/895515615 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fad3c070220 con 0x7fad1807de60 2024-09-10T20:57:16.611 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-10T20:57:16.612 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T20:57:16.612 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-10T20:57:16.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.608+0000 7fad41a00640 1 -- 172.21.15.6:0/3880451683 >> [v2:172.21.15.6:6800/895515615,v1:172.21.15.6:6801/895515615] conn(0x7fad1807de60 msgr2=0x7fad18080280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:16.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.608+0000 7fad41a00640 1 --2- 172.21.15.6:0/3880451683 >> [v2:172.21.15.6:6800/895515615,v1:172.21.15.6:6801/895515615] conn(0x7fad1807de60 0x7fad18080280 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:16.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.608+0000 7fad41a00640 1 -- 172.21.15.6:0/3880451683 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fad18077fa0 msgr2=0x7fad1807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:16.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.608+0000 7fad41a00640 1 --2- 172.21.15.6:0/3880451683 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fad18077fa0 0x7fad1807a460 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fad3c0d03f0 tx=0x7fad24009040 comp rx=0 tx=0).stop 2024-09-10T20:57:16.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.608+0000 7fad41a00640 1 -- 172.21.15.6:0/3880451683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad3c06fe40 msgr2=0x7fad3c154f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:16.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.608+0000 7fad41a00640 1 --2- 172.21.15.6:0/3880451683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad3c06fe40 0x7fad3c154f10 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fad2c02ab00 tx=0x7fad2c032c10 comp rx=0 tx=0).stop 2024-09-10T20:57:16.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.608+0000 7fad3b400640 1 -- 172.21.15.6:0/3880451683 reap_dead start 2024-09-10T20:57:16.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.608+0000 7fad41a00640 1 -- 172.21.15.6:0/3880451683 shutdown_connections 2024-09-10T20:57:16.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.608+0000 7fad41a00640 1 -- 172.21.15.6:0/3880451683 >> 172.21.15.6:0/3880451683 conn(0x7fad3c0cfa20 msgr2=0x7fad3c15d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:16.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.608+0000 7fad41a00640 1 -- 172.21.15.6:0/3880451683 shutdown_connections 2024-09-10T20:57:16.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.608+0000 7fad41a00640 1 -- 172.21.15.6:0/3880451683 wait complete. 2024-09-10T20:57:16.626 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-10T20:57:16.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.784+0000 7f8fb7a00640 1 -- 172.21.15.6:0/1905545525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8fb00cb360 msgr2=0x7f8fb0165de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:16.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.784+0000 7f8fb7a00640 1 --2- 172.21.15.6:0/1905545525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8fb00cb360 0x7f8fb0165de0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8005fd0 tx=0x7f8fa802a8b0 comp rx=0 tx=0).stop 2024-09-10T20:57:16.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.784+0000 7f8fb7a00640 1 -- 172.21.15.6:0/1905545525 shutdown_connections 2024-09-10T20:57:16.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.784+0000 7f8fb7a00640 1 --2- 172.21.15.6:0/1905545525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8fb00cb360 0x7f8fb0165de0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:16.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.784+0000 7f8fb7a00640 1 -- 172.21.15.6:0/1905545525 >> 172.21.15.6:0/1905545525 conn(0x7f8fb00cfa20 msgr2=0x7f8fb00cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:16.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.784+0000 7f8fb7a00640 1 -- 172.21.15.6:0/1905545525 shutdown_connections 2024-09-10T20:57:16.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.784+0000 7f8fb7a00640 1 -- 172.21.15.6:0/1905545525 wait complete. 2024-09-10T20:57:16.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.786+0000 7f8fb7a00640 1 Processor -- start 2024-09-10T20:57:16.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.786+0000 7f8fb7a00640 1 -- start start 2024-09-10T20:57:16.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.787+0000 7f8fb7a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8fb006f090 0x7f8fb00c7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:16.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.787+0000 7f8fb7a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8fb00af060 0x7f8fb01f5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:16.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.787+0000 7f8fb7a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fb00cb360 0x7f8fb01515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:16.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.787+0000 7f8fb7a00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb006f5f0 con 0x7f8fb006f090 2024-09-10T20:57:16.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.787+0000 7f8fb7a00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb006f470 con 0x7f8fb00af060 2024-09-10T20:57:16.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.787+0000 7f8fb7a00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8fb006f770 con 0x7f8fb00cb360 2024-09-10T20:57:16.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.787+0000 7f8fb5000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8fb006f090 0x7f8fb00c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:16.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.787+0000 7f8fb5000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8fb006f090 0x7f8fb00c7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47460/0 (socket says 172.21.15.6:47460) 2024-09-10T20:57:16.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.787+0000 7f8fb5000640 1 -- 172.21.15.6:0/1806671148 learned_addr learned my addr 172.21.15.6:0/1806671148 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:16.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.787+0000 7f8fb5a00640 1 --2- 172.21.15.6:0/1806671148 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fb00cb360 0x7f8fb01515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:16.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.787+0000 7f8fa7e00640 1 --2- 172.21.15.6:0/1806671148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8fb00af060 0x7f8fb01f5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:16.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.788+0000 7f8fb5000640 1 -- 172.21.15.6:0/1806671148 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fb00cb360 msgr2=0x7f8fb01515f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:16.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.788+0000 7f8fb5000640 1 --2- 172.21.15.6:0/1806671148 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fb00cb360 0x7f8fb01515f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:16.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.788+0000 7f8fb5000640 1 -- 172.21.15.6:0/1806671148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8fb00af060 msgr2=0x7f8fb01f5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:16.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.788+0000 7f8fb5000640 1 --2- 172.21.15.6:0/1806671148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8fb00af060 0x7f8fb01f5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:16.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.788+0000 7f8fb5000640 1 -- 172.21.15.6:0/1806671148 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fb00c7da0 con 0x7f8fb006f090 2024-09-10T20:57:16.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.788+0000 7f8fb5000640 1 --2- 172.21.15.6:0/1806671148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8fb006f090 0x7f8fb00c7710 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f8fa000c500 tx=0x7f8fa000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:16.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.788+0000 7f8fad600640 1 -- 172.21.15.6:0/1806671148 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0016020 con 0x7f8fb006f090 2024-09-10T20:57:16.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.788+0000 7f8fad600640 1 -- 172.21.15.6:0/1806671148 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8fa0012920 con 0x7f8fb006f090 2024-09-10T20:57:16.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.788+0000 7f8fad600640 1 -- 172.21.15.6:0/1806671148 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0012d90 con 0x7f8fb006f090 2024-09-10T20:57:16.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.788+0000 7f8fb7a00640 1 -- 172.21.15.6:0/1806671148 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fb00c8140 con 0x7f8fb006f090 2024-09-10T20:57:16.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.789+0000 7f8fb7a00640 1 -- 172.21.15.6:0/1806671148 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fb00c8700 con 0x7f8fb006f090 2024-09-10T20:57:16.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.790+0000 7f8fb7a00640 1 -- 172.21.15.6:0/1806671148 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fb015eb20 con 0x7f8fb006f090 2024-09-10T20:57:16.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.791+0000 7f8fad600640 1 -- 172.21.15.6:0/1806671148 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8fa001a3b0 con 0x7f8fb006f090 2024-09-10T20:57:16.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.792+0000 7f8fad600640 1 --2- 172.21.15.6:0/1806671148 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f8f8c077f70 0x7f8f8c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:16.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.792+0000 7f8fad600640 1 -- 172.21.15.6:0/1806671148 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4943+0+0 (secure 0 0 0) 0x7f8fa0099910 con 0x7f8fb006f090 2024-09-10T20:57:16.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.792+0000 7f8fa7e00640 1 --2- 172.21.15.6:0/1806671148 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f8f8c077f70 0x7f8f8c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:16.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.793+0000 7f8fa7e00640 1 --2- 172.21.15.6:0/1806671148 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f8f8c077f70 0x7f8f8c07a430 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8fb00c73d0 tx=0x7f8f98009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:16.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.796+0000 7f8fad600640 1 -- 172.21.15.6:0/1806671148 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f8fa0020030 con 0x7f8fb006f090 2024-09-10T20:57:16.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.993+0000 7f8fb7a00640 1 -- 172.21.15.6:0/1806671148 --> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f8fb01586a0 con 0x7f8f8c077f70 2024-09-10T20:57:16.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.993+0000 7f8fad600640 1 -- 172.21.15.6:0/1806671148 <== mgr.4120 v2:172.21.15.150:6800/1238179351 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f8fb01586a0 con 0x7f8f8c077f70 2024-09-10T20:57:16.997 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 0 to deep-scrub 2024-09-10T20:57:17.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.996+0000 7f8fb7a00640 1 -- 172.21.15.6:0/1806671148 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f8f8c077f70 msgr2=0x7f8f8c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:17.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.996+0000 7f8fb7a00640 1 --2- 172.21.15.6:0/1806671148 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f8f8c077f70 0x7f8f8c07a430 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8fb00c73d0 tx=0x7f8f98009040 comp rx=0 tx=0).stop 2024-09-10T20:57:17.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.996+0000 7f8fb7a00640 1 -- 172.21.15.6:0/1806671148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8fb006f090 msgr2=0x7f8fb00c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:17.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.996+0000 7f8fb7a00640 1 --2- 172.21.15.6:0/1806671148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8fb006f090 0x7f8fb00c7710 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f8fa000c500 tx=0x7f8fa000c9c0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.996+0000 7f8fb7a00640 1 -- 172.21.15.6:0/1806671148 shutdown_connections 2024-09-10T20:57:17.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.996+0000 7f8fb7a00640 1 --2- 172.21.15.6:0/1806671148 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f8f8c077f70 0x7f8f8c07a430 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.996+0000 7f8fb7a00640 1 --2- 172.21.15.6:0/1806671148 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fb00cb360 0x7f8fb01515f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.996+0000 7f8fb7a00640 1 --2- 172.21.15.6:0/1806671148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8fb00af060 0x7f8fb01f5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.996+0000 7f8fb7a00640 1 --2- 172.21.15.6:0/1806671148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8fb006f090 0x7f8fb00c7710 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.996+0000 7f8fb7a00640 1 -- 172.21.15.6:0/1806671148 >> 172.21.15.6:0/1806671148 conn(0x7f8fb00cfa20 msgr2=0x7f8fb006fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:17.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.996+0000 7f8fb7a00640 1 -- 172.21.15.6:0/1806671148 shutdown_connections 2024-09-10T20:57:17.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:16.996+0000 7f8fb7a00640 1 -- 172.21.15.6:0/1806671148 wait complete. 2024-09-10T20:57:17.015 INFO:tasks.ceph:Scrubbing osd.1 2024-09-10T20:57:17.015 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-10T20:57:17.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.177+0000 7fbf24600640 1 -- 172.21.15.6:0/1999970415 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf1c06fe40 msgr2=0x7fbf1c070220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:17.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.177+0000 7fbf24600640 1 --2- 172.21.15.6:0/1999970415 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf1c06fe40 0x7fbf1c070220 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbf10009830 tx=0x7fbf1002a510 comp rx=0 tx=0).stop 2024-09-10T20:57:17.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.177+0000 7fbf24600640 1 -- 172.21.15.6:0/1999970415 shutdown_connections 2024-09-10T20:57:17.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.177+0000 7fbf24600640 1 --2- 172.21.15.6:0/1999970415 >> v2:172.21.15.150:3300/0 conn(0x7fbf1c0ca310 0x7fbf1c0ca780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.177+0000 7fbf24600640 1 --2- 172.21.15.6:0/1999970415 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf1c06fe40 0x7fbf1c070220 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.177+0000 7fbf24600640 1 -- 172.21.15.6:0/1999970415 >> 172.21.15.6:0/1999970415 conn(0x7fbf1c0cfa20 msgr2=0x7fbf1c0cfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:17.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.177+0000 7fbf24600640 1 -- 172.21.15.6:0/1999970415 shutdown_connections 2024-09-10T20:57:17.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.177+0000 7fbf24600640 1 -- 172.21.15.6:0/1999970415 wait complete. 2024-09-10T20:57:17.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.179+0000 7fbf24600640 1 Processor -- start 2024-09-10T20:57:17.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.179+0000 7fbf24600640 1 -- start start 2024-09-10T20:57:17.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.180+0000 7fbf24600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf1c06fe40 0x7fbf1c1f7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:17.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.180+0000 7fbf24600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf1c0ca310 0x7fbf1c159f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:17.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.180+0000 7fbf24600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf1c15bce0 0x7fbf1c15a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:17.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.180+0000 7fbf24600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbf1c0cb050 con 0x7fbf1c06fe40 2024-09-10T20:57:17.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.180+0000 7fbf24600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbf1c0caed0 con 0x7fbf1c0ca310 2024-09-10T20:57:17.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.180+0000 7fbf24600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fbf1c0cb1d0 con 0x7fbf1c15bce0 2024-09-10T20:57:17.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.180+0000 7fbf21c00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf1c06fe40 0x7fbf1c1f7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:17.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.180+0000 7fbf21c00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf1c06fe40 0x7fbf1c1f7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47476/0 (socket says 172.21.15.6:47476) 2024-09-10T20:57:17.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.180+0000 7fbf21c00640 1 -- 172.21.15.6:0/3951552735 learned_addr learned my addr 172.21.15.6:0/3951552735 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:17.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.180+0000 7fbf22600640 1 --2- 172.21.15.6:0/3951552735 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf1c15bce0 0x7fbf1c15a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:17.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.180+0000 7fbf21200640 1 --2- 172.21.15.6:0/3951552735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf1c0ca310 0x7fbf1c159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:17.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.180+0000 7fbf21c00640 1 -- 172.21.15.6:0/3951552735 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf1c15bce0 msgr2=0x7fbf1c15a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:17.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.180+0000 7fbf21c00640 1 --2- 172.21.15.6:0/3951552735 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf1c15bce0 0x7fbf1c15a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.180+0000 7fbf21c00640 1 -- 172.21.15.6:0/3951552735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf1c0ca310 msgr2=0x7fbf1c159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:17.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.180+0000 7fbf21c00640 1 --2- 172.21.15.6:0/3951552735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf1c0ca310 0x7fbf1c159f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.180+0000 7fbf21c00640 1 -- 172.21.15.6:0/3951552735 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf1c1559f0 con 0x7fbf1c06fe40 2024-09-10T20:57:17.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.180+0000 7fbf22600640 1 --2- 172.21.15.6:0/3951552735 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf1c15bce0 0x7fbf1c15a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:57:17.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.181+0000 7fbf21c00640 1 --2- 172.21.15.6:0/3951552735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf1c06fe40 0x7fbf1c1f7c90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fbf10009950 tx=0x7fbf10032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:17.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.181+0000 7fbf19600640 1 -- 172.21.15.6:0/3951552735 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf10040070 con 0x7fbf1c06fe40 2024-09-10T20:57:17.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.181+0000 7fbf19600640 1 -- 172.21.15.6:0/3951552735 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf10005310 con 0x7fbf1c06fe40 2024-09-10T20:57:17.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.181+0000 7fbf19600640 1 -- 172.21.15.6:0/3951552735 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf10005c90 con 0x7fbf1c06fe40 2024-09-10T20:57:17.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.181+0000 7fbf24600640 1 -- 172.21.15.6:0/3951552735 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf1c158d30 con 0x7fbf1c06fe40 2024-09-10T20:57:17.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.181+0000 7fbf24600640 1 -- 172.21.15.6:0/3951552735 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf1c1f85e0 con 0x7fbf1c06fe40 2024-09-10T20:57:17.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.182+0000 7fbf24600640 1 -- 172.21.15.6:0/3951552735 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbf1c070220 con 0x7fbf1c06fe40 2024-09-10T20:57:17.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.183+0000 7fbf19600640 1 -- 172.21.15.6:0/3951552735 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fbf100049b0 con 0x7fbf1c06fe40 2024-09-10T20:57:17.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.184+0000 7fbf19600640 1 --2- 172.21.15.6:0/3951552735 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbefc077f70 0x7fbefc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:17.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.184+0000 7fbf19600640 1 -- 172.21.15.6:0/3951552735 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4943+0+0 (secure 0 0 0) 0x7fbf100bafe0 con 0x7fbf1c06fe40 2024-09-10T20:57:17.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.184+0000 7fbf19600640 1 --2- 172.21.15.6:0/3951552735 >> [v2:172.21.15.6:6808/1129113250,v1:172.21.15.6:6809/1129113250] conn(0x7fbefc07de30 0x7fbefc080250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:17.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.184+0000 7fbf19600640 1 -- 172.21.15.6:0/3951552735 --> [v2:172.21.15.6:6808/1129113250,v1:172.21.15.6:6809/1129113250] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbf10030e50 con 0x7fbefc07de30 2024-09-10T20:57:17.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.184+0000 7fbf19600640 1 -- 172.21.15.6:0/3951552735 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fbf100bd600 con 0x7fbf1c06fe40 2024-09-10T20:57:17.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.185+0000 7fbf22600640 1 --2- 172.21.15.6:0/3951552735 >> [v2:172.21.15.6:6808/1129113250,v1:172.21.15.6:6809/1129113250] conn(0x7fbefc07de30 0x7fbefc080250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:17.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.185+0000 7fbf21200640 1 --2- 172.21.15.6:0/3951552735 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbefc077f70 0x7fbefc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:17.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.185+0000 7fbf22600640 1 --2- 172.21.15.6:0/3951552735 >> [v2:172.21.15.6:6808/1129113250,v1:172.21.15.6:6809/1129113250] conn(0x7fbefc07de30 0x7fbefc080250 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:17.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.186+0000 7fbf21200640 1 --2- 172.21.15.6:0/3951552735 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbefc077f70 0x7fbefc07a430 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c1558b0 tx=0x7fbf08001390 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:17.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.186+0000 7fbf19600640 1 -- 172.21.15.6:0/3951552735 <== osd.1 v2:172.21.15.6:6808/1129113250 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbf10030e50 con 0x7fbefc07de30 2024-09-10T20:57:17.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.200+0000 7fbf24600640 1 -- 172.21.15.6:0/3951552735 --> [v2:172.21.15.6:6808/1129113250,v1:172.21.15.6:6809/1129113250] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbf1c0cd840 con 0x7fbefc07de30 2024-09-10T20:57:17.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.200+0000 7fbf19600640 1 -- 172.21.15.6:0/3951552735 <== osd.1 v2:172.21.15.6:6808/1129113250 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbf1c0cd840 con 0x7fbefc07de30 2024-09-10T20:57:17.205 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-10T20:57:17.205 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T20:57:17.205 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-10T20:57:17.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.201+0000 7fbf24600640 1 -- 172.21.15.6:0/3951552735 >> [v2:172.21.15.6:6808/1129113250,v1:172.21.15.6:6809/1129113250] conn(0x7fbefc07de30 msgr2=0x7fbefc080250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:17.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.201+0000 7fbf24600640 1 --2- 172.21.15.6:0/3951552735 >> [v2:172.21.15.6:6808/1129113250,v1:172.21.15.6:6809/1129113250] conn(0x7fbefc07de30 0x7fbefc080250 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.201+0000 7fbf24600640 1 -- 172.21.15.6:0/3951552735 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbefc077f70 msgr2=0x7fbefc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:17.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.201+0000 7fbf24600640 1 --2- 172.21.15.6:0/3951552735 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fbefc077f70 0x7fbefc07a430 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c1558b0 tx=0x7fbf08001390 comp rx=0 tx=0).stop 2024-09-10T20:57:17.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.201+0000 7fbf24600640 1 -- 172.21.15.6:0/3951552735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf1c06fe40 msgr2=0x7fbf1c1f7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:17.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.201+0000 7fbf24600640 1 --2- 172.21.15.6:0/3951552735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf1c06fe40 0x7fbf1c1f7c90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fbf10009950 tx=0x7fbf10032c10 comp rx=0 tx=0).stop 2024-09-10T20:57:17.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.201+0000 7fbf22600640 1 -- 172.21.15.6:0/3951552735 reap_dead start 2024-09-10T20:57:17.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.201+0000 7fbf24600640 1 -- 172.21.15.6:0/3951552735 shutdown_connections 2024-09-10T20:57:17.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.201+0000 7fbf24600640 1 -- 172.21.15.6:0/3951552735 >> 172.21.15.6:0/3951552735 conn(0x7fbf1c0cfa20 msgr2=0x7fbf1c0b4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:17.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.201+0000 7fbf24600640 1 -- 172.21.15.6:0/3951552735 shutdown_connections 2024-09-10T20:57:17.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.201+0000 7fbf24600640 1 -- 172.21.15.6:0/3951552735 wait complete. 2024-09-10T20:57:17.220 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-10T20:57:17.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.378+0000 7fb836600640 1 -- 172.21.15.6:0/3065893717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb830162130 msgr2=0x7fb8300ad880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:17.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.378+0000 7fb836600640 1 --2- 172.21.15.6:0/3065893717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb830162130 0x7fb8300ad880 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb8300cee90 tx=0x7fb82802aa90 comp rx=0 tx=0).stop 2024-09-10T20:57:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.378+0000 7fb836600640 1 -- 172.21.15.6:0/3065893717 shutdown_connections 2024-09-10T20:57:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.378+0000 7fb836600640 1 --2- 172.21.15.6:0/3065893717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb830162130 0x7fb8300ad880 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.378+0000 7fb836600640 1 --2- 172.21.15.6:0/3065893717 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb83015bb30 0x7fb8300cf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.378+0000 7fb836600640 1 -- 172.21.15.6:0/3065893717 >> 172.21.15.6:0/3065893717 conn(0x7fb8300cfa20 msgr2=0x7fb8300cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.378+0000 7fb836600640 1 -- 172.21.15.6:0/3065893717 shutdown_connections 2024-09-10T20:57:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.378+0000 7fb836600640 1 -- 172.21.15.6:0/3065893717 wait complete. 2024-09-10T20:57:17.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.380+0000 7fb836600640 1 Processor -- start 2024-09-10T20:57:17.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.380+0000 7fb836600640 1 -- start start 2024-09-10T20:57:17.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.380+0000 7fb836600640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8300caa40 0x7fb8300c7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:17.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.381+0000 7fb836600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb83015bb30 0x7fb830157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:17.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.381+0000 7fb836600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb830162130 0x7fb830159b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:17.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.381+0000 7fb836600640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb8300ae190 con 0x7fb8300caa40 2024-09-10T20:57:17.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.381+0000 7fb836600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb8300ae010 con 0x7fb83015bb30 2024-09-10T20:57:17.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.381+0000 7fb836600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb8300ae310 con 0x7fb830162130 2024-09-10T20:57:17.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.381+0000 7fb82f400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8300caa40 0x7fb8300c7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:17.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.381+0000 7fb82f400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8300caa40 0x7fb8300c7730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47484/0 (socket says 172.21.15.6:47484) 2024-09-10T20:57:17.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.381+0000 7fb82f400640 1 -- 172.21.15.6:0/1203183056 learned_addr learned my addr 172.21.15.6:0/1203183056 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:17.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.381+0000 7fb82fe00640 1 --2- 172.21.15.6:0/1203183056 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb830162130 0x7fb830159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:17.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.381+0000 7fb82f400640 1 -- 172.21.15.6:0/1203183056 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb830162130 msgr2=0x7fb830159b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:17.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.381+0000 7fb82f400640 1 --2- 172.21.15.6:0/1203183056 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb830162130 0x7fb830159b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.381+0000 7fb82f400640 1 -- 172.21.15.6:0/1203183056 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb83015bb30 msgr2=0x7fb830157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:17.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.381+0000 7fb82ea00640 1 --2- 172.21.15.6:0/1203183056 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb83015bb30 0x7fb830157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:17.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.381+0000 7fb82f400640 1 --2- 172.21.15.6:0/1203183056 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb83015bb30 0x7fb830157d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.381+0000 7fb82f400640 1 -- 172.21.15.6:0/1203183056 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8300c8030 con 0x7fb8300caa40 2024-09-10T20:57:17.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.381+0000 7fb82ea00640 1 --2- 172.21.15.6:0/1203183056 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb83015bb30 0x7fb830157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:57:17.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.382+0000 7fb82f400640 1 --2- 172.21.15.6:0/1203183056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8300caa40 0x7fb8300c7730 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb82000e9f0 tx=0x7fb82000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:17.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.382+0000 7fb827400640 1 -- 172.21.15.6:0/1203183056 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb82000cd80 con 0x7fb8300caa40 2024-09-10T20:57:17.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.382+0000 7fb827400640 1 -- 172.21.15.6:0/1203183056 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb820010430 con 0x7fb8300caa40 2024-09-10T20:57:17.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.382+0000 7fb827400640 1 -- 172.21.15.6:0/1203183056 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb820010840 con 0x7fb8300caa40 2024-09-10T20:57:17.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.382+0000 7fb836600640 1 -- 172.21.15.6:0/1203183056 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8300c8310 con 0x7fb8300caa40 2024-09-10T20:57:17.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.382+0000 7fb836600640 1 -- 172.21.15.6:0/1203183056 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8300b4390 con 0x7fb8300caa40 2024-09-10T20:57:17.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.383+0000 7fb836600640 1 -- 172.21.15.6:0/1203183056 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8300ae7c0 con 0x7fb8300caa40 2024-09-10T20:57:17.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.384+0000 7fb827400640 1 -- 172.21.15.6:0/1203183056 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb8200109e0 con 0x7fb8300caa40 2024-09-10T20:57:17.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.385+0000 7fb827400640 1 --2- 172.21.15.6:0/1203183056 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb810077f70 0x7fb81007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:17.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.385+0000 7fb827400640 1 -- 172.21.15.6:0/1203183056 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4943+0+0 (secure 0 0 0) 0x7fb82009a5e0 con 0x7fb8300caa40 2024-09-10T20:57:17.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.385+0000 7fb82ea00640 1 --2- 172.21.15.6:0/1203183056 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb810077f70 0x7fb81007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:17.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.386+0000 7fb82ea00640 1 --2- 172.21.15.6:0/1203183056 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb810077f70 0x7fb81007a430 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb830074690 tx=0x7fb81c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:17.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.389+0000 7fb827400640 1 -- 172.21.15.6:0/1203183056 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb820063490 con 0x7fb8300caa40 2024-09-10T20:57:17.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.582+0000 7fb836600640 1 -- 172.21.15.6:0/1203183056 --> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fb830069d20 con 0x7fb810077f70 2024-09-10T20:57:17.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.583+0000 7fb827400640 1 -- 172.21.15.6:0/1203183056 <== mgr.4120 v2:172.21.15.150:6800/1238179351 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb830069d20 con 0x7fb810077f70 2024-09-10T20:57:17.587 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 1 to deep-scrub 2024-09-10T20:57:17.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.585+0000 7fb836600640 1 -- 172.21.15.6:0/1203183056 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb810077f70 msgr2=0x7fb81007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:17.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.585+0000 7fb836600640 1 --2- 172.21.15.6:0/1203183056 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb810077f70 0x7fb81007a430 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb830074690 tx=0x7fb81c009040 comp rx=0 tx=0).stop 2024-09-10T20:57:17.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.585+0000 7fb836600640 1 -- 172.21.15.6:0/1203183056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8300caa40 msgr2=0x7fb8300c7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:17.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.585+0000 7fb836600640 1 --2- 172.21.15.6:0/1203183056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8300caa40 0x7fb8300c7730 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb82000e9f0 tx=0x7fb82000eeb0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.585+0000 7fb836600640 1 -- 172.21.15.6:0/1203183056 shutdown_connections 2024-09-10T20:57:17.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.585+0000 7fb836600640 1 --2- 172.21.15.6:0/1203183056 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb810077f70 0x7fb81007a430 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.585+0000 7fb836600640 1 --2- 172.21.15.6:0/1203183056 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb830162130 0x7fb830159b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.585+0000 7fb836600640 1 --2- 172.21.15.6:0/1203183056 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb83015bb30 0x7fb830157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.585+0000 7fb836600640 1 --2- 172.21.15.6:0/1203183056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8300caa40 0x7fb8300c7730 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.585+0000 7fb836600640 1 -- 172.21.15.6:0/1203183056 >> 172.21.15.6:0/1203183056 conn(0x7fb8300cfa20 msgr2=0x7fb830072730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:17.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.585+0000 7fb836600640 1 -- 172.21.15.6:0/1203183056 shutdown_connections 2024-09-10T20:57:17.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.585+0000 7fb836600640 1 -- 172.21.15.6:0/1203183056 wait complete. 2024-09-10T20:57:17.604 INFO:tasks.ceph:Scrubbing osd.2 2024-09-10T20:57:17.604 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-10T20:57:17.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.766+0000 7fc71a200640 1 -- 172.21.15.6:0/2353674968 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7140d2080 msgr2=0x7fc7140ce3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:17.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.766+0000 7fc71a200640 1 --2- 172.21.15.6:0/2353674968 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7140d2080 0x7fc7140ce3d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc009830 tx=0x7fc6fc02a510 comp rx=0 tx=0).stop 2024-09-10T20:57:17.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.766+0000 7fc71a200640 1 -- 172.21.15.6:0/2353674968 shutdown_connections 2024-09-10T20:57:17.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.766+0000 7fc71a200640 1 --2- 172.21.15.6:0/2353674968 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7140cc050 0x7fc7140ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.766+0000 7fc71a200640 1 --2- 172.21.15.6:0/2353674968 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7140d2080 0x7fc7140ce3d0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.766+0000 7fc71a200640 1 -- 172.21.15.6:0/2353674968 >> 172.21.15.6:0/2353674968 conn(0x7fc71409aa00 msgr2=0x7fc71409ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:17.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.766+0000 7fc71a200640 1 -- 172.21.15.6:0/2353674968 shutdown_connections 2024-09-10T20:57:17.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.766+0000 7fc71a200640 1 -- 172.21.15.6:0/2353674968 wait complete. 2024-09-10T20:57:17.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.768+0000 7fc71a200640 1 Processor -- start 2024-09-10T20:57:17.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.768+0000 7fc71a200640 1 -- start start 2024-09-10T20:57:17.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.769+0000 7fc71a200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7140cc050 0x7fc714152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:17.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.769+0000 7fc71a200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7140d2080 0x7fc7140b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:17.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.769+0000 7fc71a200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc71415dda0 0x7fc7140b6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:17.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.769+0000 7fc71a200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc7140d0c10 con 0x7fc7140cc050 2024-09-10T20:57:17.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.769+0000 7fc71a200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc7140d0a90 con 0x7fc7140d2080 2024-09-10T20:57:17.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.769+0000 7fc71a200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fc7140d0d90 con 0x7fc71415dda0 2024-09-10T20:57:17.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.769+0000 7fc718e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7140cc050 0x7fc714152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:17.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.769+0000 7fc718e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7140cc050 0x7fc714152a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47502/0 (socket says 172.21.15.6:47502) 2024-09-10T20:57:17.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.769+0000 7fc718e00640 1 -- 172.21.15.6:0/4173119063 learned_addr learned my addr 172.21.15.6:0/4173119063 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:17.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.769+0000 7fc719800640 1 --2- 172.21.15.6:0/4173119063 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc71415dda0 0x7fc7140b6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:17.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.769+0000 7fc718e00640 1 -- 172.21.15.6:0/4173119063 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc71415dda0 msgr2=0x7fc7140b6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:17.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.769+0000 7fc70be00640 1 --2- 172.21.15.6:0/4173119063 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7140d2080 0x7fc7140b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:17.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.769+0000 7fc718e00640 1 --2- 172.21.15.6:0/4173119063 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc71415dda0 0x7fc7140b6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.769+0000 7fc718e00640 1 -- 172.21.15.6:0/4173119063 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7140d2080 msgr2=0x7fc7140b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:17.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.769+0000 7fc718e00640 1 --2- 172.21.15.6:0/4173119063 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7140d2080 0x7fc7140b5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.769+0000 7fc718e00640 1 -- 172.21.15.6:0/4173119063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7140b49d0 con 0x7fc7140cc050 2024-09-10T20:57:17.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.769+0000 7fc719800640 1 --2- 172.21.15.6:0/4173119063 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc71415dda0 0x7fc7140b6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:57:17.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.769+0000 7fc70be00640 1 --2- 172.21.15.6:0/4173119063 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7140d2080 0x7fc7140b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:57:17.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.770+0000 7fc718e00640 1 --2- 172.21.15.6:0/4173119063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7140cc050 0x7fc714152a60 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc70400c3a0 tx=0x7fc70400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:17.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.770+0000 7fc711600640 1 -- 172.21.15.6:0/4173119063 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc704011790 con 0x7fc7140cc050 2024-09-10T20:57:17.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.770+0000 7fc711600640 1 -- 172.21.15.6:0/4173119063 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc704017070 con 0x7fc7140cc050 2024-09-10T20:57:17.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.770+0000 7fc711600640 1 -- 172.21.15.6:0/4173119063 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc704011cc0 con 0x7fc7140cc050 2024-09-10T20:57:17.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.770+0000 7fc71a200640 1 -- 172.21.15.6:0/4173119063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7140b4cb0 con 0x7fc7140cc050 2024-09-10T20:57:17.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.770+0000 7fc71a200640 1 -- 172.21.15.6:0/4173119063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7140b5270 con 0x7fc7140cc050 2024-09-10T20:57:17.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.771+0000 7fc71a200640 1 -- 172.21.15.6:0/4173119063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc7140713f0 con 0x7fc7140cc050 2024-09-10T20:57:17.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.772+0000 7fc711600640 1 -- 172.21.15.6:0/4173119063 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc70401c460 con 0x7fc7140cc050 2024-09-10T20:57:17.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.773+0000 7fc711600640 1 --2- 172.21.15.6:0/4173119063 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fc6f0077fa0 0x7fc6f007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:17.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.773+0000 7fc711600640 1 -- 172.21.15.6:0/4173119063 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4943+0+0 (secure 0 0 0) 0x7fc704099870 con 0x7fc7140cc050 2024-09-10T20:57:17.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.774+0000 7fc711600640 1 --2- 172.21.15.6:0/4173119063 >> [v2:172.21.15.6:6824/3847470051,v1:172.21.15.6:6825/3847470051] conn(0x7fc6f007de60 0x7fc6f0080280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:17.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.774+0000 7fc711600640 1 -- 172.21.15.6:0/4173119063 --> [v2:172.21.15.6:6824/3847470051,v1:172.21.15.6:6825/3847470051] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc704020e50 con 0x7fc6f007de60 2024-09-10T20:57:17.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.774+0000 7fc711600640 1 -- 172.21.15.6:0/4173119063 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fc70409e2a0 con 0x7fc7140cc050 2024-09-10T20:57:17.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.774+0000 7fc719800640 1 --2- 172.21.15.6:0/4173119063 >> [v2:172.21.15.6:6824/3847470051,v1:172.21.15.6:6825/3847470051] conn(0x7fc6f007de60 0x7fc6f0080280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:17.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.774+0000 7fc70be00640 1 --2- 172.21.15.6:0/4173119063 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fc6f0077fa0 0x7fc6f007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:17.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.775+0000 7fc719800640 1 --2- 172.21.15.6:0/4173119063 >> [v2:172.21.15.6:6824/3847470051,v1:172.21.15.6:6825/3847470051] conn(0x7fc6f007de60 0x7fc6f0080280 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:17.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.775+0000 7fc70be00640 1 --2- 172.21.15.6:0/4173119063 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fc6f0077fa0 0x7fc6f007a460 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc034000 tx=0x7fc6fc004730 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:17.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.775+0000 7fc711600640 1 -- 172.21.15.6:0/4173119063 <== osd.2 v2:172.21.15.6:6824/3847470051 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc704020e50 con 0x7fc6f007de60 2024-09-10T20:57:17.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.789+0000 7fc71a200640 1 -- 172.21.15.6:0/4173119063 --> [v2:172.21.15.6:6824/3847470051,v1:172.21.15.6:6825/3847470051] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc71406c580 con 0x7fc6f007de60 2024-09-10T20:57:17.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.789+0000 7fc711600640 1 -- 172.21.15.6:0/4173119063 <== osd.2 v2:172.21.15.6:6824/3847470051 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc71406c580 con 0x7fc6f007de60 2024-09-10T20:57:17.793 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-10T20:57:17.793 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T20:57:17.793 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-10T20:57:17.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.789+0000 7fc71a200640 1 -- 172.21.15.6:0/4173119063 >> [v2:172.21.15.6:6824/3847470051,v1:172.21.15.6:6825/3847470051] conn(0x7fc6f007de60 msgr2=0x7fc6f0080280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:17.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.789+0000 7fc71a200640 1 --2- 172.21.15.6:0/4173119063 >> [v2:172.21.15.6:6824/3847470051,v1:172.21.15.6:6825/3847470051] conn(0x7fc6f007de60 0x7fc6f0080280 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.789+0000 7fc71a200640 1 -- 172.21.15.6:0/4173119063 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fc6f0077fa0 msgr2=0x7fc6f007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:17.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.789+0000 7fc71a200640 1 --2- 172.21.15.6:0/4173119063 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fc6f0077fa0 0x7fc6f007a460 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc034000 tx=0x7fc6fc004730 comp rx=0 tx=0).stop 2024-09-10T20:57:17.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.790+0000 7fc71a200640 1 -- 172.21.15.6:0/4173119063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7140cc050 msgr2=0x7fc714152a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:17.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.790+0000 7fc71a200640 1 --2- 172.21.15.6:0/4173119063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7140cc050 0x7fc714152a60 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc70400c3a0 tx=0x7fc70400c860 comp rx=0 tx=0).stop 2024-09-10T20:57:17.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.790+0000 7fc719800640 1 -- 172.21.15.6:0/4173119063 reap_dead start 2024-09-10T20:57:17.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.790+0000 7fc71a200640 1 -- 172.21.15.6:0/4173119063 shutdown_connections 2024-09-10T20:57:17.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.790+0000 7fc71a200640 1 -- 172.21.15.6:0/4173119063 >> 172.21.15.6:0/4173119063 conn(0x7fc71409aa00 msgr2=0x7fc7140ccaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:17.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.790+0000 7fc71a200640 1 -- 172.21.15.6:0/4173119063 shutdown_connections 2024-09-10T20:57:17.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.790+0000 7fc71a200640 1 -- 172.21.15.6:0/4173119063 wait complete. 2024-09-10T20:57:17.808 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-10T20:57:17.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.967+0000 7fc3e6a00640 1 -- 172.21.15.6:0/1572496598 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3e00ce510 msgr2=0x7fc3e0072400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:17.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.967+0000 7fc3e6a00640 1 --2- 172.21.15.6:0/1572496598 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3e00ce510 0x7fc3e0072400 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc3e00cf510 tx=0x7fc3cc02a560 comp rx=0 tx=0).stop 2024-09-10T20:57:17.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.967+0000 7fc3e6a00640 1 -- 172.21.15.6:0/1572496598 shutdown_connections 2024-09-10T20:57:17.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.967+0000 7fc3e6a00640 1 --2- 172.21.15.6:0/1572496598 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3e00ce510 0x7fc3e0072400 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.967+0000 7fc3e6a00640 1 --2- 172.21.15.6:0/1572496598 >> v2:172.21.15.150:3300/0 conn(0x7fc3e015e4b0 0x7fc3e015e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.967+0000 7fc3e6a00640 1 -- 172.21.15.6:0/1572496598 >> 172.21.15.6:0/1572496598 conn(0x7fc3e006d660 msgr2=0x7fc3e00b1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:17.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.967+0000 7fc3e6a00640 1 -- 172.21.15.6:0/1572496598 shutdown_connections 2024-09-10T20:57:17.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.967+0000 7fc3e6a00640 1 -- 172.21.15.6:0/1572496598 wait complete. 2024-09-10T20:57:17.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.969+0000 7fc3e6a00640 1 Processor -- start 2024-09-10T20:57:17.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.969+0000 7fc3e6a00640 1 -- start start 2024-09-10T20:57:17.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.970+0000 7fc3e6a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3e00ce510 0x7fc3e0158980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:17.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.970+0000 7fc3e6a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3e0154d60 0x7fc3e01439e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:17.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.970+0000 7fc3e6a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3e015e4b0 0x7fc3e01f7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:17.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.970+0000 7fc3e6a00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e006f9e0 con 0x7fc3e015e4b0 2024-09-10T20:57:17.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.970+0000 7fc3e6a00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e006f860 con 0x7fc3e00ce510 2024-09-10T20:57:17.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.970+0000 7fc3e6a00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fc3e006fb60 con 0x7fc3e0154d60 2024-09-10T20:57:17.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.970+0000 7fc3e6000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3e015e4b0 0x7fc3e01f7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:17.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.970+0000 7fc3e6000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3e015e4b0 0x7fc3e01f7ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45208/0 (socket says 172.21.15.6:45208) 2024-09-10T20:57:17.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.970+0000 7fc3e6000640 1 -- 172.21.15.6:0/2777010734 learned_addr learned my addr 172.21.15.6:0/2777010734 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:17.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.970+0000 7fc3e4c00640 1 --2- 172.21.15.6:0/2777010734 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3e0154d60 0x7fc3e01439e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:17.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.970+0000 7fc3e5600640 1 --2- 172.21.15.6:0/2777010734 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3e00ce510 0x7fc3e0158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:17.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.970+0000 7fc3e6000640 1 -- 172.21.15.6:0/2777010734 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3e0154d60 msgr2=0x7fc3e01439e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:17.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.970+0000 7fc3e6000640 1 --2- 172.21.15.6:0/2777010734 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3e0154d60 0x7fc3e01439e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.970+0000 7fc3e6000640 1 -- 172.21.15.6:0/2777010734 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3e00ce510 msgr2=0x7fc3e0158980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:17.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.970+0000 7fc3e6000640 1 --2- 172.21.15.6:0/2777010734 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3e00ce510 0x7fc3e0158980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.970+0000 7fc3e6000640 1 -- 172.21.15.6:0/2777010734 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3e0158ec0 con 0x7fc3e015e4b0 2024-09-10T20:57:17.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.971+0000 7fc3e6000640 1 --2- 172.21.15.6:0/2777010734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3e015e4b0 0x7fc3e01f7ad0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc3d800e960 tx=0x7fc3d800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:17.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.971+0000 7fc3dd600640 1 -- 172.21.15.6:0/2777010734 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d8004d20 con 0x7fc3e015e4b0 2024-09-10T20:57:17.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.971+0000 7fc3dd600640 1 -- 172.21.15.6:0/2777010734 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc3d800cb20 con 0x7fc3e015e4b0 2024-09-10T20:57:17.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.971+0000 7fc3dd600640 1 -- 172.21.15.6:0/2777010734 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d8005020 con 0x7fc3e015e4b0 2024-09-10T20:57:17.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.971+0000 7fc3e6a00640 1 -- 172.21.15.6:0/2777010734 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3e015a780 con 0x7fc3e015e4b0 2024-09-10T20:57:17.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.971+0000 7fc3e6a00640 1 -- 172.21.15.6:0/2777010734 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3e015afc0 con 0x7fc3e015e4b0 2024-09-10T20:57:17.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.972+0000 7fc3e6a00640 1 -- 172.21.15.6:0/2777010734 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3e006fff0 con 0x7fc3e015e4b0 2024-09-10T20:57:17.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.973+0000 7fc3dd600640 1 -- 172.21.15.6:0/2777010734 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc3d800f040 con 0x7fc3e015e4b0 2024-09-10T20:57:17.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.975+0000 7fc3dd600640 1 --2- 172.21.15.6:0/2777010734 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fc3c0077f70 0x7fc3c007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:17.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.975+0000 7fc3dd600640 1 -- 172.21.15.6:0/2777010734 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4943+0+0 (secure 0 0 0) 0x7fc3d809a0a0 con 0x7fc3e015e4b0 2024-09-10T20:57:17.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.975+0000 7fc3e5600640 1 --2- 172.21.15.6:0/2777010734 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fc3c0077f70 0x7fc3c007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:17.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.976+0000 7fc3e5600640 1 --2- 172.21.15.6:0/2777010734 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fc3c0077f70 0x7fc3c007a430 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc3d40017c0 tx=0x7fc3d4009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:17.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:17.979+0000 7fc3dd600640 1 -- 172.21.15.6:0/2777010734 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc3e015a780 con 0x7fc3e015e4b0 2024-09-10T20:57:18.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.174+0000 7fc3e6a00640 1 -- 172.21.15.6:0/2777010734 --> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fc3e006e420 con 0x7fc3c0077f70 2024-09-10T20:57:18.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.174+0000 7fc3dd600640 1 -- 172.21.15.6:0/2777010734 <== mgr.4120 v2:172.21.15.150:6800/1238179351 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc3e006e420 con 0x7fc3c0077f70 2024-09-10T20:57:18.179 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 2 to deep-scrub 2024-09-10T20:57:18.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.177+0000 7fc3e6a00640 1 -- 172.21.15.6:0/2777010734 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fc3c0077f70 msgr2=0x7fc3c007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:18.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.177+0000 7fc3e6a00640 1 --2- 172.21.15.6:0/2777010734 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fc3c0077f70 0x7fc3c007a430 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc3d40017c0 tx=0x7fc3d4009040 comp rx=0 tx=0).stop 2024-09-10T20:57:18.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.177+0000 7fc3e6a00640 1 -- 172.21.15.6:0/2777010734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3e015e4b0 msgr2=0x7fc3e01f7ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:18.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.177+0000 7fc3e6a00640 1 --2- 172.21.15.6:0/2777010734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3e015e4b0 0x7fc3e01f7ad0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc3d800e960 tx=0x7fc3d800ee20 comp rx=0 tx=0).stop 2024-09-10T20:57:18.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.177+0000 7fc3e6a00640 1 -- 172.21.15.6:0/2777010734 shutdown_connections 2024-09-10T20:57:18.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.177+0000 7fc3e6a00640 1 --2- 172.21.15.6:0/2777010734 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fc3c0077f70 0x7fc3c007a430 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:18.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.177+0000 7fc3e6a00640 1 --2- 172.21.15.6:0/2777010734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3e015e4b0 0x7fc3e01f7ad0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:18.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.177+0000 7fc3e6a00640 1 --2- 172.21.15.6:0/2777010734 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3e0154d60 0x7fc3e01439e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:18.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.177+0000 7fc3e6a00640 1 --2- 172.21.15.6:0/2777010734 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3e00ce510 0x7fc3e0158980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:18.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.177+0000 7fc3e6a00640 1 -- 172.21.15.6:0/2777010734 >> 172.21.15.6:0/2777010734 conn(0x7fc3e006d660 msgr2=0x7fc3e015f940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:18.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.177+0000 7fc3e6a00640 1 -- 172.21.15.6:0/2777010734 shutdown_connections 2024-09-10T20:57:18.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.177+0000 7fc3e6a00640 1 -- 172.21.15.6:0/2777010734 wait complete. 2024-09-10T20:57:18.196 INFO:tasks.ceph:Scrubbing osd.3 2024-09-10T20:57:18.197 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-10T20:57:18.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.359+0000 7fb3d8000640 1 -- 172.21.15.6:0/1227407259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3d006fe90 msgr2=0x7fb3d0070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:18.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.359+0000 7fb3d8000640 1 --2- 172.21.15.6:0/1227407259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3d006fe90 0x7fb3d0070270 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb3d00cc440 tx=0x7fb3c402a5f0 comp rx=0 tx=0).stop 2024-09-10T20:57:18.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.359+0000 7fb3d8000640 1 -- 172.21.15.6:0/1227407259 shutdown_connections 2024-09-10T20:57:18.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.359+0000 7fb3d8000640 1 --2- 172.21.15.6:0/1227407259 >> v2:172.21.15.150:3300/0 conn(0x7fb3d00cef10 0x7fb3d00cac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:18.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.359+0000 7fb3d8000640 1 --2- 172.21.15.6:0/1227407259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3d006fe90 0x7fb3d0070270 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:18.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.359+0000 7fb3d8000640 1 -- 172.21.15.6:0/1227407259 >> 172.21.15.6:0/1227407259 conn(0x7fb3d00cfa20 msgr2=0x7fb3d00cfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:18.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.359+0000 7fb3d8000640 1 -- 172.21.15.6:0/1227407259 shutdown_connections 2024-09-10T20:57:18.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.359+0000 7fb3d8000640 1 -- 172.21.15.6:0/1227407259 wait complete. 2024-09-10T20:57:18.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.361+0000 7fb3d8000640 1 Processor -- start 2024-09-10T20:57:18.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.361+0000 7fb3d8000640 1 -- start start 2024-09-10T20:57:18.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.362+0000 7fb3d8000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3d006fe90 0x7fb3d01f5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:18.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.362+0000 7fb3d8000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3d00ca070 0x7fb3d00b5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:18.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.362+0000 7fb3d8000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3d00cef10 0x7fb3d00c59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:18.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.362+0000 7fb3d8000640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d00cb170 con 0x7fb3d00ca070 2024-09-10T20:57:18.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.362+0000 7fb3d8000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d015ae30 con 0x7fb3d006fe90 2024-09-10T20:57:18.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.362+0000 7fb3d8000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb3d00cb2f0 con 0x7fb3d00cef10 2024-09-10T20:57:18.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.362+0000 7fb3d4c00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3d00ca070 0x7fb3d00b5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:18.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.362+0000 7fb3d4c00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3d00ca070 0x7fb3d00b5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45228/0 (socket says 172.21.15.6:45228) 2024-09-10T20:57:18.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.362+0000 7fb3d4c00640 1 -- 172.21.15.6:0/1290143114 learned_addr learned my addr 172.21.15.6:0/1290143114 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:18.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.362+0000 7fb3d5600640 1 --2- 172.21.15.6:0/1290143114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3d006fe90 0x7fb3d01f5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:18.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.362+0000 7fb3d6000640 1 --2- 172.21.15.6:0/1290143114 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3d00cef10 0x7fb3d00c59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:18.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.362+0000 7fb3d4c00640 1 -- 172.21.15.6:0/1290143114 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3d00cef10 msgr2=0x7fb3d00c59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:18.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.362+0000 7fb3d4c00640 1 --2- 172.21.15.6:0/1290143114 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3d00cef10 0x7fb3d00c59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:18.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.362+0000 7fb3d4c00640 1 -- 172.21.15.6:0/1290143114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3d006fe90 msgr2=0x7fb3d01f5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:18.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.362+0000 7fb3d4c00640 1 --2- 172.21.15.6:0/1290143114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3d006fe90 0x7fb3d01f5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:18.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.362+0000 7fb3d4c00640 1 -- 172.21.15.6:0/1290143114 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3d00b28f0 con 0x7fb3d00ca070 2024-09-10T20:57:18.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.363+0000 7fb3d4c00640 1 --2- 172.21.15.6:0/1290143114 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3d00ca070 0x7fb3d00b5370 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc00c420 tx=0x7fb3bc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:18.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.363+0000 7fb3cd600640 1 -- 172.21.15.6:0/1290143114 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc017070 con 0x7fb3d00ca070 2024-09-10T20:57:18.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.363+0000 7fb3cd600640 1 -- 172.21.15.6:0/1290143114 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb3bc0053c0 con 0x7fb3d00ca070 2024-09-10T20:57:18.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.363+0000 7fb3d8000640 1 -- 172.21.15.6:0/1290143114 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3d00b2b90 con 0x7fb3d00ca070 2024-09-10T20:57:18.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.363+0000 7fb3cd600640 1 -- 172.21.15.6:0/1290143114 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc003850 con 0x7fb3d00ca070 2024-09-10T20:57:18.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.363+0000 7fb3d8000640 1 -- 172.21.15.6:0/1290143114 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3d00b3150 con 0x7fb3d00ca070 2024-09-10T20:57:18.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.364+0000 7fb3d8000640 1 -- 172.21.15.6:0/1290143114 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb3d0076140 con 0x7fb3d00ca070 2024-09-10T20:57:18.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.365+0000 7fb3cd600640 1 -- 172.21.15.6:0/1290143114 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb3bc0039f0 con 0x7fb3d00ca070 2024-09-10T20:57:18.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.366+0000 7fb3cd600640 1 --2- 172.21.15.6:0/1290143114 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb3b0077f70 0x7fb3b007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:18.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.366+0000 7fb3cd600640 1 -- 172.21.15.6:0/1290143114 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4943+0+0 (secure 0 0 0) 0x7fb3bc0994f0 con 0x7fb3d00ca070 2024-09-10T20:57:18.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.367+0000 7fb3cd600640 1 --2- 172.21.15.6:0/1290143114 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x7fb3b007de30 0x7fb3b0080250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:18.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.367+0000 7fb3cd600640 1 -- 172.21.15.6:0/1290143114 --> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb3bc01feb0 con 0x7fb3b007de30 2024-09-10T20:57:18.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.367+0000 7fb3cd600640 1 -- 172.21.15.6:0/1290143114 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fb3bc0998a0 con 0x7fb3d00ca070 2024-09-10T20:57:18.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.367+0000 7fb3d5600640 1 --2- 172.21.15.6:0/1290143114 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb3b0077f70 0x7fb3b007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:18.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.367+0000 7fb3d6000640 1 --2- 172.21.15.6:0/1290143114 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x7fb3b007de30 0x7fb3b0080250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:18.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.367+0000 7fb3d6000640 1 --2- 172.21.15.6:0/1290143114 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x7fb3b007de30 0x7fb3b0080250 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:18.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.367+0000 7fb3d5600640 1 --2- 172.21.15.6:0/1290143114 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb3b0077f70 0x7fb3b007a430 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4033000 tx=0x7fb3c4004730 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:18.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.368+0000 7fb3cd600640 1 -- 172.21.15.6:0/1290143114 <== osd.3 v2:172.21.15.6:6816/3911674247 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb3bc01feb0 con 0x7fb3b007de30 2024-09-10T20:57:18.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.381+0000 7fb3d8000640 1 -- 172.21.15.6:0/1290143114 --> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb3d0070270 con 0x7fb3b007de30 2024-09-10T20:57:18.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.382+0000 7fb3cd600640 1 -- 172.21.15.6:0/1290143114 <== osd.3 v2:172.21.15.6:6816/3911674247 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb3d0070270 con 0x7fb3b007de30 2024-09-10T20:57:18.386 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-10T20:57:18.386 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T20:57:18.386 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-10T20:57:18.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.382+0000 7fb3d8000640 1 -- 172.21.15.6:0/1290143114 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x7fb3b007de30 msgr2=0x7fb3b0080250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:18.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.382+0000 7fb3d8000640 1 --2- 172.21.15.6:0/1290143114 >> [v2:172.21.15.6:6816/3911674247,v1:172.21.15.6:6817/3911674247] conn(0x7fb3b007de30 0x7fb3b0080250 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:18.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.382+0000 7fb3d8000640 1 -- 172.21.15.6:0/1290143114 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb3b0077f70 msgr2=0x7fb3b007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:18.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.382+0000 7fb3d8000640 1 --2- 172.21.15.6:0/1290143114 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fb3b0077f70 0x7fb3b007a430 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4033000 tx=0x7fb3c4004730 comp rx=0 tx=0).stop 2024-09-10T20:57:18.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.382+0000 7fb3d8000640 1 -- 172.21.15.6:0/1290143114 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3d00ca070 msgr2=0x7fb3d00b5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:18.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.382+0000 7fb3d8000640 1 --2- 172.21.15.6:0/1290143114 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3d00ca070 0x7fb3d00b5370 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc00c420 tx=0x7fb3bc00c8e0 comp rx=0 tx=0).stop 2024-09-10T20:57:18.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.382+0000 7fb3d6000640 1 -- 172.21.15.6:0/1290143114 reap_dead start 2024-09-10T20:57:18.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.383+0000 7fb3d8000640 1 -- 172.21.15.6:0/1290143114 shutdown_connections 2024-09-10T20:57:18.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.383+0000 7fb3d8000640 1 -- 172.21.15.6:0/1290143114 >> 172.21.15.6:0/1290143114 conn(0x7fb3d00cfa20 msgr2=0x7fb3d01581f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:18.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.383+0000 7fb3d8000640 1 -- 172.21.15.6:0/1290143114 shutdown_connections 2024-09-10T20:57:18.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.383+0000 7fb3d8000640 1 -- 172.21.15.6:0/1290143114 wait complete. 2024-09-10T20:57:18.401 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-10T20:57:18.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.557+0000 7fd526800640 1 -- 172.21.15.6:0/3855944521 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd520159670 msgr2=0x7fd5200743b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:18.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.557+0000 7fd526800640 1 --2- 172.21.15.6:0/3855944521 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd520159670 0x7fd5200743b0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd520051860 tx=0x7fd51002a4b0 comp rx=0 tx=0).stop 2024-09-10T20:57:18.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.557+0000 7fd526800640 1 -- 172.21.15.6:0/3855944521 shutdown_connections 2024-09-10T20:57:18.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.557+0000 7fd526800640 1 --2- 172.21.15.6:0/3855944521 >> v2:172.21.15.150:3300/0 conn(0x7fd520070450 0x7fd5200cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:18.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.557+0000 7fd526800640 1 --2- 172.21.15.6:0/3855944521 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd520159670 0x7fd5200743b0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:18.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.557+0000 7fd526800640 1 -- 172.21.15.6:0/3855944521 >> 172.21.15.6:0/3855944521 conn(0x7fd5200cfa20 msgr2=0x7fd5200cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:18.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.557+0000 7fd526800640 1 -- 172.21.15.6:0/3855944521 shutdown_connections 2024-09-10T20:57:18.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.557+0000 7fd526800640 1 -- 172.21.15.6:0/3855944521 wait complete. 2024-09-10T20:57:18.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.559+0000 7fd526800640 1 Processor -- start 2024-09-10T20:57:18.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.559+0000 7fd526800640 1 -- start start 2024-09-10T20:57:18.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.559+0000 7fd526800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd520070450 0x7fd5201f9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:18.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.560+0000 7fd526800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd520159670 0x7fd5200b07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:18.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.560+0000 7fd526800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd52015c170 0x7fd52014ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:18.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.560+0000 7fd526800640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd5200b4a90 con 0x7fd52015c170 2024-09-10T20:57:18.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.560+0000 7fd526800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd5200b4910 con 0x7fd520159670 2024-09-10T20:57:18.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.560+0000 7fd526800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd5200b4c10 con 0x7fd520070450 2024-09-10T20:57:18.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.560+0000 7fd51fe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd52015c170 0x7fd52014ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:18.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.560+0000 7fd51fe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd52015c170 0x7fd52014ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45244/0 (socket says 172.21.15.6:45244) 2024-09-10T20:57:18.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.560+0000 7fd51fe00640 1 -- 172.21.15.6:0/2338854944 learned_addr learned my addr 172.21.15.6:0/2338854944 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:18.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.560+0000 7fd51f400640 1 --2- 172.21.15.6:0/2338854944 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd520070450 0x7fd5201f9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:18.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.560+0000 7fd517e00640 1 --2- 172.21.15.6:0/2338854944 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd520159670 0x7fd5200b07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:18.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.560+0000 7fd51fe00640 1 -- 172.21.15.6:0/2338854944 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd520070450 msgr2=0x7fd5201f9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:18.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.560+0000 7fd51fe00640 1 --2- 172.21.15.6:0/2338854944 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd520070450 0x7fd5201f9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:18.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.560+0000 7fd51fe00640 1 -- 172.21.15.6:0/2338854944 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd520159670 msgr2=0x7fd5200b07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:18.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.560+0000 7fd51fe00640 1 --2- 172.21.15.6:0/2338854944 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd520159670 0x7fd5200b07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:18.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.560+0000 7fd51fe00640 1 -- 172.21.15.6:0/2338854944 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5201f9740 con 0x7fd52015c170 2024-09-10T20:57:18.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.560+0000 7fd517e00640 1 --2- 172.21.15.6:0/2338854944 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd520159670 0x7fd5200b07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:57:18.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.561+0000 7fd51fe00640 1 --2- 172.21.15.6:0/2338854944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd52015c170 0x7fd52014ba30 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd51800b970 tx=0x7fd51800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:18.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.561+0000 7fd517400640 1 -- 172.21.15.6:0/2338854944 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd518019070 con 0x7fd52015c170 2024-09-10T20:57:18.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.561+0000 7fd517400640 1 -- 172.21.15.6:0/2338854944 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd51800cc50 con 0x7fd52015c170 2024-09-10T20:57:18.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.561+0000 7fd517400640 1 -- 172.21.15.6:0/2338854944 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5180146a0 con 0x7fd52015c170 2024-09-10T20:57:18.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.561+0000 7fd526800640 1 -- 172.21.15.6:0/2338854944 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd520159ec0 con 0x7fd52015c170 2024-09-10T20:57:18.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.561+0000 7fd526800640 1 -- 172.21.15.6:0/2338854944 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd52015a480 con 0x7fd52015c170 2024-09-10T20:57:18.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.562+0000 7fd526800640 1 -- 172.21.15.6:0/2338854944 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5200b5140 con 0x7fd52015c170 2024-09-10T20:57:18.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.563+0000 7fd517400640 1 -- 172.21.15.6:0/2338854944 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd51801d3b0 con 0x7fd52015c170 2024-09-10T20:57:18.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.564+0000 7fd517400640 1 --2- 172.21.15.6:0/2338854944 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd4fc077f70 0x7fd4fc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:18.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.564+0000 7fd517400640 1 -- 172.21.15.6:0/2338854944 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4943+0+0 (secure 0 0 0) 0x7fd518099a50 con 0x7fd52015c170 2024-09-10T20:57:18.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.565+0000 7fd51f400640 1 --2- 172.21.15.6:0/2338854944 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd4fc077f70 0x7fd4fc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:18.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.565+0000 7fd51f400640 1 --2- 172.21.15.6:0/2338854944 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd4fc077f70 0x7fd4fc07a430 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd510033000 tx=0x7fd510004730 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:18.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.568+0000 7fd517400640 1 -- 172.21.15.6:0/2338854944 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fd5201f9740 con 0x7fd52015c170 2024-09-10T20:57:18.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.762+0000 7fd526800640 1 -- 172.21.15.6:0/2338854944 --> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fd520069d20 con 0x7fd4fc077f70 2024-09-10T20:57:18.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.763+0000 7fd517400640 1 -- 172.21.15.6:0/2338854944 <== mgr.4120 v2:172.21.15.150:6800/1238179351 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd520069d20 con 0x7fd4fc077f70 2024-09-10T20:57:18.767 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 3 to deep-scrub 2024-09-10T20:57:18.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.765+0000 7fd526800640 1 -- 172.21.15.6:0/2338854944 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd4fc077f70 msgr2=0x7fd4fc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:18.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.765+0000 7fd526800640 1 --2- 172.21.15.6:0/2338854944 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd4fc077f70 0x7fd4fc07a430 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd510033000 tx=0x7fd510004730 comp rx=0 tx=0).stop 2024-09-10T20:57:18.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.765+0000 7fd526800640 1 -- 172.21.15.6:0/2338854944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd52015c170 msgr2=0x7fd52014ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:18.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.765+0000 7fd526800640 1 --2- 172.21.15.6:0/2338854944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd52015c170 0x7fd52014ba30 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd51800b970 tx=0x7fd51800be30 comp rx=0 tx=0).stop 2024-09-10T20:57:18.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.765+0000 7fd526800640 1 -- 172.21.15.6:0/2338854944 shutdown_connections 2024-09-10T20:57:18.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.765+0000 7fd526800640 1 --2- 172.21.15.6:0/2338854944 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd4fc077f70 0x7fd4fc07a430 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:18.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.765+0000 7fd526800640 1 --2- 172.21.15.6:0/2338854944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd52015c170 0x7fd52014ba30 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:18.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.765+0000 7fd526800640 1 --2- 172.21.15.6:0/2338854944 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd520159670 0x7fd5200b07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:18.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.765+0000 7fd526800640 1 --2- 172.21.15.6:0/2338854944 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd520070450 0x7fd5201f9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:18.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.765+0000 7fd526800640 1 -- 172.21.15.6:0/2338854944 >> 172.21.15.6:0/2338854944 conn(0x7fd5200cfa20 msgr2=0x7fd520073160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:18.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.765+0000 7fd526800640 1 -- 172.21.15.6:0/2338854944 shutdown_connections 2024-09-10T20:57:18.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.765+0000 7fd526800640 1 -- 172.21.15.6:0/2338854944 wait complete. 2024-09-10T20:57:18.785 INFO:tasks.ceph:Scrubbing osd.4 2024-09-10T20:57:18.785 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-10T20:57:18.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.946+0000 7fe9c1e00640 1 -- 172.21.15.6:0/1197621425 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9bc0b5270 msgr2=0x7fe9bc0d21d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:18.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.946+0000 7fe9c1e00640 1 --2- 172.21.15.6:0/1197621425 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9bc0b5270 0x7fe9bc0d21d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe9a8009830 tx=0x7fe9a802a640 comp rx=0 tx=0).stop 2024-09-10T20:57:18.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.946+0000 7fe9c1e00640 1 -- 172.21.15.6:0/1197621425 shutdown_connections 2024-09-10T20:57:18.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.946+0000 7fe9c1e00640 1 --2- 172.21.15.6:0/1197621425 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9bc0b5270 0x7fe9bc0d21d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:18.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.946+0000 7fe9c1e00640 1 -- 172.21.15.6:0/1197621425 >> 172.21.15.6:0/1197621425 conn(0x7fe9bc09cee0 msgr2=0x7fe9bc0d3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:18.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.946+0000 7fe9c1e00640 1 -- 172.21.15.6:0/1197621425 shutdown_connections 2024-09-10T20:57:18.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.946+0000 7fe9c1e00640 1 -- 172.21.15.6:0/1197621425 wait complete. 2024-09-10T20:57:18.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.948+0000 7fe9c1e00640 1 Processor -- start 2024-09-10T20:57:18.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.948+0000 7fe9c1e00640 1 -- start start 2024-09-10T20:57:18.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.949+0000 7fe9c1e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9bc0b5270 0x7fe9bc0ca3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:18.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.949+0000 7fe9c1e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9bc0d2710 0x7fe9bc1f7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:18.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.949+0000 7fe9c1e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9bc1612f0 0x7fe9bc09fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:18.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.949+0000 7fe9c1e00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe9bc0d2ca0 con 0x7fe9bc0d2710 2024-09-10T20:57:18.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.949+0000 7fe9c1e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe9bc0d2b20 con 0x7fe9bc1612f0 2024-09-10T20:57:18.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.949+0000 7fe9c1e00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe9bc0b5e80 con 0x7fe9bc0b5270 2024-09-10T20:57:18.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.949+0000 7fe9bbe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9bc0d2710 0x7fe9bc1f7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:18.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.949+0000 7fe9bbe00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9bc0d2710 0x7fe9bc1f7c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45256/0 (socket says 172.21.15.6:45256) 2024-09-10T20:57:18.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.949+0000 7fe9bbe00640 1 -- 172.21.15.6:0/2038379676 learned_addr learned my addr 172.21.15.6:0/2038379676 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:18.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.949+0000 7fe9c0a00640 1 --2- 172.21.15.6:0/2038379676 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9bc0b5270 0x7fe9bc0ca3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:18.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.949+0000 7fe9c1400640 1 --2- 172.21.15.6:0/2038379676 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9bc1612f0 0x7fe9bc09fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:18.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.950+0000 7fe9bbe00640 1 -- 172.21.15.6:0/2038379676 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9bc0b5270 msgr2=0x7fe9bc0ca3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:18.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.950+0000 7fe9bbe00640 1 --2- 172.21.15.6:0/2038379676 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9bc0b5270 0x7fe9bc0ca3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:18.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.950+0000 7fe9bbe00640 1 -- 172.21.15.6:0/2038379676 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9bc1612f0 msgr2=0x7fe9bc09fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:18.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.950+0000 7fe9bbe00640 1 --2- 172.21.15.6:0/2038379676 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9bc1612f0 0x7fe9bc09fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:18.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.950+0000 7fe9bbe00640 1 -- 172.21.15.6:0/2038379676 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9bc0ca900 con 0x7fe9bc0d2710 2024-09-10T20:57:18.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.950+0000 7fe9c1400640 1 --2- 172.21.15.6:0/2038379676 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9bc1612f0 0x7fe9bc09fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:57:18.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.950+0000 7fe9c0a00640 1 --2- 172.21.15.6:0/2038379676 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9bc0b5270 0x7fe9bc0ca3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:57:18.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.950+0000 7fe9bbe00640 1 --2- 172.21.15.6:0/2038379676 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9bc0d2710 0x7fe9bc1f7c50 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe9a8000c00 tx=0x7fe9a8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:18.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.950+0000 7fe9b8c00640 1 -- 172.21.15.6:0/2038379676 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a8041030 con 0x7fe9bc0d2710 2024-09-10T20:57:18.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.950+0000 7fe9b8c00640 1 -- 172.21.15.6:0/2038379676 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9a8031400 con 0x7fe9bc0d2710 2024-09-10T20:57:18.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.950+0000 7fe9b8c00640 1 -- 172.21.15.6:0/2038379676 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a8005280 con 0x7fe9bc0d2710 2024-09-10T20:57:18.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.950+0000 7fe9c1e00640 1 -- 172.21.15.6:0/2038379676 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9bc1f8550 con 0x7fe9bc0d2710 2024-09-10T20:57:18.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.950+0000 7fe9c1e00640 1 -- 172.21.15.6:0/2038379676 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9bc1f8b10 con 0x7fe9bc0d2710 2024-09-10T20:57:18.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.951+0000 7fe9c1e00640 1 -- 172.21.15.6:0/2038379676 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe9bc0b6410 con 0x7fe9bc0d2710 2024-09-10T20:57:18.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.952+0000 7fe9b8c00640 1 -- 172.21.15.6:0/2038379676 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe9a80047a0 con 0x7fe9bc0d2710 2024-09-10T20:57:18.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.953+0000 7fe9b8c00640 1 --2- 172.21.15.6:0/2038379676 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fe99c077f70 0x7fe99c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:18.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.953+0000 7fe9b8c00640 1 -- 172.21.15.6:0/2038379676 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4943+0+0 (secure 0 0 0) 0x7fe9a80bb220 con 0x7fe9bc0d2710 2024-09-10T20:57:18.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.954+0000 7fe9b8c00640 1 --2- 172.21.15.6:0/2038379676 >> [v2:172.21.15.150:6826/2568527750,v1:172.21.15.150:6827/2568527750] conn(0x7fe99c07de30 0x7fe99c080250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:18.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.954+0000 7fe9b8c00640 1 -- 172.21.15.6:0/2038379676 --> [v2:172.21.15.150:6826/2568527750,v1:172.21.15.150:6827/2568527750] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe99c080900 con 0x7fe99c07de30 2024-09-10T20:57:18.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.954+0000 7fe9b8c00640 1 -- 172.21.15.6:0/2038379676 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fe9a80bb5d0 con 0x7fe9bc0d2710 2024-09-10T20:57:18.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.954+0000 7fe9c0a00640 1 --2- 172.21.15.6:0/2038379676 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fe99c077f70 0x7fe99c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:18.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.954+0000 7fe9c1400640 1 --2- 172.21.15.6:0/2038379676 >> [v2:172.21.15.150:6826/2568527750,v1:172.21.15.150:6827/2568527750] conn(0x7fe99c07de30 0x7fe99c080250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:18.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.955+0000 7fe9c0a00640 1 --2- 172.21.15.6:0/2038379676 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fe99c077f70 0x7fe99c07a430 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0001120 tx=0x7fe9b0009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:18.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.955+0000 7fe9c1400640 1 --2- 172.21.15.6:0/2038379676 >> [v2:172.21.15.150:6826/2568527750,v1:172.21.15.150:6827/2568527750] conn(0x7fe99c07de30 0x7fe99c080250 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:18.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.956+0000 7fe9b8c00640 1 -- 172.21.15.6:0/2038379676 <== osd.4 v2:172.21.15.150:6826/2568527750 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe99c080900 con 0x7fe99c07de30 2024-09-10T20:57:18.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.969+0000 7fe9c1e00640 1 -- 172.21.15.6:0/2038379676 --> [v2:172.21.15.150:6826/2568527750,v1:172.21.15.150:6827/2568527750] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe9bc0b4f70 con 0x7fe99c07de30 2024-09-10T20:57:18.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.970+0000 7fe9b8c00640 1 -- 172.21.15.6:0/2038379676 <== osd.4 v2:172.21.15.150:6826/2568527750 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe9bc0b4f70 con 0x7fe99c07de30 2024-09-10T20:57:18.974 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-10T20:57:18.975 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T20:57:18.975 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-10T20:57:18.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.971+0000 7fe9c1e00640 1 -- 172.21.15.6:0/2038379676 >> [v2:172.21.15.150:6826/2568527750,v1:172.21.15.150:6827/2568527750] conn(0x7fe99c07de30 msgr2=0x7fe99c080250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:18.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.971+0000 7fe9c1e00640 1 --2- 172.21.15.6:0/2038379676 >> [v2:172.21.15.150:6826/2568527750,v1:172.21.15.150:6827/2568527750] conn(0x7fe99c07de30 0x7fe99c080250 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:18.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.971+0000 7fe9c1e00640 1 -- 172.21.15.6:0/2038379676 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fe99c077f70 msgr2=0x7fe99c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:18.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.971+0000 7fe9c1e00640 1 --2- 172.21.15.6:0/2038379676 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fe99c077f70 0x7fe99c07a430 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0001120 tx=0x7fe9b0009040 comp rx=0 tx=0).stop 2024-09-10T20:57:18.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.971+0000 7fe9c1e00640 1 -- 172.21.15.6:0/2038379676 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9bc0d2710 msgr2=0x7fe9bc1f7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:18.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.971+0000 7fe9c1e00640 1 --2- 172.21.15.6:0/2038379676 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9bc0d2710 0x7fe9bc1f7c50 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe9a8000c00 tx=0x7fe9a8004270 comp rx=0 tx=0).stop 2024-09-10T20:57:18.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.971+0000 7fe9c1400640 1 -- 172.21.15.6:0/2038379676 reap_dead start 2024-09-10T20:57:18.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.971+0000 7fe9c1e00640 1 -- 172.21.15.6:0/2038379676 shutdown_connections 2024-09-10T20:57:18.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.971+0000 7fe9c1e00640 1 -- 172.21.15.6:0/2038379676 >> 172.21.15.6:0/2038379676 conn(0x7fe9bc09cee0 msgr2=0x7fe9bc0ccef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:18.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.971+0000 7fe9c1e00640 1 -- 172.21.15.6:0/2038379676 shutdown_connections 2024-09-10T20:57:18.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:18.971+0000 7fe9c1e00640 1 -- 172.21.15.6:0/2038379676 wait complete. 2024-09-10T20:57:18.990 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-10T20:57:19.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.147+0000 7f008ca00640 1 -- 172.21.15.6:0/1878070204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00880cf340 msgr2=0x7f0088161a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:19.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.147+0000 7f008ca00640 1 --2- 172.21.15.6:0/1878070204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00880cf340 0x7f0088161a20 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f00880cdd20 tx=0x7f007002a530 comp rx=0 tx=0).stop 2024-09-10T20:57:19.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.147+0000 7f008ca00640 1 -- 172.21.15.6:0/1878070204 shutdown_connections 2024-09-10T20:57:19.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.147+0000 7f008ca00640 1 --2- 172.21.15.6:0/1878070204 >> v2:172.21.15.150:3300/0 conn(0x7f0088161f60 0x7f00880ad880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:19.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.147+0000 7f008ca00640 1 --2- 172.21.15.6:0/1878070204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00880cf340 0x7f0088161a20 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:19.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.147+0000 7f008ca00640 1 -- 172.21.15.6:0/1878070204 >> 172.21.15.6:0/1878070204 conn(0x7f00880cfa20 msgr2=0x7f00880cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:19.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.147+0000 7f008ca00640 1 -- 172.21.15.6:0/1878070204 shutdown_connections 2024-09-10T20:57:19.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.148+0000 7f008ca00640 1 -- 172.21.15.6:0/1878070204 wait complete. 2024-09-10T20:57:19.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.149+0000 7f008ca00640 1 Processor -- start 2024-09-10T20:57:19.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.149+0000 7f008ca00640 1 -- start start 2024-09-10T20:57:19.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.150+0000 7f008ca00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00880cf340 0x7f0088157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:19.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.150+0000 7f008ca00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f008815bb30 0x7f00880b3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:19.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.150+0000 7f008ca00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0088161f60 0x7f00881599b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:19.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.150+0000 7f008ca00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f00880ae150 con 0x7f00880cf340 2024-09-10T20:57:19.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.150+0000 7f008ca00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f00880adfd0 con 0x7f0088161f60 2024-09-10T20:57:19.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.150+0000 7f008ca00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f00880ae2d0 con 0x7f008815bb30 2024-09-10T20:57:19.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.150+0000 7f0085e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00880cf340 0x7f0088157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:19.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.150+0000 7f0085e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00880cf340 0x7f0088157f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45272/0 (socket says 172.21.15.6:45272) 2024-09-10T20:57:19.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.151+0000 7f0085e00640 1 -- 172.21.15.6:0/187048275 learned_addr learned my addr 172.21.15.6:0/187048275 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:19.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.151+0000 7f0086800640 1 --2- 172.21.15.6:0/187048275 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0088161f60 0x7f00881599b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:19.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.151+0000 7f007fe00640 1 --2- 172.21.15.6:0/187048275 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f008815bb30 0x7f00880b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:19.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.151+0000 7f0085e00640 1 -- 172.21.15.6:0/187048275 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f008815bb30 msgr2=0x7f00880b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:19.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.151+0000 7f0085e00640 1 --2- 172.21.15.6:0/187048275 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f008815bb30 0x7f00880b3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:19.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.151+0000 7f0085e00640 1 -- 172.21.15.6:0/187048275 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0088161f60 msgr2=0x7f00881599b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:19.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.151+0000 7f0085e00640 1 --2- 172.21.15.6:0/187048275 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0088161f60 0x7f00881599b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:19.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.151+0000 7f0085e00640 1 -- 172.21.15.6:0/187048275 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00880c47e0 con 0x7f00880cf340 2024-09-10T20:57:19.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.151+0000 7f007fe00640 1 --2- 172.21.15.6:0/187048275 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f008815bb30 0x7f00880b3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:57:19.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.151+0000 7f0085e00640 1 --2- 172.21.15.6:0/187048275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00880cf340 0x7f0088157f40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f007800c480 tx=0x7f007800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:19.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.151+0000 7f007e000640 1 -- 172.21.15.6:0/187048275 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0078016020 con 0x7f00880cf340 2024-09-10T20:57:19.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.151+0000 7f007e000640 1 -- 172.21.15.6:0/187048275 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0078012920 con 0x7f00880cf340 2024-09-10T20:57:19.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.151+0000 7f007e000640 1 -- 172.21.15.6:0/187048275 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0078012d70 con 0x7f00880cf340 2024-09-10T20:57:19.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.151+0000 7f008ca00640 1 -- 172.21.15.6:0/187048275 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00880c4ac0 con 0x7f00880cf340 2024-09-10T20:57:19.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.152+0000 7f008ca00640 1 -- 172.21.15.6:0/187048275 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00880b4170 con 0x7f00880cf340 2024-09-10T20:57:19.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.153+0000 7f008ca00640 1 -- 172.21.15.6:0/187048275 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00880c4fe0 con 0x7f00880cf340 2024-09-10T20:57:19.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.154+0000 7f007e000640 1 -- 172.21.15.6:0/187048275 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f007801b400 con 0x7f00880cf340 2024-09-10T20:57:19.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.155+0000 7f007e000640 1 --2- 172.21.15.6:0/187048275 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f0064077fa0 0x7f006407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:19.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.155+0000 7f007e000640 1 -- 172.21.15.6:0/187048275 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4943+0+0 (secure 0 0 0) 0x7f0078099d80 con 0x7f00880cf340 2024-09-10T20:57:19.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.155+0000 7f007fe00640 1 --2- 172.21.15.6:0/187048275 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f0064077fa0 0x7f006407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:19.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.156+0000 7f007fe00640 1 --2- 172.21.15.6:0/187048275 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f0064077fa0 0x7f006407a460 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0070034000 tx=0x7f0070004730 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:19.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.159+0000 7f007e000640 1 -- 172.21.15.6:0/187048275 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f00880c4fe0 con 0x7f00880cf340 2024-09-10T20:57:19.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.354+0000 7f008ca00640 1 -- 172.21.15.6:0/187048275 --> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f00880ae780 con 0x7f0064077fa0 2024-09-10T20:57:19.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.355+0000 7f007e000640 1 -- 172.21.15.6:0/187048275 <== mgr.4120 v2:172.21.15.150:6800/1238179351 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f00880ae780 con 0x7f0064077fa0 2024-09-10T20:57:19.359 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 4 to deep-scrub 2024-09-10T20:57:19.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.357+0000 7f008ca00640 1 -- 172.21.15.6:0/187048275 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f0064077fa0 msgr2=0x7f006407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:19.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.357+0000 7f008ca00640 1 --2- 172.21.15.6:0/187048275 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f0064077fa0 0x7f006407a460 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0070034000 tx=0x7f0070004730 comp rx=0 tx=0).stop 2024-09-10T20:57:19.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.357+0000 7f008ca00640 1 -- 172.21.15.6:0/187048275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00880cf340 msgr2=0x7f0088157f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:19.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.357+0000 7f008ca00640 1 --2- 172.21.15.6:0/187048275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00880cf340 0x7f0088157f40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f007800c480 tx=0x7f007800c940 comp rx=0 tx=0).stop 2024-09-10T20:57:19.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.357+0000 7f008ca00640 1 -- 172.21.15.6:0/187048275 shutdown_connections 2024-09-10T20:57:19.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.357+0000 7f008ca00640 1 --2- 172.21.15.6:0/187048275 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f0064077fa0 0x7f006407a460 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:19.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.357+0000 7f008ca00640 1 --2- 172.21.15.6:0/187048275 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0088161f60 0x7f00881599b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:19.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.357+0000 7f008ca00640 1 --2- 172.21.15.6:0/187048275 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f008815bb30 0x7f00880b3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:19.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.357+0000 7f008ca00640 1 --2- 172.21.15.6:0/187048275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00880cf340 0x7f0088157f40 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:19.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.357+0000 7f008ca00640 1 -- 172.21.15.6:0/187048275 >> 172.21.15.6:0/187048275 conn(0x7f00880cfa20 msgr2=0x7f00880cfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:19.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.357+0000 7f008ca00640 1 -- 172.21.15.6:0/187048275 shutdown_connections 2024-09-10T20:57:19.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.357+0000 7f008ca00640 1 -- 172.21.15.6:0/187048275 wait complete. 2024-09-10T20:57:19.377 INFO:tasks.ceph:Scrubbing osd.5 2024-09-10T20:57:19.378 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-10T20:57:19.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.537+0000 7f3e03e00640 1 -- 172.21.15.6:0/1294240236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e040aef70 msgr2=0x7f3e0406f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:19.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.537+0000 7f3e03e00640 1 --2- 172.21.15.6:0/1294240236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e040aef70 0x7f3e0406f2e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f3e0415c000 tx=0x7f3dfc02a8b0 comp rx=0 tx=0).stop 2024-09-10T20:57:19.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.537+0000 7f3e03e00640 1 -- 172.21.15.6:0/1294240236 shutdown_connections 2024-09-10T20:57:19.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.537+0000 7f3e03e00640 1 --2- 172.21.15.6:0/1294240236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e040aef70 0x7f3e0406f2e0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:19.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.537+0000 7f3e03e00640 1 --2- 172.21.15.6:0/1294240236 >> v2:172.21.15.150:3300/0 conn(0x7f3e040cc070 0x7f3e0406eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:19.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.537+0000 7f3e03e00640 1 -- 172.21.15.6:0/1294240236 >> 172.21.15.6:0/1294240236 conn(0x7f3e0406cb70 msgr2=0x7f3e0406cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:19.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.537+0000 7f3e03e00640 1 -- 172.21.15.6:0/1294240236 shutdown_connections 2024-09-10T20:57:19.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.537+0000 7f3e03e00640 1 -- 172.21.15.6:0/1294240236 wait complete. 2024-09-10T20:57:19.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.539+0000 7f3e03e00640 1 Processor -- start 2024-09-10T20:57:19.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.539+0000 7f3e03e00640 1 -- start start 2024-09-10T20:57:19.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.540+0000 7f3e03e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e040aeb90 0x7f3e0414d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:19.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.540+0000 7f3e03e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e040aef70 0x7f3e0415aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:19.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.540+0000 7f3e03e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e040cc070 0x7f3e04155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:19.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.540+0000 7f3e03e00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3e040b3ae0 con 0x7f3e040aeb90 2024-09-10T20:57:19.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.540+0000 7f3e03e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3e040b3960 con 0x7f3e040aef70 2024-09-10T20:57:19.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.540+0000 7f3e03e00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3e040b3c60 con 0x7f3e040cc070 2024-09-10T20:57:19.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.540+0000 7f3e02a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e040aeb90 0x7f3e0414d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:19.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.540+0000 7f3e02a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e040aeb90 0x7f3e0414d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45294/0 (socket says 172.21.15.6:45294) 2024-09-10T20:57:19.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.540+0000 7f3e02a00640 1 -- 172.21.15.6:0/2071253618 learned_addr learned my addr 172.21.15.6:0/2071253618 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:19.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.540+0000 7f3dfa000640 1 --2- 172.21.15.6:0/2071253618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e040aef70 0x7f3e0415aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:19.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.540+0000 7f3e03400640 1 --2- 172.21.15.6:0/2071253618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e040cc070 0x7f3e04155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:19.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.541+0000 7f3e02a00640 1 -- 172.21.15.6:0/2071253618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e040cc070 msgr2=0x7f3e04155260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:19.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.541+0000 7f3e02a00640 1 --2- 172.21.15.6:0/2071253618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e040cc070 0x7f3e04155260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:19.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.541+0000 7f3e02a00640 1 -- 172.21.15.6:0/2071253618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e040aef70 msgr2=0x7f3e0415aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:19.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.541+0000 7f3e02a00640 1 --2- 172.21.15.6:0/2071253618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e040aef70 0x7f3e0415aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:19.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.541+0000 7f3e02a00640 1 -- 172.21.15.6:0/2071253618 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e041566d0 con 0x7f3e040aeb90 2024-09-10T20:57:19.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.541+0000 7f3dfa000640 1 --2- 172.21.15.6:0/2071253618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e040aef70 0x7f3e0415aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:57:19.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.541+0000 7f3e02a00640 1 --2- 172.21.15.6:0/2071253618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e040aeb90 0x7f3e0414d260 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f3df400c500 tx=0x7f3df400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:19.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.541+0000 7f3dfb400640 1 -- 172.21.15.6:0/2071253618 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df4017070 con 0x7f3e040aeb90 2024-09-10T20:57:19.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.541+0000 7f3dfb400640 1 -- 172.21.15.6:0/2071253618 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3df40035f0 con 0x7f3e040aeb90 2024-09-10T20:57:19.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.541+0000 7f3dfb400640 1 -- 172.21.15.6:0/2071253618 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df4003a40 con 0x7f3e040aeb90 2024-09-10T20:57:19.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.541+0000 7f3e03e00640 1 -- 172.21.15.6:0/2071253618 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e04156970 con 0x7f3e040aeb90 2024-09-10T20:57:19.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.541+0000 7f3e03e00640 1 -- 172.21.15.6:0/2071253618 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e04156f30 con 0x7f3e040aeb90 2024-09-10T20:57:19.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.542+0000 7f3e03e00640 1 -- 172.21.15.6:0/2071253618 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3e0406cf50 con 0x7f3e040aeb90 2024-09-10T20:57:19.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.544+0000 7f3dfb400640 1 -- 172.21.15.6:0/2071253618 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3df4003be0 con 0x7f3e040aeb90 2024-09-10T20:57:19.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.545+0000 7f3dfb400640 1 --2- 172.21.15.6:0/2071253618 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3de0077f70 0x7f3de007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:19.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.545+0000 7f3dfb400640 1 -- 172.21.15.6:0/2071253618 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4943+0+0 (secure 0 0 0) 0x7f3df4099290 con 0x7f3e040aeb90 2024-09-10T20:57:19.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.545+0000 7f3dfb400640 1 --2- 172.21.15.6:0/2071253618 >> [v2:172.21.15.150:6810/371417736,v1:172.21.15.150:6811/371417736] conn(0x7f3de007de30 0x7f3de0080250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:19.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.545+0000 7f3dfb400640 1 -- 172.21.15.6:0/2071253618 --> [v2:172.21.15.150:6810/371417736,v1:172.21.15.150:6811/371417736] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3de0080900 con 0x7f3de007de30 2024-09-10T20:57:19.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.545+0000 7f3dfb400640 1 -- 172.21.15.6:0/2071253618 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f3df40a0050 con 0x7f3e040aeb90 2024-09-10T20:57:19.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.545+0000 7f3dfa000640 1 --2- 172.21.15.6:0/2071253618 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3de0077f70 0x7f3de007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:19.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.545+0000 7f3e03400640 1 --2- 172.21.15.6:0/2071253618 >> [v2:172.21.15.150:6810/371417736,v1:172.21.15.150:6811/371417736] conn(0x7f3de007de30 0x7f3de0080250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:19.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.546+0000 7f3dfa000640 1 --2- 172.21.15.6:0/2071253618 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3de0077f70 0x7f3de007a430 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3dec005fd0 tx=0x7f3dec00f360 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:19.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.546+0000 7f3e03400640 1 --2- 172.21.15.6:0/2071253618 >> [v2:172.21.15.150:6810/371417736,v1:172.21.15.150:6811/371417736] conn(0x7f3de007de30 0x7f3de0080250 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:19.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.547+0000 7f3dfb400640 1 -- 172.21.15.6:0/2071253618 <== osd.5 v2:172.21.15.150:6810/371417736 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3de0080900 con 0x7f3de007de30 2024-09-10T20:57:19.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.560+0000 7f3e03e00640 1 -- 172.21.15.6:0/2071253618 --> [v2:172.21.15.150:6810/371417736,v1:172.21.15.150:6811/371417736] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3e040b2f00 con 0x7f3de007de30 2024-09-10T20:57:19.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.561+0000 7f3dfb400640 1 -- 172.21.15.6:0/2071253618 <== osd.5 v2:172.21.15.150:6810/371417736 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3e040b2f00 con 0x7f3de007de30 2024-09-10T20:57:19.565 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-10T20:57:19.565 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T20:57:19.565 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-10T20:57:19.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.561+0000 7f3e03e00640 1 -- 172.21.15.6:0/2071253618 >> [v2:172.21.15.150:6810/371417736,v1:172.21.15.150:6811/371417736] conn(0x7f3de007de30 msgr2=0x7f3de0080250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:19.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.561+0000 7f3e03e00640 1 --2- 172.21.15.6:0/2071253618 >> [v2:172.21.15.150:6810/371417736,v1:172.21.15.150:6811/371417736] conn(0x7f3de007de30 0x7f3de0080250 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:19.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.561+0000 7f3e03e00640 1 -- 172.21.15.6:0/2071253618 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3de0077f70 msgr2=0x7f3de007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:19.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.561+0000 7f3e03e00640 1 --2- 172.21.15.6:0/2071253618 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3de0077f70 0x7f3de007a430 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3dec005fd0 tx=0x7f3dec00f360 comp rx=0 tx=0).stop 2024-09-10T20:57:19.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.561+0000 7f3e03e00640 1 -- 172.21.15.6:0/2071253618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e040aeb90 msgr2=0x7f3e0414d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:19.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.561+0000 7f3e03e00640 1 --2- 172.21.15.6:0/2071253618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e040aeb90 0x7f3e0414d260 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f3df400c500 tx=0x7f3df400c9c0 comp rx=0 tx=0).stop 2024-09-10T20:57:19.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.561+0000 7f3e03400640 1 -- 172.21.15.6:0/2071253618 reap_dead start 2024-09-10T20:57:19.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.561+0000 7f3e03e00640 1 -- 172.21.15.6:0/2071253618 shutdown_connections 2024-09-10T20:57:19.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.561+0000 7f3e03e00640 1 -- 172.21.15.6:0/2071253618 >> 172.21.15.6:0/2071253618 conn(0x7f3e0406cb70 msgr2=0x7f3e04072390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:19.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.561+0000 7f3e03e00640 1 -- 172.21.15.6:0/2071253618 shutdown_connections 2024-09-10T20:57:19.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.562+0000 7f3e03e00640 1 -- 172.21.15.6:0/2071253618 wait complete. 2024-09-10T20:57:19.580 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-10T20:57:19.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.738+0000 7ff53b200640 1 -- 172.21.15.6:0/936107582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff518004d40 msgr2=0x7ff5180051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:19.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.738+0000 7ff53b200640 1 --2- 172.21.15.6:0/936107582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff518004d40 0x7ff5180051c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00c640 tx=0x7ff518005830 comp rx=0 tx=0).stop 2024-09-10T20:57:19.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.738+0000 7ff539200640 1 -- 172.21.15.6:0/936107582 reap_dead start 2024-09-10T20:57:19.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.738+0000 7ff53b200640 1 -- 172.21.15.6:0/936107582 shutdown_connections 2024-09-10T20:57:19.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.738+0000 7ff53b200640 1 -- 172.21.15.6:0/936107582 >> 172.21.15.6:0/936107582 conn(0x7ff5340cfa20 msgr2=0x7ff5340cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:19.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.738+0000 7ff53b200640 1 -- 172.21.15.6:0/936107582 shutdown_connections 2024-09-10T20:57:19.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.738+0000 7ff53b200640 1 -- 172.21.15.6:0/936107582 wait complete. 2024-09-10T20:57:19.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.740+0000 7ff53b200640 1 Processor -- start 2024-09-10T20:57:19.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.740+0000 7ff53b200640 1 -- start start 2024-09-10T20:57:19.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.741+0000 7ff53b200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff518004d40 0x7ff53414ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:19.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.741+0000 7ff53b200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5340c3c60 0x7ff53414b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:19.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.741+0000 7ff53b200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5340c6af0 0x7ff5340cdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:19.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.741+0000 7ff53b200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff5340b53b0 con 0x7ff518004d40 2024-09-10T20:57:19.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.741+0000 7ff53b200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff5340b5230 con 0x7ff5340c3c60 2024-09-10T20:57:19.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.741+0000 7ff53b200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ff5340743b0 con 0x7ff5340c6af0 2024-09-10T20:57:19.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.741+0000 7ff533e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff518004d40 0x7ff53414ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:19.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.741+0000 7ff533e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff518004d40 0x7ff53414ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45310/0 (socket says 172.21.15.6:45310) 2024-09-10T20:57:19.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.741+0000 7ff533e00640 1 -- 172.21.15.6:0/2756197119 learned_addr learned my addr 172.21.15.6:0/2756197119 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:19.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.741+0000 7ff533400640 1 --2- 172.21.15.6:0/2756197119 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5340c3c60 0x7ff53414b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:19.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.741+0000 7ff539200640 1 --2- 172.21.15.6:0/2756197119 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5340c6af0 0x7ff5340cdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:19.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.741+0000 7ff533e00640 1 -- 172.21.15.6:0/2756197119 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5340c6af0 msgr2=0x7ff5340cdfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:19.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.741+0000 7ff533e00640 1 --2- 172.21.15.6:0/2756197119 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5340c6af0 0x7ff5340cdfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:19.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.741+0000 7ff533e00640 1 -- 172.21.15.6:0/2756197119 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5340c3c60 msgr2=0x7ff53414b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:19.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.741+0000 7ff533e00640 1 --2- 172.21.15.6:0/2756197119 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5340c3c60 0x7ff53414b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:19.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.741+0000 7ff533e00640 1 -- 172.21.15.6:0/2756197119 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff53414c230 con 0x7ff518004d40 2024-09-10T20:57:19.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.742+0000 7ff533e00640 1 --2- 172.21.15.6:0/2756197119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff518004d40 0x7ff53414ec40 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff524003ef0 tx=0x7ff5240017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:19.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.742+0000 7ff52be00640 1 -- 172.21.15.6:0/2756197119 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff524015070 con 0x7ff518004d40 2024-09-10T20:57:19.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.742+0000 7ff52be00640 1 -- 172.21.15.6:0/2756197119 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff524011920 con 0x7ff518004d40 2024-09-10T20:57:19.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.742+0000 7ff52be00640 1 -- 172.21.15.6:0/2756197119 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff524011d70 con 0x7ff518004d40 2024-09-10T20:57:19.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.742+0000 7ff53b200640 1 -- 172.21.15.6:0/2756197119 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff53414c510 con 0x7ff518004d40 2024-09-10T20:57:19.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.742+0000 7ff53b200640 1 -- 172.21.15.6:0/2756197119 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff53414cad0 con 0x7ff518004d40 2024-09-10T20:57:19.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.744+0000 7ff53b200640 1 -- 172.21.15.6:0/2756197119 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5340cd920 con 0x7ff518004d40 2024-09-10T20:57:19.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.745+0000 7ff52be00640 1 -- 172.21.15.6:0/2756197119 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff5240103c0 con 0x7ff518004d40 2024-09-10T20:57:19.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.745+0000 7ff52be00640 1 --2- 172.21.15.6:0/2756197119 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ff514077fa0 0x7ff51407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:19.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.746+0000 7ff52be00640 1 -- 172.21.15.6:0/2756197119 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4943+0+0 (secure 0 0 0) 0x7ff52409a8b0 con 0x7ff518004d40 2024-09-10T20:57:19.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.746+0000 7ff533400640 1 --2- 172.21.15.6:0/2756197119 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ff514077fa0 0x7ff51407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:19.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.747+0000 7ff533400640 1 --2- 172.21.15.6:0/2756197119 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ff514077fa0 0x7ff51407a460 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff5340cc1d0 tx=0x7ff520005f90 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:19.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.750+0000 7ff52be00640 1 -- 172.21.15.6:0/2756197119 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff524006e60 con 0x7ff518004d40 2024-09-10T20:57:19.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.945+0000 7ff53b200640 1 -- 172.21.15.6:0/2756197119 --> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7ff53414bfe0 con 0x7ff514077fa0 2024-09-10T20:57:19.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.946+0000 7ff52be00640 1 -- 172.21.15.6:0/2756197119 <== mgr.4120 v2:172.21.15.150:6800/1238179351 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff53414bfe0 con 0x7ff514077fa0 2024-09-10T20:57:19.950 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 5 to deep-scrub 2024-09-10T20:57:19.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.948+0000 7ff53b200640 1 -- 172.21.15.6:0/2756197119 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ff514077fa0 msgr2=0x7ff51407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:19.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.948+0000 7ff53b200640 1 --2- 172.21.15.6:0/2756197119 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ff514077fa0 0x7ff51407a460 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff5340cc1d0 tx=0x7ff520005f90 comp rx=0 tx=0).stop 2024-09-10T20:57:19.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.948+0000 7ff53b200640 1 -- 172.21.15.6:0/2756197119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff518004d40 msgr2=0x7ff53414ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:19.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.948+0000 7ff53b200640 1 --2- 172.21.15.6:0/2756197119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff518004d40 0x7ff53414ec40 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff524003ef0 tx=0x7ff5240017a0 comp rx=0 tx=0).stop 2024-09-10T20:57:19.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.948+0000 7ff53b200640 1 -- 172.21.15.6:0/2756197119 shutdown_connections 2024-09-10T20:57:19.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.949+0000 7ff53b200640 1 --2- 172.21.15.6:0/2756197119 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7ff514077fa0 0x7ff51407a460 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:19.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.949+0000 7ff53b200640 1 --2- 172.21.15.6:0/2756197119 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5340c6af0 0x7ff5340cdfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:19.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.949+0000 7ff53b200640 1 --2- 172.21.15.6:0/2756197119 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5340c3c60 0x7ff53414b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:19.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.949+0000 7ff53b200640 1 --2- 172.21.15.6:0/2756197119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff518004d40 0x7ff53414ec40 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:19.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.949+0000 7ff53b200640 1 -- 172.21.15.6:0/2756197119 >> 172.21.15.6:0/2756197119 conn(0x7ff5340cfa20 msgr2=0x7ff5340ad880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:19.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.949+0000 7ff53b200640 1 -- 172.21.15.6:0/2756197119 shutdown_connections 2024-09-10T20:57:19.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:19.949+0000 7ff53b200640 1 -- 172.21.15.6:0/2756197119 wait complete. 2024-09-10T20:57:19.968 INFO:tasks.ceph:Scrubbing osd.6 2024-09-10T20:57:19.968 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-10T20:57:20.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.128+0000 7fbaaca00640 1 -- 172.21.15.6:0/2087523388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaa806fe40 msgr2=0x7fbaa8070220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:20.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.128+0000 7fbaaca00640 1 --2- 172.21.15.6:0/2087523388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaa806fe40 0x7fbaa8070220 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fba98009830 tx=0x7fba9802a510 comp rx=0 tx=0).stop 2024-09-10T20:57:20.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.129+0000 7fbaaca00640 1 -- 172.21.15.6:0/2087523388 shutdown_connections 2024-09-10T20:57:20.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.129+0000 7fbaaca00640 1 --2- 172.21.15.6:0/2087523388 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbaa815bce0 0x7fbaa815cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:20.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.129+0000 7fbaaca00640 1 --2- 172.21.15.6:0/2087523388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaa806fe40 0x7fbaa8070220 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:20.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.129+0000 7fbaaca00640 1 -- 172.21.15.6:0/2087523388 >> 172.21.15.6:0/2087523388 conn(0x7fbaa80cfa20 msgr2=0x7fbaa80cfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:20.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.129+0000 7fbaaca00640 1 -- 172.21.15.6:0/2087523388 shutdown_connections 2024-09-10T20:57:20.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.129+0000 7fbaaca00640 1 -- 172.21.15.6:0/2087523388 wait complete. 2024-09-10T20:57:20.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.130+0000 7fbaaca00640 1 Processor -- start 2024-09-10T20:57:20.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.130+0000 7fbaaca00640 1 -- start start 2024-09-10T20:57:20.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.131+0000 7fbaaca00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbaa806fe40 0x7fbaa81f2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:20.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.131+0000 7fbaaca00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaa8072560 0x7fbaa81f00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:20.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.131+0000 7fbaaca00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbaa815bce0 0x7fbaa81efa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:20.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.131+0000 7fbaaca00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa8073260 con 0x7fbaa8072560 2024-09-10T20:57:20.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.131+0000 7fbaaca00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa80730e0 con 0x7fbaa806fe40 2024-09-10T20:57:20.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.131+0000 7fbaaca00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fbaa81f3ac0 con 0x7fbaa815bce0 2024-09-10T20:57:20.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.132+0000 7fbaa5400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaa8072560 0x7fbaa81f00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:20.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.132+0000 7fbaa5e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbaa806fe40 0x7fbaa81f2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:20.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.132+0000 7fbaa6800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbaa815bce0 0x7fbaa81efa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:20.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.132+0000 7fbaa5e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbaa806fe40 0x7fbaa81f2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.6:60582/0 (socket says 172.21.15.6:60582) 2024-09-10T20:57:20.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.132+0000 7fbaa5e00640 1 -- 172.21.15.6:0/1434941529 learned_addr learned my addr 172.21.15.6:0/1434941529 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:20.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.132+0000 7fbaa5400640 1 -- 172.21.15.6:0/1434941529 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbaa815bce0 msgr2=0x7fbaa81efa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:20.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.132+0000 7fbaa5400640 1 --2- 172.21.15.6:0/1434941529 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbaa815bce0 0x7fbaa81efa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:20.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.132+0000 7fbaa5400640 1 -- 172.21.15.6:0/1434941529 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbaa806fe40 msgr2=0x7fbaa81f2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:20.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.132+0000 7fbaa5400640 1 --2- 172.21.15.6:0/1434941529 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbaa806fe40 0x7fbaa81f2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:20.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.132+0000 7fbaa5400640 1 -- 172.21.15.6:0/1434941529 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa81f3da0 con 0x7fbaa8072560 2024-09-10T20:57:20.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.133+0000 7fbaa5400640 1 --2- 172.21.15.6:0/1434941529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaa8072560 0x7fbaa81f00b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8070a20 tx=0x7fba9400eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:20.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.133+0000 7fba9e000640 1 -- 172.21.15.6:0/1434941529 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9400cab0 con 0x7fbaa8072560 2024-09-10T20:57:20.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.133+0000 7fba9e000640 1 -- 172.21.15.6:0/1434941529 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba9400cd40 con 0x7fbaa8072560 2024-09-10T20:57:20.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.133+0000 7fba9e000640 1 -- 172.21.15.6:0/1434941529 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba94010690 con 0x7fbaa8072560 2024-09-10T20:57:20.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.133+0000 7fbaaca00640 1 -- 172.21.15.6:0/1434941529 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaa81f4080 con 0x7fbaa8072560 2024-09-10T20:57:20.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.133+0000 7fbaaca00640 1 -- 172.21.15.6:0/1434941529 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaa81f4640 con 0x7fbaa8072560 2024-09-10T20:57:20.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.134+0000 7fbaaca00640 1 -- 172.21.15.6:0/1434941529 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbaa80cb550 con 0x7fbaa8072560 2024-09-10T20:57:20.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.135+0000 7fba9e000640 1 -- 172.21.15.6:0/1434941529 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fba94010830 con 0x7fbaa8072560 2024-09-10T20:57:20.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.136+0000 7fba9e000640 1 --2- 172.21.15.6:0/1434941529 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fba88077f70 0x7fba8807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:20.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.136+0000 7fba9e000640 1 -- 172.21.15.6:0/1434941529 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4943+0+0 (secure 0 0 0) 0x7fba9409a3b0 con 0x7fbaa8072560 2024-09-10T20:57:20.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.136+0000 7fba9e000640 1 --2- 172.21.15.6:0/1434941529 >> [v2:172.21.15.150:6818/2329248366,v1:172.21.15.150:6819/2329248366] conn(0x7fba8807de30 0x7fba88080250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:20.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.136+0000 7fba9e000640 1 -- 172.21.15.6:0/1434941529 --> [v2:172.21.15.150:6818/2329248366,v1:172.21.15.150:6819/2329248366] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fba88080900 con 0x7fba8807de30 2024-09-10T20:57:20.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.136+0000 7fba9e000640 1 -- 172.21.15.6:0/1434941529 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fba940a1050 con 0x7fbaa8072560 2024-09-10T20:57:20.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.136+0000 7fbaa5e00640 1 --2- 172.21.15.6:0/1434941529 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fba88077f70 0x7fba8807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:20.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.137+0000 7fbaa6800640 1 --2- 172.21.15.6:0/1434941529 >> [v2:172.21.15.150:6818/2329248366,v1:172.21.15.150:6819/2329248366] conn(0x7fba8807de30 0x7fba88080250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:20.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.137+0000 7fbaa6800640 1 --2- 172.21.15.6:0/1434941529 >> [v2:172.21.15.150:6818/2329248366,v1:172.21.15.150:6819/2329248366] conn(0x7fba8807de30 0x7fba88080250 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:20.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.137+0000 7fbaa5e00640 1 --2- 172.21.15.6:0/1434941529 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fba88077f70 0x7fba8807a430 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fba980095f0 tx=0x7fba98004730 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:20.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.138+0000 7fba9e000640 1 -- 172.21.15.6:0/1434941529 <== osd.6 v2:172.21.15.150:6818/2329248366 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fba88080900 con 0x7fba8807de30 2024-09-10T20:57:20.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.151+0000 7fbaaca00640 1 -- 172.21.15.6:0/1434941529 --> [v2:172.21.15.150:6818/2329248366,v1:172.21.15.150:6819/2329248366] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbaa80d0460 con 0x7fba8807de30 2024-09-10T20:57:20.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.152+0000 7fba9e000640 1 -- 172.21.15.6:0/1434941529 <== osd.6 v2:172.21.15.150:6818/2329248366 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbaa80d0460 con 0x7fba8807de30 2024-09-10T20:57:20.157 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-10T20:57:20.157 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T20:57:20.157 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-10T20:57:20.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.152+0000 7fbaaca00640 1 -- 172.21.15.6:0/1434941529 >> [v2:172.21.15.150:6818/2329248366,v1:172.21.15.150:6819/2329248366] conn(0x7fba8807de30 msgr2=0x7fba88080250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:20.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.152+0000 7fbaaca00640 1 --2- 172.21.15.6:0/1434941529 >> [v2:172.21.15.150:6818/2329248366,v1:172.21.15.150:6819/2329248366] conn(0x7fba8807de30 0x7fba88080250 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:20.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.152+0000 7fbaaca00640 1 -- 172.21.15.6:0/1434941529 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fba88077f70 msgr2=0x7fba8807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:20.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.152+0000 7fbaaca00640 1 --2- 172.21.15.6:0/1434941529 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fba88077f70 0x7fba8807a430 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fba980095f0 tx=0x7fba98004730 comp rx=0 tx=0).stop 2024-09-10T20:57:20.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.153+0000 7fbaaca00640 1 -- 172.21.15.6:0/1434941529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaa8072560 msgr2=0x7fbaa81f00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:20.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.153+0000 7fbaaca00640 1 --2- 172.21.15.6:0/1434941529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaa8072560 0x7fbaa81f00b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8070a20 tx=0x7fba9400eb30 comp rx=0 tx=0).stop 2024-09-10T20:57:20.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.153+0000 7fbaa6800640 1 -- 172.21.15.6:0/1434941529 reap_dead start 2024-09-10T20:57:20.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.153+0000 7fbaaca00640 1 -- 172.21.15.6:0/1434941529 shutdown_connections 2024-09-10T20:57:20.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.153+0000 7fbaaca00640 1 -- 172.21.15.6:0/1434941529 >> 172.21.15.6:0/1434941529 conn(0x7fbaa80cfa20 msgr2=0x7fbaa815e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:20.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.153+0000 7fbaaca00640 1 -- 172.21.15.6:0/1434941529 shutdown_connections 2024-09-10T20:57:20.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.153+0000 7fbaaca00640 1 -- 172.21.15.6:0/1434941529 wait complete. 2024-09-10T20:57:20.172 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-10T20:57:20.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.329+0000 7fd7ece00640 1 -- 172.21.15.6:0/3216121243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7e815de90 msgr2=0x7fd7e80d05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:20.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.329+0000 7fd7ece00640 1 --2- 172.21.15.6:0/3216121243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7e815de90 0x7fd7e80d05e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fd7e80c7590 tx=0x7fd7d802a4d0 comp rx=0 tx=0).stop 2024-09-10T20:57:20.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.330+0000 7fd7ece00640 1 -- 172.21.15.6:0/3216121243 shutdown_connections 2024-09-10T20:57:20.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.330+0000 7fd7ece00640 1 --2- 172.21.15.6:0/3216121243 >> v2:172.21.15.150:3300/0 conn(0x7fd7e80d1850 0x7fd7e80d1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:20.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.330+0000 7fd7ece00640 1 --2- 172.21.15.6:0/3216121243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7e815de90 0x7fd7e80d05e0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:20.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.330+0000 7fd7ece00640 1 -- 172.21.15.6:0/3216121243 >> 172.21.15.6:0/3216121243 conn(0x7fd7e80d3c80 msgr2=0x7fd7e80d4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:20.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.330+0000 7fd7ece00640 1 -- 172.21.15.6:0/3216121243 shutdown_connections 2024-09-10T20:57:20.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.330+0000 7fd7ece00640 1 -- 172.21.15.6:0/3216121243 wait complete. 2024-09-10T20:57:20.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.331+0000 7fd7ece00640 1 Processor -- start 2024-09-10T20:57:20.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.331+0000 7fd7ece00640 1 -- start start 2024-09-10T20:57:20.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.332+0000 7fd7ece00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7e80d1850 0x7fd7e80cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:20.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.332+0000 7fd7ece00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7e80d4770 0x7fd7e8160f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:20.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.332+0000 7fd7ece00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7e815de90 0x7fd7e81f7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:20.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.332+0000 7fd7ece00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e80b32a0 con 0x7fd7e80d1850 2024-09-10T20:57:20.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.332+0000 7fd7ece00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e80b3120 con 0x7fd7e80d4770 2024-09-10T20:57:20.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.332+0000 7fd7ece00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd7e80d2220 con 0x7fd7e815de90 2024-09-10T20:57:20.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.332+0000 7fd7e7400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7e80d1850 0x7fd7e80cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:20.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.333+0000 7fd7e7400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7e80d1850 0x7fd7e80cc8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45336/0 (socket says 172.21.15.6:45336) 2024-09-10T20:57:20.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.333+0000 7fd7e7400640 1 -- 172.21.15.6:0/3797802900 learned_addr learned my addr 172.21.15.6:0/3797802900 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:20.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.333+0000 7fd7e6a00640 1 --2- 172.21.15.6:0/3797802900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7e80d4770 0x7fd7e8160f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:20.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.333+0000 7fd7e7e00640 1 --2- 172.21.15.6:0/3797802900 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7e815de90 0x7fd7e81f7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:20.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.333+0000 7fd7e7400640 1 -- 172.21.15.6:0/3797802900 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7e815de90 msgr2=0x7fd7e81f7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:20.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.333+0000 7fd7e7400640 1 --2- 172.21.15.6:0/3797802900 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7e815de90 0x7fd7e81f7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:20.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.333+0000 7fd7e7400640 1 -- 172.21.15.6:0/3797802900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7e80d4770 msgr2=0x7fd7e8160f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:20.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.333+0000 7fd7e7400640 1 --2- 172.21.15.6:0/3797802900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7e80d4770 0x7fd7e8160f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:20.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.333+0000 7fd7e7400640 1 -- 172.21.15.6:0/3797802900 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7e80ccf10 con 0x7fd7e80d1850 2024-09-10T20:57:20.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.333+0000 7fd7e7400640 1 --2- 172.21.15.6:0/3797802900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7e80d1850 0x7fd7e80cc8d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8034040 tx=0x7fd7d8003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:20.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.333+0000 7fd7df400640 1 -- 172.21.15.6:0/3797802900 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d803e030 con 0x7fd7e80d1850 2024-09-10T20:57:20.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.334+0000 7fd7df400640 1 -- 172.21.15.6:0/3797802900 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd7d8003e00 con 0x7fd7e80d1850 2024-09-10T20:57:20.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.334+0000 7fd7df400640 1 -- 172.21.15.6:0/3797802900 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d8035040 con 0x7fd7e80d1850 2024-09-10T20:57:20.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.334+0000 7fd7ece00640 1 -- 172.21.15.6:0/3797802900 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7e80cd1f0 con 0x7fd7e80d1850 2024-09-10T20:57:20.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.334+0000 7fd7ece00640 1 -- 172.21.15.6:0/3797802900 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7e815e600 con 0x7fd7e80d1850 2024-09-10T20:57:20.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.335+0000 7fd7ece00640 1 -- 172.21.15.6:0/3797802900 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7e80d1ce0 con 0x7fd7e80d1850 2024-09-10T20:57:20.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.336+0000 7fd7df400640 1 -- 172.21.15.6:0/3797802900 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd7d80049c0 con 0x7fd7e80d1850 2024-09-10T20:57:20.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.337+0000 7fd7df400640 1 --2- 172.21.15.6:0/3797802900 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd7c8077f70 0x7fd7c807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:20.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.337+0000 7fd7df400640 1 -- 172.21.15.6:0/3797802900 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4943+0+0 (secure 0 0 0) 0x7fd7d80ba450 con 0x7fd7e80d1850 2024-09-10T20:57:20.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.337+0000 7fd7e6a00640 1 --2- 172.21.15.6:0/3797802900 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd7c8077f70 0x7fd7c807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:20.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.338+0000 7fd7e6a00640 1 --2- 172.21.15.6:0/3797802900 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd7c8077f70 0x7fd7c807a430 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd7e81f7c60 tx=0x7fd7d4009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:20.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.341+0000 7fd7df400640 1 -- 172.21.15.6:0/3797802900 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fd7d8082b60 con 0x7fd7e80d1850 2024-09-10T20:57:20.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.533+0000 7fd7ece00640 1 -- 172.21.15.6:0/3797802900 --> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fd7e815d400 con 0x7fd7c8077f70 2024-09-10T20:57:20.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.534+0000 7fd7df400640 1 -- 172.21.15.6:0/3797802900 <== mgr.4120 v2:172.21.15.150:6800/1238179351 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd7e815d400 con 0x7fd7c8077f70 2024-09-10T20:57:20.538 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 6 to deep-scrub 2024-09-10T20:57:20.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.536+0000 7fd7ece00640 1 -- 172.21.15.6:0/3797802900 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd7c8077f70 msgr2=0x7fd7c807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:20.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.536+0000 7fd7ece00640 1 --2- 172.21.15.6:0/3797802900 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd7c8077f70 0x7fd7c807a430 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd7e81f7c60 tx=0x7fd7d4009040 comp rx=0 tx=0).stop 2024-09-10T20:57:20.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.536+0000 7fd7ece00640 1 -- 172.21.15.6:0/3797802900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7e80d1850 msgr2=0x7fd7e80cc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:20.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.536+0000 7fd7ece00640 1 --2- 172.21.15.6:0/3797802900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7e80d1850 0x7fd7e80cc8d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8034040 tx=0x7fd7d8003910 comp rx=0 tx=0).stop 2024-09-10T20:57:20.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.536+0000 7fd7ece00640 1 -- 172.21.15.6:0/3797802900 shutdown_connections 2024-09-10T20:57:20.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.536+0000 7fd7ece00640 1 --2- 172.21.15.6:0/3797802900 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fd7c8077f70 0x7fd7c807a430 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:20.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.536+0000 7fd7ece00640 1 --2- 172.21.15.6:0/3797802900 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7e815de90 0x7fd7e81f7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:20.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.536+0000 7fd7ece00640 1 --2- 172.21.15.6:0/3797802900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7e80d4770 0x7fd7e8160f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:20.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.536+0000 7fd7ece00640 1 --2- 172.21.15.6:0/3797802900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7e80d1850 0x7fd7e80cc8d0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:20.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.536+0000 7fd7ece00640 1 -- 172.21.15.6:0/3797802900 >> 172.21.15.6:0/3797802900 conn(0x7fd7e80d3c80 msgr2=0x7fd7e806e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:20.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.536+0000 7fd7ece00640 1 -- 172.21.15.6:0/3797802900 shutdown_connections 2024-09-10T20:57:20.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.537+0000 7fd7ece00640 1 -- 172.21.15.6:0/3797802900 wait complete. 2024-09-10T20:57:20.557 INFO:tasks.ceph:Scrubbing osd.7 2024-09-10T20:57:20.557 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-10T20:57:20.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.718+0000 7f68d1000640 1 -- 172.21.15.6:0/3955602931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68b0004e60 msgr2=0x7f68b000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:20.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.718+0000 7f68d1000640 1 --2- 172.21.15.6:0/3955602931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68b0004e60 0x7f68b000b9c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f68c4009e50 tx=0x7f68b0005830 comp rx=0 tx=0).stop 2024-09-10T20:57:20.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.719+0000 7f68ca800640 1 -- 172.21.15.6:0/3955602931 reap_dead start 2024-09-10T20:57:20.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.719+0000 7f68d1000640 1 -- 172.21.15.6:0/3955602931 shutdown_connections 2024-09-10T20:57:20.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.719+0000 7f68d1000640 1 -- 172.21.15.6:0/3955602931 >> 172.21.15.6:0/3955602931 conn(0x7f68cc0cfa20 msgr2=0x7f68cc0cfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:20.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.719+0000 7f68d1000640 1 -- 172.21.15.6:0/3955602931 shutdown_connections 2024-09-10T20:57:20.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.719+0000 7f68d1000640 1 -- 172.21.15.6:0/3955602931 wait complete. 2024-09-10T20:57:20.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.720+0000 7f68d1000640 1 Processor -- start 2024-09-10T20:57:20.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.720+0000 7f68d1000640 1 -- start start 2024-09-10T20:57:20.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.721+0000 7f68d1000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68b0004e60 0x7f68cc159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:20.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.721+0000 7f68d1000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68cc0b4750 0x7f68cc0b2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:20.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.721+0000 7f68d1000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68cc0b34f0 0x7f68cc154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:20.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.721+0000 7f68d1000640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f68cc164a50 con 0x7f68b0004e60 2024-09-10T20:57:20.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.721+0000 7f68d1000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f68cc1648d0 con 0x7f68cc0b4750 2024-09-10T20:57:20.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.721+0000 7f68d1000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f68cc164bd0 con 0x7f68cc0b34f0 2024-09-10T20:57:20.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.722+0000 7f68c9e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68b0004e60 0x7f68cc159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:20.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.722+0000 7f68c9e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68b0004e60 0x7f68cc159430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45362/0 (socket says 172.21.15.6:45362) 2024-09-10T20:57:20.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.722+0000 7f68c9e00640 1 -- 172.21.15.6:0/3907975621 learned_addr learned my addr 172.21.15.6:0/3907975621 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:20.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.722+0000 7f68c1400640 1 --2- 172.21.15.6:0/3907975621 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68cc0b4750 0x7f68cc0b2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:20.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.722+0000 7f68ca800640 1 --2- 172.21.15.6:0/3907975621 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68cc0b34f0 0x7f68cc154fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:20.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.722+0000 7f68c9e00640 1 -- 172.21.15.6:0/3907975621 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68cc0b34f0 msgr2=0x7f68cc154fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:20.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.722+0000 7f68c9e00640 1 --2- 172.21.15.6:0/3907975621 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68cc0b34f0 0x7f68cc154fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:20.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.722+0000 7f68c9e00640 1 -- 172.21.15.6:0/3907975621 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68cc0b4750 msgr2=0x7f68cc0b2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:20.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.722+0000 7f68c9e00640 1 --2- 172.21.15.6:0/3907975621 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68cc0b4750 0x7f68cc0b2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:20.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.722+0000 7f68c9e00640 1 -- 172.21.15.6:0/3907975621 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68cc0b4040 con 0x7f68b0004e60 2024-09-10T20:57:20.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.722+0000 7f68c9e00640 1 --2- 172.21.15.6:0/3907975621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68b0004e60 0x7f68cc159430 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f68bc003ed0 tx=0x7f68bc0017f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:20.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.723+0000 7f68c2a00640 1 -- 172.21.15.6:0/3907975621 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68bc015070 con 0x7f68b0004e60 2024-09-10T20:57:20.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.723+0000 7f68c2a00640 1 -- 172.21.15.6:0/3907975621 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f68bc011900 con 0x7f68b0004e60 2024-09-10T20:57:20.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.723+0000 7f68c2a00640 1 -- 172.21.15.6:0/3907975621 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68bc011cf0 con 0x7f68b0004e60 2024-09-10T20:57:20.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.723+0000 7f68d1000640 1 -- 172.21.15.6:0/3907975621 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68cc0b4320 con 0x7f68b0004e60 2024-09-10T20:57:20.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.723+0000 7f68d1000640 1 -- 172.21.15.6:0/3907975621 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68cc1561c0 con 0x7f68b0004e60 2024-09-10T20:57:20.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.724+0000 7f68d1000640 1 -- 172.21.15.6:0/3907975621 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f68cc0b3df0 con 0x7f68b0004e60 2024-09-10T20:57:20.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.725+0000 7f68c2a00640 1 -- 172.21.15.6:0/3907975621 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f68bc010420 con 0x7f68b0004e60 2024-09-10T20:57:20.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.726+0000 7f68c2a00640 1 --2- 172.21.15.6:0/3907975621 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f68a8077f70 0x7f68a807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:20.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.726+0000 7f68c2a00640 1 -- 172.21.15.6:0/3907975621 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4943+0+0 (secure 0 0 0) 0x7f68bc09a780 con 0x7f68b0004e60 2024-09-10T20:57:20.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.726+0000 7f68c2a00640 1 --2- 172.21.15.6:0/3907975621 >> [v2:172.21.15.150:6802/527018351,v1:172.21.15.150:6803/527018351] conn(0x7f68a807de30 0x7f68a8080250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:20.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.726+0000 7f68c2a00640 1 -- 172.21.15.6:0/3907975621 --> [v2:172.21.15.150:6802/527018351,v1:172.21.15.150:6803/527018351] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f68bc01ce50 con 0x7f68a807de30 2024-09-10T20:57:20.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.726+0000 7f68c2a00640 1 -- 172.21.15.6:0/3907975621 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f68bc0a1050 con 0x7f68b0004e60 2024-09-10T20:57:20.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.726+0000 7f68c1400640 1 --2- 172.21.15.6:0/3907975621 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f68a8077f70 0x7f68a807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:20.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.726+0000 7f68ca800640 1 --2- 172.21.15.6:0/3907975621 >> [v2:172.21.15.150:6802/527018351,v1:172.21.15.150:6803/527018351] conn(0x7f68a807de30 0x7f68a8080250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:20.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.727+0000 7f68c1400640 1 --2- 172.21.15.6:0/3907975621 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f68a8077f70 0x7f68a807a430 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f68b4001cc0 tx=0x7f68b4006720 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:20.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.727+0000 7f68ca800640 1 --2- 172.21.15.6:0/3907975621 >> [v2:172.21.15.150:6802/527018351,v1:172.21.15.150:6803/527018351] conn(0x7f68a807de30 0x7f68a8080250 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:20.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.728+0000 7f68c2a00640 1 -- 172.21.15.6:0/3907975621 <== osd.7 v2:172.21.15.150:6802/527018351 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f68bc01ce50 con 0x7f68a807de30 2024-09-10T20:57:20.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.741+0000 7f68d1000640 1 -- 172.21.15.6:0/3907975621 --> [v2:172.21.15.150:6802/527018351,v1:172.21.15.150:6803/527018351] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f68cc0b28f0 con 0x7f68a807de30 2024-09-10T20:57:20.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.742+0000 7f68c2a00640 1 -- 172.21.15.6:0/3907975621 <== osd.7 v2:172.21.15.150:6802/527018351 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f68c4003970 con 0x7f68a807de30 2024-09-10T20:57:20.746 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-10T20:57:20.746 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T20:57:20.746 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-10T20:57:20.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.742+0000 7f68d1000640 1 -- 172.21.15.6:0/3907975621 >> [v2:172.21.15.150:6802/527018351,v1:172.21.15.150:6803/527018351] conn(0x7f68a807de30 msgr2=0x7f68a8080250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:20.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.742+0000 7f68d1000640 1 --2- 172.21.15.6:0/3907975621 >> [v2:172.21.15.150:6802/527018351,v1:172.21.15.150:6803/527018351] conn(0x7f68a807de30 0x7f68a8080250 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:20.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.742+0000 7f68d1000640 1 -- 172.21.15.6:0/3907975621 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f68a8077f70 msgr2=0x7f68a807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:20.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.742+0000 7f68d1000640 1 --2- 172.21.15.6:0/3907975621 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f68a8077f70 0x7f68a807a430 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f68b4001cc0 tx=0x7f68b4006720 comp rx=0 tx=0).stop 2024-09-10T20:57:20.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.742+0000 7f68d1000640 1 -- 172.21.15.6:0/3907975621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68b0004e60 msgr2=0x7f68cc159430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:20.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.742+0000 7f68d1000640 1 --2- 172.21.15.6:0/3907975621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68b0004e60 0x7f68cc159430 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f68bc003ed0 tx=0x7f68bc0017f0 comp rx=0 tx=0).stop 2024-09-10T20:57:20.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.742+0000 7f68ca800640 1 -- 172.21.15.6:0/3907975621 reap_dead start 2024-09-10T20:57:20.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.742+0000 7f68d1000640 1 -- 172.21.15.6:0/3907975621 shutdown_connections 2024-09-10T20:57:20.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.742+0000 7f68d1000640 1 -- 172.21.15.6:0/3907975621 >> 172.21.15.6:0/3907975621 conn(0x7f68cc0cfa20 msgr2=0x7f68cc15a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:20.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.742+0000 7f68d1000640 1 -- 172.21.15.6:0/3907975621 shutdown_connections 2024-09-10T20:57:20.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.742+0000 7f68d1000640 1 -- 172.21.15.6:0/3907975621 wait complete. 2024-09-10T20:57:20.762 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-10T20:57:20.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.919+0000 7f36ad000640 1 -- 172.21.15.6:0/2902721699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36a806eb30 msgr2=0x7f36a8073a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:20.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.919+0000 7f36ad000640 1 --2- 172.21.15.6:0/2902721699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36a806eb30 0x7f36a8073a50 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f36900098e0 tx=0x7f369002a5d0 comp rx=0 tx=0).stop 2024-09-10T20:57:20.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.919+0000 7f36ad000640 1 -- 172.21.15.6:0/2902721699 shutdown_connections 2024-09-10T20:57:20.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.919+0000 7f36ad000640 1 --2- 172.21.15.6:0/2902721699 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36a8073f90 0x7f36a80cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:20.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.919+0000 7f36ad000640 1 --2- 172.21.15.6:0/2902721699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36a806eb30 0x7f36a8073a50 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:20.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.919+0000 7f36ad000640 1 -- 172.21.15.6:0/2902721699 >> 172.21.15.6:0/2902721699 conn(0x7f36a806d660 msgr2=0x7f36a80b1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:20.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.919+0000 7f36ad000640 1 -- 172.21.15.6:0/2902721699 shutdown_connections 2024-09-10T20:57:20.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.919+0000 7f36ad000640 1 -- 172.21.15.6:0/2902721699 wait complete. 2024-09-10T20:57:20.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.920+0000 7f36ad000640 1 Processor -- start 2024-09-10T20:57:20.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.921+0000 7f36ad000640 1 -- start start 2024-09-10T20:57:20.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.922+0000 7f36ad000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36a806eb30 0x7f36a8151310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:20.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.922+0000 7f36ad000640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36a8073f90 0x7f36a80b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:20.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.922+0000 7f36ad000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36a81592f0 0x7f36a80b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:20.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.922+0000 7f36ad000640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f36a80cc2d0 con 0x7f36a8073f90 2024-09-10T20:57:20.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.922+0000 7f36ad000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f36a80cc150 con 0x7f36a81592f0 2024-09-10T20:57:20.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.922+0000 7f36ad000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f36a80cc450 con 0x7f36a806eb30 2024-09-10T20:57:20.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.922+0000 7f369ea00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36a8073f90 0x7f36a80b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:20.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.922+0000 7f369ea00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36a8073f90 0x7f36a80b01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45386/0 (socket says 172.21.15.6:45386) 2024-09-10T20:57:20.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.922+0000 7f369ea00640 1 -- 172.21.15.6:0/2799783354 learned_addr learned my addr 172.21.15.6:0/2799783354 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:20.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.922+0000 7f36a7400640 1 --2- 172.21.15.6:0/2799783354 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36a806eb30 0x7f36a8151310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:20.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.922+0000 7f36a7e00640 1 --2- 172.21.15.6:0/2799783354 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36a81592f0 0x7f36a80b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:20.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.922+0000 7f369ea00640 1 -- 172.21.15.6:0/2799783354 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36a806eb30 msgr2=0x7f36a8151310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:20.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.922+0000 7f369ea00640 1 --2- 172.21.15.6:0/2799783354 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36a806eb30 0x7f36a8151310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:20.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.922+0000 7f369ea00640 1 -- 172.21.15.6:0/2799783354 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36a81592f0 msgr2=0x7f36a80b06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:20.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.922+0000 7f369ea00640 1 --2- 172.21.15.6:0/2799783354 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36a81592f0 0x7f36a80b06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:20.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.922+0000 7f369ea00640 1 -- 172.21.15.6:0/2799783354 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36a80a9960 con 0x7f36a8073f90 2024-09-10T20:57:20.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.922+0000 7f36a7400640 1 --2- 172.21.15.6:0/2799783354 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36a806eb30 0x7f36a8151310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:57:20.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.923+0000 7f369ea00640 1 --2- 172.21.15.6:0/2799783354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36a8073f90 0x7f36a80b01a0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3690009a00 tx=0x7f3690031690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:20.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.923+0000 7f369fe00640 1 -- 172.21.15.6:0/2799783354 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3690004460 con 0x7f36a8073f90 2024-09-10T20:57:20.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.923+0000 7f369fe00640 1 -- 172.21.15.6:0/2799783354 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3690005230 con 0x7f36a8073f90 2024-09-10T20:57:20.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.923+0000 7f36ad000640 1 -- 172.21.15.6:0/2799783354 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36a80ac520 con 0x7f36a8073f90 2024-09-10T20:57:20.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.923+0000 7f369fe00640 1 -- 172.21.15.6:0/2799783354 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3690005660 con 0x7f36a8073f90 2024-09-10T20:57:20.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.923+0000 7f36ad000640 1 -- 172.21.15.6:0/2799783354 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36a80acae0 con 0x7f36a8073f90 2024-09-10T20:57:20.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.924+0000 7f36ad000640 1 -- 172.21.15.6:0/2799783354 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36a815f210 con 0x7f36a8073f90 2024-09-10T20:57:20.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.925+0000 7f369fe00640 1 -- 172.21.15.6:0/2799783354 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f369004c030 con 0x7f36a8073f90 2024-09-10T20:57:20.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.926+0000 7f369fe00640 1 --2- 172.21.15.6:0/2799783354 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3684077f70 0x7f368407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:20.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.926+0000 7f369fe00640 1 -- 172.21.15.6:0/2799783354 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4943+0+0 (secure 0 0 0) 0x7f36900ba9e0 con 0x7f36a8073f90 2024-09-10T20:57:20.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.927+0000 7f36a7400640 1 --2- 172.21.15.6:0/2799783354 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3684077f70 0x7f368407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:20.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.927+0000 7f36a7400640 1 --2- 172.21.15.6:0/2799783354 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3684077f70 0x7f368407a430 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3698001b10 tx=0x7f3698009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:20.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:20.930+0000 7f369fe00640 1 -- 172.21.15.6:0/2799783354 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f3690040030 con 0x7f36a8073f90 2024-09-10T20:57:21.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.122+0000 7f36ad000640 1 -- 172.21.15.6:0/2799783354 --> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f36a80ac310 con 0x7f3684077f70 2024-09-10T20:57:21.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.123+0000 7f369fe00640 1 -- 172.21.15.6:0/2799783354 <== mgr.4120 v2:172.21.15.150:6800/1238179351 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f36a80ac310 con 0x7f3684077f70 2024-09-10T20:57:21.126 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 7 to deep-scrub 2024-09-10T20:57:21.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.125+0000 7f36ad000640 1 -- 172.21.15.6:0/2799783354 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3684077f70 msgr2=0x7f368407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:21.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.125+0000 7f36ad000640 1 --2- 172.21.15.6:0/2799783354 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3684077f70 0x7f368407a430 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3698001b10 tx=0x7f3698009040 comp rx=0 tx=0).stop 2024-09-10T20:57:21.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.125+0000 7f36ad000640 1 -- 172.21.15.6:0/2799783354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36a8073f90 msgr2=0x7f36a80b01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:21.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.125+0000 7f36ad000640 1 --2- 172.21.15.6:0/2799783354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36a8073f90 0x7f36a80b01a0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3690009a00 tx=0x7f3690031690 comp rx=0 tx=0).stop 2024-09-10T20:57:21.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.125+0000 7f36ad000640 1 -- 172.21.15.6:0/2799783354 shutdown_connections 2024-09-10T20:57:21.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.125+0000 7f36ad000640 1 --2- 172.21.15.6:0/2799783354 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f3684077f70 0x7f368407a430 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:21.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.125+0000 7f36ad000640 1 --2- 172.21.15.6:0/2799783354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36a8073f90 0x7f36a80b01a0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:21.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.125+0000 7f36ad000640 1 --2- 172.21.15.6:0/2799783354 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36a81592f0 0x7f36a80b06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:21.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.125+0000 7f36ad000640 1 --2- 172.21.15.6:0/2799783354 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36a806eb30 0x7f36a8151310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:21.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.125+0000 7f36ad000640 1 -- 172.21.15.6:0/2799783354 >> 172.21.15.6:0/2799783354 conn(0x7f36a806d660 msgr2=0x7f36a80c8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:21.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.125+0000 7f36ad000640 1 -- 172.21.15.6:0/2799783354 shutdown_connections 2024-09-10T20:57:21.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.125+0000 7f36ad000640 1 -- 172.21.15.6:0/2799783354 wait complete. 2024-09-10T20:57:21.145 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T20:57:21.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.305+0000 7f4de1800640 1 -- 172.21.15.6:0/3658884681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dc0003a50 msgr2=0x7f4dc0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:21.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.305+0000 7f4de1800640 1 --2- 172.21.15.6:0/3658884681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dc0003a50 0x7f4dc0003e70 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc009b50 tx=0x7f4dc0005830 comp rx=0 tx=0).stop 2024-09-10T20:57:21.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.306+0000 7f4de1800640 1 -- 172.21.15.6:0/3658884681 shutdown_connections 2024-09-10T20:57:21.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.306+0000 7f4de1800640 1 --2- 172.21.15.6:0/3658884681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dc0003a50 0x7f4dc0003e70 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:21.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.306+0000 7f4de1800640 1 -- 172.21.15.6:0/3658884681 >> 172.21.15.6:0/3658884681 conn(0x7f4ddc09d0a0 msgr2=0x7f4ddc0d3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:21.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.306+0000 7f4de1800640 1 -- 172.21.15.6:0/3658884681 shutdown_connections 2024-09-10T20:57:21.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.306+0000 7f4de1800640 1 -- 172.21.15.6:0/3658884681 wait complete. 2024-09-10T20:57:21.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.307+0000 7f4de1800640 1 Processor -- start 2024-09-10T20:57:21.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.307+0000 7f4de1800640 1 -- start start 2024-09-10T20:57:21.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.308+0000 7f4de1800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4dc0003a50 0x7f4ddc0b6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:21.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.308+0000 7f4de1800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ddc0b9120 0x7f4ddc0ca1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:21.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.308+0000 7f4de1800640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ddc1f8020 0x7f4ddc1f84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:21.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.308+0000 7f4de1800640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4ddc162190 con 0x7f4ddc1f8020 2024-09-10T20:57:21.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.308+0000 7f4de1800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4ddc162010 con 0x7f4ddc0b9120 2024-09-10T20:57:21.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.308+0000 7f4de1800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f4ddc0d46a0 con 0x7f4dc0003a50 2024-09-10T20:57:21.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.309+0000 7f4de0e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ddc1f8020 0x7f4ddc1f84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:21.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.309+0000 7f4de0e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ddc1f8020 0x7f4ddc1f84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45406/0 (socket says 172.21.15.6:45406) 2024-09-10T20:57:21.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.309+0000 7f4de0e00640 1 -- 172.21.15.6:0/1105025266 learned_addr learned my addr 172.21.15.6:0/1105025266 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:21.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.309+0000 7f4ddbe00640 1 --2- 172.21.15.6:0/1105025266 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4dc0003a50 0x7f4ddc0b6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:21.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.309+0000 7f4dd3e00640 1 --2- 172.21.15.6:0/1105025266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ddc0b9120 0x7f4ddc0ca1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:21.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.309+0000 7f4de0e00640 1 -- 172.21.15.6:0/1105025266 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4dc0003a50 msgr2=0x7f4ddc0b6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:21.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.309+0000 7f4de0e00640 1 --2- 172.21.15.6:0/1105025266 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4dc0003a50 0x7f4ddc0b6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:21.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.309+0000 7f4de0e00640 1 -- 172.21.15.6:0/1105025266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ddc0b9120 msgr2=0x7f4ddc0ca1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:21.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.309+0000 7f4de0e00640 1 --2- 172.21.15.6:0/1105025266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ddc0b9120 0x7f4ddc0ca1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:21.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.309+0000 7f4de0e00640 1 -- 172.21.15.6:0/1105025266 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ddc0cb360 con 0x7f4ddc1f8020 2024-09-10T20:57:21.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.309+0000 7f4de0e00640 1 --2- 172.21.15.6:0/1105025266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ddc1f8020 0x7f4ddc1f84d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc08d1d0 tx=0x7f4dd4006430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:21.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.309+0000 7f4dd8c00640 1 -- 172.21.15.6:0/1105025266 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd4011900 con 0x7f4ddc1f8020 2024-09-10T20:57:21.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.310+0000 7f4dd8c00640 1 -- 172.21.15.6:0/1105025266 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4dd4018070 con 0x7f4ddc1f8020 2024-09-10T20:57:21.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.310+0000 7f4dd8c00640 1 -- 172.21.15.6:0/1105025266 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd4011d60 con 0x7f4ddc1f8020 2024-09-10T20:57:21.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.310+0000 7f4de1800640 1 -- 172.21.15.6:0/1105025266 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ddc1f8df0 con 0x7f4ddc1f8020 2024-09-10T20:57:21.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.310+0000 7f4de1800640 1 -- 172.21.15.6:0/1105025266 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ddc0b9890 con 0x7f4ddc1f8020 2024-09-10T20:57:21.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.311+0000 7f4de1800640 1 -- 172.21.15.6:0/1105025266 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ddc0cb650 con 0x7f4ddc1f8020 2024-09-10T20:57:21.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.312+0000 7f4dd8c00640 1 -- 172.21.15.6:0/1105025266 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4dd401d460 con 0x7f4ddc1f8020 2024-09-10T20:57:21.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.313+0000 7f4dd8c00640 1 --2- 172.21.15.6:0/1105025266 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4db8077fa0 0x7f4db807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:21.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.313+0000 7f4dd8c00640 1 -- 172.21.15.6:0/1105025266 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4943+0+0 (secure 0 0 0) 0x7f4dd409a3b0 con 0x7f4ddc1f8020 2024-09-10T20:57:21.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.313+0000 7f4ddbe00640 1 --2- 172.21.15.6:0/1105025266 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4db8077fa0 0x7f4db807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:21.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.314+0000 7f4ddbe00640 1 --2- 172.21.15.6:0/1105025266 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4db8077fa0 0x7f4db807a460 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc035000 tx=0x7f4dcc0046c0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:21.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.317+0000 7f4dd8c00640 1 -- 172.21.15.6:0/1105025266 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4dd4063110 con 0x7f4ddc1f8020 2024-09-10T20:57:21.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.510+0000 7f4de1800640 1 -- 172.21.15.6:0/1105025266 --> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4ddc0d4c00 con 0x7f4db8077fa0 2024-09-10T20:57:21.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.512+0000 7f4dd8c00640 1 -- 172.21.15.6:0/1105025266 <== mgr.4120 v2:172.21.15.150:6800/1238179351 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13345 (secure 0 0 0) 0x7f4ddc0d4c00 con 0x7f4db8077fa0 2024-09-10T20:57:21.516 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:57:21.516 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-10T20:57:21.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.514+0000 7f4de1800640 1 -- 172.21.15.6:0/1105025266 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4db8077fa0 msgr2=0x7f4db807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:21.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.514+0000 7f4de1800640 1 --2- 172.21.15.6:0/1105025266 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4db8077fa0 0x7f4db807a460 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc035000 tx=0x7f4dcc0046c0 comp rx=0 tx=0).stop 2024-09-10T20:57:21.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.514+0000 7f4de1800640 1 -- 172.21.15.6:0/1105025266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ddc1f8020 msgr2=0x7f4ddc1f84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:21.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.514+0000 7f4de1800640 1 --2- 172.21.15.6:0/1105025266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ddc1f8020 0x7f4ddc1f84d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc08d1d0 tx=0x7f4dd4006430 comp rx=0 tx=0).stop 2024-09-10T20:57:21.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.514+0000 7f4de1800640 1 -- 172.21.15.6:0/1105025266 shutdown_connections 2024-09-10T20:57:21.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.514+0000 7f4de1800640 1 --2- 172.21.15.6:0/1105025266 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f4db8077fa0 0x7f4db807a460 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:21.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.514+0000 7f4de1800640 1 --2- 172.21.15.6:0/1105025266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ddc1f8020 0x7f4ddc1f84d0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:21.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.514+0000 7f4de1800640 1 --2- 172.21.15.6:0/1105025266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ddc0b9120 0x7f4ddc0ca1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:21.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.514+0000 7f4de1800640 1 --2- 172.21.15.6:0/1105025266 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4dc0003a50 0x7f4ddc0b6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:21.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.514+0000 7f4de1800640 1 -- 172.21.15.6:0/1105025266 >> 172.21.15.6:0/1105025266 conn(0x7f4ddc09d0a0 msgr2=0x7f4ddc06d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:21.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.514+0000 7f4de1800640 1 -- 172.21.15.6:0/1105025266 shutdown_connections 2024-09-10T20:57:21.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:21.514+0000 7f4de1800640 1 -- 172.21.15.6:0/1105025266 wait complete. 2024-09-10T20:57:21.534 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2024-09-10T20:57:21.195197+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":229552,"kb_used_data":4968,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754745168,"statfs":{"total":773094113280,"available":772859052032,"internally_reserved":0,"allocated":5087232,"data_stored":2759032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":-1,"num_object_clones":0,"num_object_copies":-2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":-4,"num_read_kb":-4,"num_write":-6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001966"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":148,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T20:57:11.222343+0000","last_change":"2024-09-10T20:55:34.718784+0000","last_active":"2024-09-10T20:57:11.222343+0000","last_peered":"2024-09-10T20:57:11.222343+0000","last_clean":"2024-09-10T20:57:11.222343+0000","last_became_active":"2024-09-10T20:55:34.717616+0000","last_became_peered":"2024-09-10T20:55:34.717616+0000","last_unstale":"2024-09-10T20:57:11.222343+0000","last_undegraded":"2024-09-10T20:57:11.222343+0000","last_fullsized":"2024-09-10T20:57:11.222343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:55:33.618098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:55:33.618098+0000","last_clean_scrub_stamp":"2024-09-10T20:55:33.618098+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:30:17.442729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509465,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28092,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343748,"statfs":{"total":96636764160,"available":96607997952,"internally_reserved":0,"allocated":1081344,"data_stored":787655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27508,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":487424,"data_stored":197287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27504,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":487424,"data_stored":197287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31664,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340176,"statfs":{"total":96636764160,"available":96604340224,"internally_reserved":0,"allocated":487424,"data_stored":197287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27512,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":487424,"data_stored":197287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27512,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":487424,"data_stored":197287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509463,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28088,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":1081344,"data_stored":787655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542168,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31672,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340168,"statfs":{"total":96636764160,"available":96604332032,"internally_reserved":0,"allocated":487424,"data_stored":197287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T20:57:21.537 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-10T20:55:33.618098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=20, tm_min=55, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=20, tm_min=57, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T20:57:21.538 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T20:57:38.787 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T20:57:38.792 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T20:57:41.538 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T20:57:41.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.697+0000 7fabe1400640 1 -- 172.21.15.6:0/236203860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabdc0cf340 msgr2=0x7fabdc161a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:41.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.697+0000 7fabe1400640 1 --2- 172.21.15.6:0/236203860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabdc0cf340 0x7fabdc161a20 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fabc4009830 tx=0x7fabc402a510 comp rx=0 tx=0).stop 2024-09-10T20:57:41.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.697+0000 7fabe1400640 1 -- 172.21.15.6:0/236203860 shutdown_connections 2024-09-10T20:57:41.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.697+0000 7fabe1400640 1 --2- 172.21.15.6:0/236203860 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fabdc161f60 0x7fabdc0ad880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:41.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.697+0000 7fabe1400640 1 --2- 172.21.15.6:0/236203860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabdc0cf340 0x7fabdc161a20 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:41.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.697+0000 7fabe1400640 1 -- 172.21.15.6:0/236203860 >> 172.21.15.6:0/236203860 conn(0x7fabdc0cfa20 msgr2=0x7fabdc0cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:41.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.697+0000 7fabe1400640 1 -- 172.21.15.6:0/236203860 shutdown_connections 2024-09-10T20:57:41.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.697+0000 7fabe1400640 1 -- 172.21.15.6:0/236203860 wait complete. 2024-09-10T20:57:41.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.699+0000 7fabe1400640 1 Processor -- start 2024-09-10T20:57:41.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.699+0000 7fabe1400640 1 -- start start 2024-09-10T20:57:41.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.700+0000 7fabe1400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fabdc0cf340 0x7fabdc06f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:41.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.700+0000 7fabe1400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabdc15bb30 0x7fabdc159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:41.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.700+0000 7fabe1400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fabdc161f60 0x7fabdc15a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:41.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.700+0000 7fabe1400640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fabdc0ae150 con 0x7fabdc15bb30 2024-09-10T20:57:41.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.700+0000 7fabe1400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fabdc0adfd0 con 0x7fabdc0cf340 2024-09-10T20:57:41.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.700+0000 7fabe1400640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fabdc0ae2d0 con 0x7fabdc161f60 2024-09-10T20:57:41.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.700+0000 7fabd1e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabdc15bb30 0x7fabdc159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:41.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.700+0000 7fabd1e00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabdc15bb30 0x7fabdc159bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42898/0 (socket says 172.21.15.6:42898) 2024-09-10T20:57:41.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.700+0000 7fabd1e00640 1 -- 172.21.15.6:0/2779820075 learned_addr learned my addr 172.21.15.6:0/2779820075 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:41.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.700+0000 7fabdb200640 1 --2- 172.21.15.6:0/2779820075 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fabdc161f60 0x7fabdc15a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:41.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.700+0000 7fabda800640 1 --2- 172.21.15.6:0/2779820075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fabdc0cf340 0x7fabdc06f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:41.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.701+0000 7fabd1e00640 1 -- 172.21.15.6:0/2779820075 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fabdc161f60 msgr2=0x7fabdc15a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:41.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.701+0000 7fabd1e00640 1 --2- 172.21.15.6:0/2779820075 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fabdc161f60 0x7fabdc15a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:41.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.701+0000 7fabd1e00640 1 -- 172.21.15.6:0/2779820075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fabdc0cf340 msgr2=0x7fabdc06f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:41.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.701+0000 7fabd1e00640 1 --2- 172.21.15.6:0/2779820075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fabdc0cf340 0x7fabdc06f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:41.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.701+0000 7fabd1e00640 1 -- 172.21.15.6:0/2779820075 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabdc15a650 con 0x7fabdc15bb30 2024-09-10T20:57:41.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.701+0000 7fabdb200640 1 --2- 172.21.15.6:0/2779820075 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fabdc161f60 0x7fabdc15a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:57:41.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.701+0000 7fabda800640 1 --2- 172.21.15.6:0/2779820075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fabdc0cf340 0x7fabdc06f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:57:41.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.701+0000 7fabd1e00640 1 --2- 172.21.15.6:0/2779820075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabdc15bb30 0x7fabdc159bd0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fabc4009950 tx=0x7fabc4032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:41.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.701+0000 7fabd3400640 1 -- 172.21.15.6:0/2779820075 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc4040070 con 0x7fabdc15bb30 2024-09-10T20:57:41.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.701+0000 7fabd3400640 1 -- 172.21.15.6:0/2779820075 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fabc4005310 con 0x7fabdc15bb30 2024-09-10T20:57:41.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.701+0000 7fabd3400640 1 -- 172.21.15.6:0/2779820075 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc40047a0 con 0x7fabdc15bb30 2024-09-10T20:57:41.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.701+0000 7fabe1400640 1 -- 172.21.15.6:0/2779820075 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabdc1f90b0 con 0x7fabdc15bb30 2024-09-10T20:57:41.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.701+0000 7fabe1400640 1 -- 172.21.15.6:0/2779820075 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabdc0b2de0 con 0x7fabdc15bb30 2024-09-10T20:57:41.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.702+0000 7fabe1400640 1 -- 172.21.15.6:0/2779820075 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabdc0ae780 con 0x7fabdc15bb30 2024-09-10T20:57:41.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.703+0000 7fabd3400640 1 -- 172.21.15.6:0/2779820075 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fabc404c030 con 0x7fabdc15bb30 2024-09-10T20:57:41.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.704+0000 7fabd3400640 1 --2- 172.21.15.6:0/2779820075 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fabb8077f70 0x7fabb807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:41.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.704+0000 7fabd3400640 1 -- 172.21.15.6:0/2779820075 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4943+0+0 (secure 0 0 0) 0x7fabc40baf00 con 0x7fabdc15bb30 2024-09-10T20:57:41.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.705+0000 7fabda800640 1 --2- 172.21.15.6:0/2779820075 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fabb8077f70 0x7fabb807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:41.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.706+0000 7fabda800640 1 --2- 172.21.15.6:0/2779820075 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fabb8077f70 0x7fabb807a430 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fabcc000f60 tx=0x7fabcc009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:41.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.709+0000 7fabd3400640 1 -- 172.21.15.6:0/2779820075 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fabc4083c60 con 0x7fabdc15bb30 2024-09-10T20:57:41.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.902+0000 7fabe1400640 1 -- 172.21.15.6:0/2779820075 --> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fabdc0d0850 con 0x7fabb8077f70 2024-09-10T20:57:41.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.903+0000 7fabd3400640 1 -- 172.21.15.6:0/2779820075 <== mgr.4120 v2:172.21.15.150:6800/1238179351 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13344 (secure 0 0 0) 0x7fabdc0d0850 con 0x7fabb8077f70 2024-09-10T20:57:41.908 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:57:41.908 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-10T20:57:41.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.906+0000 7fabe1400640 1 -- 172.21.15.6:0/2779820075 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fabb8077f70 msgr2=0x7fabb807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:41.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.906+0000 7fabe1400640 1 --2- 172.21.15.6:0/2779820075 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fabb8077f70 0x7fabb807a430 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fabcc000f60 tx=0x7fabcc009040 comp rx=0 tx=0).stop 2024-09-10T20:57:41.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.906+0000 7fabe1400640 1 -- 172.21.15.6:0/2779820075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabdc15bb30 msgr2=0x7fabdc159bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:41.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.906+0000 7fabe1400640 1 --2- 172.21.15.6:0/2779820075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabdc15bb30 0x7fabdc159bd0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fabc4009950 tx=0x7fabc4032c10 comp rx=0 tx=0).stop 2024-09-10T20:57:41.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.906+0000 7fabe1400640 1 -- 172.21.15.6:0/2779820075 shutdown_connections 2024-09-10T20:57:41.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.906+0000 7fabe1400640 1 --2- 172.21.15.6:0/2779820075 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fabb8077f70 0x7fabb807a430 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:41.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.906+0000 7fabe1400640 1 --2- 172.21.15.6:0/2779820075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabdc15bb30 0x7fabdc159bd0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:41.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.906+0000 7fabe1400640 1 --2- 172.21.15.6:0/2779820075 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fabdc161f60 0x7fabdc15a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:41.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.906+0000 7fabe1400640 1 --2- 172.21.15.6:0/2779820075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fabdc0cf340 0x7fabdc06f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:41.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.906+0000 7fabe1400640 1 -- 172.21.15.6:0/2779820075 >> 172.21.15.6:0/2779820075 conn(0x7fabdc0cfa20 msgr2=0x7fabdc0b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:41.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.906+0000 7fabe1400640 1 -- 172.21.15.6:0/2779820075 shutdown_connections 2024-09-10T20:57:41.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:41.906+0000 7fabe1400640 1 -- 172.21.15.6:0/2779820075 wait complete. 2024-09-10T20:57:41.926 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":100,"stamp":"2024-09-10T20:57:41.200149+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":229532,"kb_used_data":4968,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754745188,"statfs":{"total":773094113280,"available":772859072512,"internally_reserved":0,"allocated":5087232,"data_stored":2759032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003128"},"pg_stats":[{"pgid":"1.0","version":"42'74","reported_seq":159,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T20:57:21.236080+0000","last_change":"2024-09-10T20:57:21.236026+0000","last_active":"2024-09-10T20:57:21.236080+0000","last_peered":"2024-09-10T20:57:21.236080+0000","last_clean":"2024-09-10T20:57:21.236080+0000","last_became_active":"2024-09-10T20:55:34.717616+0000","last_became_peered":"2024-09-10T20:55:34.717616+0000","last_unstale":"2024-09-10T20:57:21.236080+0000","last_undegraded":"2024-09-10T20:57:21.236080+0000","last_fullsized":"2024-09-10T20:57:21.236080+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'74","last_scrub_stamp":"2024-09-10T20:57:21.235947+0000","last_deep_scrub":"42'74","last_deep_scrub_stamp":"2024-09-10T20:57:21.235947+0000","last_clean_scrub_stamp":"2024-09-10T20:57:21.235947+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:57:36.406975+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509469,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1081344,"data_stored":787655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509467,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27508,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":487424,"data_stored":197287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509468,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27504,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":487424,"data_stored":197287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509467,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31664,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340176,"statfs":{"total":96636764160,"available":96604340224,"internally_reserved":0,"allocated":487424,"data_stored":197287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509467,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27512,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":487424,"data_stored":197287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509468,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27512,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":487424,"data_stored":197287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509467,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1081344,"data_stored":787655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542172,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31672,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340168,"statfs":{"total":96636764160,"available":96604332032,"internally_reserved":0,"allocated":487424,"data_stored":197287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T20:57:41.927 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-10T20:57:42.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.077+0000 7f71fb200640 1 -- 172.21.15.6:0/10105726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71f4159670 msgr2=0x7f71f40743b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:42.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.077+0000 7f71fb200640 1 --2- 172.21.15.6:0/10105726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71f4159670 0x7f71f40743b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f71f40cc450 tx=0x7f71e402aa30 comp rx=0 tx=0).stop 2024-09-10T20:57:42.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.078+0000 7f71fb200640 1 -- 172.21.15.6:0/10105726 shutdown_connections 2024-09-10T20:57:42.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.078+0000 7f71fb200640 1 --2- 172.21.15.6:0/10105726 >> v2:172.21.15.150:3300/0 conn(0x7f71f415c170 0x7f71f40cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:42.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.078+0000 7f71fb200640 1 --2- 172.21.15.6:0/10105726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71f4159670 0x7f71f40743b0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:42.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.078+0000 7f71fb200640 1 -- 172.21.15.6:0/10105726 >> 172.21.15.6:0/10105726 conn(0x7f71f40cfa20 msgr2=0x7f71f40cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:42.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.078+0000 7f71fb200640 1 -- 172.21.15.6:0/10105726 shutdown_connections 2024-09-10T20:57:42.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.078+0000 7f71fb200640 1 -- 172.21.15.6:0/10105726 wait complete. 2024-09-10T20:57:42.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.079+0000 7f71fb200640 1 Processor -- start 2024-09-10T20:57:42.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.080+0000 7f71fb200640 1 -- start start 2024-09-10T20:57:42.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.080+0000 7f71fb200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71f406fd40 0x7f71f40c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:42.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.080+0000 7f71fb200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71f4159670 0x7f71f415b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:42.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.080+0000 7f71fb200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71f415c170 0x7f71f4157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:42.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.080+0000 7f71fb200640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f71f40b4a90 con 0x7f71f415c170 2024-09-10T20:57:42.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.081+0000 7f71fb200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f71f40b4910 con 0x7f71f406fd40 2024-09-10T20:57:42.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.081+0000 7f71fb200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f71f40b4c10 con 0x7f71f4159670 2024-09-10T20:57:42.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.081+0000 7f71f9200640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71f415c170 0x7f71f4157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:42.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.081+0000 7f71f3400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71f4159670 0x7f71f415b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:42.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.081+0000 7f71f3e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71f406fd40 0x7f71f40c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:42.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.081+0000 7f71f3e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71f406fd40 0x7f71f40c6af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.6:54714/0 (socket says 172.21.15.6:54714) 2024-09-10T20:57:42.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.081+0000 7f71f3e00640 1 -- 172.21.15.6:0/1657363923 learned_addr learned my addr 172.21.15.6:0/1657363923 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:42.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.081+0000 7f71f3400640 1 -- 172.21.15.6:0/1657363923 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71f406fd40 msgr2=0x7f71f40c6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:42.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.081+0000 7f71f3400640 1 --2- 172.21.15.6:0/1657363923 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71f406fd40 0x7f71f40c6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:42.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.081+0000 7f71f3400640 1 -- 172.21.15.6:0/1657363923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71f415c170 msgr2=0x7f71f4157940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:42.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.081+0000 7f71f3400640 1 --2- 172.21.15.6:0/1657363923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71f415c170 0x7f71f4157940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:42.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.081+0000 7f71f3400640 1 -- 172.21.15.6:0/1657363923 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71f41f7e20 con 0x7f71f4159670 2024-09-10T20:57:42.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.081+0000 7f71f9200640 1 --2- 172.21.15.6:0/1657363923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71f415c170 0x7f71f4157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:57:42.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.082+0000 7f71f3400640 1 --2- 172.21.15.6:0/1657363923 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71f4159670 0x7f71f415b950 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f71e000d720 tx=0x7f71e000dbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:42.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.082+0000 7f71ebe00640 1 -- 172.21.15.6:0/1657363923 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e0017070 con 0x7f71f4159670 2024-09-10T20:57:42.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.082+0000 7f71ebe00640 1 -- 172.21.15.6:0/1657363923 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f71e0004310 con 0x7f71f4159670 2024-09-10T20:57:42.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.082+0000 7f71ebe00640 1 -- 172.21.15.6:0/1657363923 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e0005280 con 0x7f71f4159670 2024-09-10T20:57:42.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.082+0000 7f71fb200640 1 -- 172.21.15.6:0/1657363923 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71f41f80c0 con 0x7f71f4159670 2024-09-10T20:57:42.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.082+0000 7f71fb200640 1 -- 172.21.15.6:0/1657363923 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f71f4157e80 con 0x7f71f4159670 2024-09-10T20:57:42.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.083+0000 7f71fb200640 1 -- 172.21.15.6:0/1657363923 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71f40b50c0 con 0x7f71f4159670 2024-09-10T20:57:42.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.085+0000 7f71ebe00640 1 -- 172.21.15.6:0/1657363923 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f71e0005420 con 0x7f71f4159670 2024-09-10T20:57:42.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.086+0000 7f71ebe00640 1 --2- 172.21.15.6:0/1657363923 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f71d4077f70 0x7f71d407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:42.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.086+0000 7f71ebe00640 1 -- 172.21.15.6:0/1657363923 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(42..42 src has 1..42) ==== 4943+0+0 (secure 0 0 0) 0x7f71e009a3f0 con 0x7f71f4159670 2024-09-10T20:57:42.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.086+0000 7f71f3e00640 1 --2- 172.21.15.6:0/1657363923 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f71d4077f70 0x7f71d407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:42.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.087+0000 7f71f3e00640 1 --2- 172.21.15.6:0/1657363923 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f71d4077f70 0x7f71d407a430 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f71e4009a60 tx=0x7f71e403a040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:42.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.090+0000 7f71ebe00640 1 -- 172.21.15.6:0/1657363923 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f71e0020020 con 0x7f71f4159670 2024-09-10T20:57:42.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.283+0000 7f71fb200640 1 -- 172.21.15.6:0/1657363923 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f71f4069d20 con 0x7f71f4159670 2024-09-10T20:57:42.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.291+0000 7f71ebe00640 1 -- 172.21.15.6:0/1657363923 <== mon.2 v2:172.21.15.150:3301/0 7 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f71e0062690 con 0x7f71f4159670 2024-09-10T20:57:42.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.291+0000 7f71ebe00640 1 -- 172.21.15.6:0/1657363923 <== mon.2 v2:172.21.15.150:3301/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v32)=0 v32) ==== 123+0+0 (secure 0 0 0) 0x7f71e0062b80 con 0x7f71f4159670 2024-09-10T20:57:42.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.293+0000 7f71fb200640 1 -- 172.21.15.6:0/1657363923 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f71d4077f70 msgr2=0x7f71d407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:42.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.293+0000 7f71fb200640 1 --2- 172.21.15.6:0/1657363923 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f71d4077f70 0x7f71d407a430 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f71e4009a60 tx=0x7f71e403a040 comp rx=0 tx=0).stop 2024-09-10T20:57:42.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.293+0000 7f71fb200640 1 -- 172.21.15.6:0/1657363923 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71f4159670 msgr2=0x7f71f415b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:42.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.293+0000 7f71fb200640 1 --2- 172.21.15.6:0/1657363923 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71f4159670 0x7f71f415b950 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f71e000d720 tx=0x7f71e000dbe0 comp rx=0 tx=0).stop 2024-09-10T20:57:42.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.293+0000 7f71fb200640 1 -- 172.21.15.6:0/1657363923 shutdown_connections 2024-09-10T20:57:42.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.293+0000 7f71fb200640 1 --2- 172.21.15.6:0/1657363923 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7f71d4077f70 0x7f71d407a430 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:42.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.293+0000 7f71fb200640 1 --2- 172.21.15.6:0/1657363923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71f415c170 0x7f71f4157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:42.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.293+0000 7f71fb200640 1 --2- 172.21.15.6:0/1657363923 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71f4159670 0x7f71f415b950 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:42.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.293+0000 7f71fb200640 1 --2- 172.21.15.6:0/1657363923 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71f406fd40 0x7f71f40c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:42.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.293+0000 7f71fb200640 1 -- 172.21.15.6:0/1657363923 >> 172.21.15.6:0/1657363923 conn(0x7f71f40cfa20 msgr2=0x7f71f4073dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:42.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.294+0000 7f71fb200640 1 -- 172.21.15.6:0/1657363923 shutdown_connections 2024-09-10T20:57:42.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.294+0000 7f71fb200640 1 -- 172.21.15.6:0/1657363923 wait complete. 2024-09-10T20:57:42.313 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T20:57:42.314 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:57:42.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.469+0000 7fecfa400640 1 -- 172.21.15.6:0/3351918173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecf40cd610 msgr2=0x7fecf40cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:42.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.469+0000 7fecfa400640 1 --2- 172.21.15.6:0/3351918173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecf40cd610 0x7fecf40cebb0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fecec005fd0 tx=0x7fecec02aa00 comp rx=0 tx=0).stop 2024-09-10T20:57:42.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.470+0000 7fecfa400640 1 -- 172.21.15.6:0/3351918173 shutdown_connections 2024-09-10T20:57:42.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.470+0000 7fecfa400640 1 --2- 172.21.15.6:0/3351918173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecf40cd610 0x7fecf40cebb0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:42.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.470+0000 7fecfa400640 1 --2- 172.21.15.6:0/3351918173 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fecf40d0890 0x7fecf415bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:42.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.470+0000 7fecfa400640 1 -- 172.21.15.6:0/3351918173 >> 172.21.15.6:0/3351918173 conn(0x7fecf40b55e0 msgr2=0x7fecf40b59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:42.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.470+0000 7fecfa400640 1 -- 172.21.15.6:0/3351918173 shutdown_connections 2024-09-10T20:57:42.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.470+0000 7fecfa400640 1 -- 172.21.15.6:0/3351918173 wait complete. 2024-09-10T20:57:42.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.471+0000 7fecfa400640 1 Processor -- start 2024-09-10T20:57:42.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.471+0000 7fecfa400640 1 -- start start 2024-09-10T20:57:42.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.472+0000 7fecfa400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fecf40cd610 0x7fecf414b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:42.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.472+0000 7fecfa400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecf40d0890 0x7fecf40c9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:42.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.472+0000 7fecfa400640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecf415bb60 0x7fecf40b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:42.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.472+0000 7fecfa400640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fecf40cf270 con 0x7fecf415bb60 2024-09-10T20:57:42.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.472+0000 7fecfa400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fecf40cf0f0 con 0x7fecf40d0890 2024-09-10T20:57:42.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.472+0000 7fecfa400640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fecf40cf3f0 con 0x7fecf40cd610 2024-09-10T20:57:42.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.473+0000 7fecf9a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecf415bb60 0x7fecf40b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:42.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.473+0000 7fecf9a00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecf415bb60 0x7fecf40b1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42928/0 (socket says 172.21.15.6:42928) 2024-09-10T20:57:42.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.473+0000 7fecf9a00640 1 -- 172.21.15.6:0/1079277210 learned_addr learned my addr 172.21.15.6:0/1079277210 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-09-10T20:57:42.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.473+0000 7fecebe00640 1 --2- 172.21.15.6:0/1079277210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecf40d0890 0x7fecf40c9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:42.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.473+0000 7fecf9000640 1 --2- 172.21.15.6:0/1079277210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fecf40cd610 0x7fecf414b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:42.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.473+0000 7fecf9a00640 1 -- 172.21.15.6:0/1079277210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fecf40cd610 msgr2=0x7fecf414b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:42.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.473+0000 7fecf9a00640 1 --2- 172.21.15.6:0/1079277210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fecf40cd610 0x7fecf414b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:42.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.473+0000 7fecf9a00640 1 -- 172.21.15.6:0/1079277210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecf40d0890 msgr2=0x7fecf40c9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:42.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.473+0000 7fecf9a00640 1 --2- 172.21.15.6:0/1079277210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecf40d0890 0x7fecf40c9a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:42.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.473+0000 7fecf9a00640 1 -- 172.21.15.6:0/1079277210 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecf41512d0 con 0x7fecf415bb60 2024-09-10T20:57:42.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.473+0000 7fecf9000640 1 --2- 172.21.15.6:0/1079277210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fecf40cd610 0x7fecf414b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:57:42.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.473+0000 7fecebe00640 1 --2- 172.21.15.6:0/1079277210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecf40d0890 0x7fecf40c9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:57:42.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.473+0000 7fecf9a00640 1 --2- 172.21.15.6:0/1079277210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecf415bb60 0x7fecf40b1d80 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fecec006010 tx=0x7fecec003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:42.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.474+0000 7fecf1600640 1 -- 172.21.15.6:0/1079277210 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecec047070 con 0x7fecf415bb60 2024-09-10T20:57:42.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.474+0000 7fecf1600640 1 -- 172.21.15.6:0/1079277210 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fecec004250 con 0x7fecf415bb60 2024-09-10T20:57:42.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.474+0000 7fecf1600640 1 -- 172.21.15.6:0/1079277210 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecec033050 con 0x7fecf415bb60 2024-09-10T20:57:42.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.474+0000 7fecfa400640 1 -- 172.21.15.6:0/1079277210 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecf41515b0 con 0x7fecf415bb60 2024-09-10T20:57:42.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.474+0000 7fecfa400640 1 -- 172.21.15.6:0/1079277210 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecf4151b70 con 0x7fecf415bb60 2024-09-10T20:57:42.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.475+0000 7fecfa400640 1 -- 172.21.15.6:0/1079277210 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecf40cf960 con 0x7fecf415bb60 2024-09-10T20:57:42.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.476+0000 7fecf1600640 1 -- 172.21.15.6:0/1079277210 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fecec004660 con 0x7fecf415bb60 2024-09-10T20:57:42.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.477+0000 7fecf1600640 1 --2- 172.21.15.6:0/1079277210 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fecd0077f70 0x7fecd007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:42.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.477+0000 7fecf1600640 1 -- 172.21.15.6:0/1079277210 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4943+0+0 (secure 0 0 0) 0x7fecec0bb090 con 0x7fecf415bb60 2024-09-10T20:57:42.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.478+0000 7fecf9000640 1 --2- 172.21.15.6:0/1079277210 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fecd0077f70 0x7fecd007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:42.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.478+0000 7fecf9000640 1 --2- 172.21.15.6:0/1079277210 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fecd0077f70 0x7fecd007a430 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fece4006fd0 tx=0x7fece4008040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:42.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.481+0000 7fecf1600640 1 -- 172.21.15.6:0/1079277210 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fecec0098b0 con 0x7fecf415bb60 2024-09-10T20:57:42.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.711+0000 7fecfa400640 1 -- 172.21.15.6:0/1079277210 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fecf40b5d40 con 0x7fecf415bb60 2024-09-10T20:57:42.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.712+0000 7fecf1600640 1 -- 172.21.15.6:0/1079277210 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+3905 (secure 0 0 0) 0x7fecec083df0 con 0x7fecf415bb60 2024-09-10T20:57:42.717 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-10T20:57:42.717 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":20,"btime":"2024-09-10T20:57:08:189203+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1675451102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1675451102},{"type":"v1","addr":"172.21.15.6:6834","nonce":1675451102}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4924,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/676153174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":676153174},{"type":"v1","addr":"172.21.15.150:6836","nonce":676153174}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4950,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4072260905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":4072260905},{"type":"v1","addr":"172.21.15.150:6837","nonce":4072260905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5406,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/513840544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":513840544},{"type":"v1","addr":"172.21.15.6:6835","nonce":513840544}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[]} 2024-09-10T20:57:42.717 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 20 2024-09-10T20:57:42.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.714+0000 7fecfa400640 1 -- 172.21.15.6:0/1079277210 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fecd0077f70 msgr2=0x7fecd007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:42.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.714+0000 7fecfa400640 1 --2- 172.21.15.6:0/1079277210 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fecd0077f70 0x7fecd007a430 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fece4006fd0 tx=0x7fece4008040 comp rx=0 tx=0).stop 2024-09-10T20:57:42.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.714+0000 7fecfa400640 1 -- 172.21.15.6:0/1079277210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecf415bb60 msgr2=0x7fecf40b1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:42.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.714+0000 7fecfa400640 1 --2- 172.21.15.6:0/1079277210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecf415bb60 0x7fecf40b1d80 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fecec006010 tx=0x7fecec003f10 comp rx=0 tx=0).stop 2024-09-10T20:57:42.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.714+0000 7fecfa400640 1 -- 172.21.15.6:0/1079277210 shutdown_connections 2024-09-10T20:57:42.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.714+0000 7fecfa400640 1 --2- 172.21.15.6:0/1079277210 >> [v2:172.21.15.150:6800/1238179351,v1:172.21.15.150:6801/1238179351] conn(0x7fecd0077f70 0x7fecd007a430 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:42.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.714+0000 7fecfa400640 1 --2- 172.21.15.6:0/1079277210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecf415bb60 0x7fecf40b1d80 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:42.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.714+0000 7fecfa400640 1 --2- 172.21.15.6:0/1079277210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecf40d0890 0x7fecf40c9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:42.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.714+0000 7fecfa400640 1 --2- 172.21.15.6:0/1079277210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fecf40cd610 0x7fecf414b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:42.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.714+0000 7fecfa400640 1 -- 172.21.15.6:0/1079277210 >> 172.21.15.6:0/1079277210 conn(0x7fecf40b55e0 msgr2=0x7fecf40ccc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:42.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.714+0000 7fecfa400640 1 -- 172.21.15.6:0/1079277210 shutdown_connections 2024-09-10T20:57:42.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-10T20:57:42.714+0000 7fecfa400640 1 -- 172.21.15.6:0/1079277210 wait complete. 2024-09-10T20:57:42.735 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-10T20:57:42.735 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-10T20:57:42.735 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T20:57:42.735 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:57:42.748 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T20:57:42.748 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T20:57:42.748 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:57:42.803 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T20:57:42.804 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T20:57:42.804 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:57:42.821 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T20:57:42.822 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T20:57:42.822 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:57:42.878 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T20:57:42.878 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-10T20:57:42.878 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-10T20:57:42.878 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:57:42.922 INFO:tasks.ceph.osd.0:Stopped 2024-09-10T20:57:42.922 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-10T20:57:42.922 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:57:42.975 INFO:tasks.ceph.osd.1:Stopped 2024-09-10T20:57:42.975 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-10T20:57:42.975 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:57:43.028 INFO:tasks.ceph.osd.2:Stopped 2024-09-10T20:57:43.029 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-10T20:57:43.029 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:57:43.079 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-09-10T20:57:43.087 INFO:tasks.ceph.osd.3:Stopped 2024-09-10T20:57:43.087 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-10T20:57:43.087 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:57:43.134 INFO:tasks.ceph.osd.4:Stopped 2024-09-10T20:57:43.134 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-10T20:57:43.134 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:57:43.178 INFO:tasks.ceph.osd.5:Stopped 2024-09-10T20:57:43.179 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-10T20:57:43.179 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:57:43.231 INFO:tasks.ceph.osd.6:Stopped 2024-09-10T20:57:43.232 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-10T20:57:43.232 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:57:43.293 INFO:tasks.ceph.osd.7:Stopped 2024-09-10T20:57:43.293 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-10T20:57:43.294 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-10T20:57:43.294 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:57:43.359 INFO:tasks.ceph.mgr.y:Stopped 2024-09-10T20:57:43.359 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-10T20:57:43.360 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:57:43.429 INFO:tasks.ceph.mgr.x:Stopped 2024-09-10T20:57:43.429 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-10T20:57:43.429 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-10T20:57:43.429 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:57:43.449 INFO:tasks.ceph.mon.a:Stopped 2024-09-10T20:57:43.449 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-10T20:57:43.450 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:57:43.467 INFO:tasks.ceph.mon.b:Stopped 2024-09-10T20:57:43.467 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-10T20:57:43.468 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:57:43.526 INFO:tasks.ceph.mon.c:Stopped 2024-09-10T20:57:43.526 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-10T20:57:43.527 DEBUG:teuthology.orchestra.run.smithi006:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-10T20:57:43.611 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi006.front.sepia.ceph.com 2024-09-10T20:57:43.611 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-10T20:57:43.814 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi006.front.sepia.ceph.com 2024-09-10T20:57:43.815 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-10T20:57:43.918 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi006.front.sepia.ceph.com 2024-09-10T20:57:43.918 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-10T20:57:44.018 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi006.front.sepia.ceph.com 2024-09-10T20:57:44.018 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-10T20:57:44.111 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-10T20:57:44.111 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-10T20:57:44.325 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-10T20:57:44.326 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-10T20:57:44.452 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-10T20:57:44.452 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-10T20:57:44.553 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-10T20:57:44.554 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-10T20:57:44.694 INFO:tasks.ceph:Archiving mon data... 2024-09-10T20:57:44.695 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899648/data/mon.a.tgz 2024-09-10T20:57:44.695 DEBUG:teuthology.orchestra.run.smithi006:> mktemp 2024-09-10T20:57:44.731 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.UKUJZmukHj 2024-09-10T20:57:44.731 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.UKUJZmukHj 2024-09-10T20:57:44.911 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0666 /tmp/tmp.UKUJZmukHj 2024-09-10T20:57:45.005 DEBUG:teuthology.orchestra.remote:smithi006:/tmp/tmp.UKUJZmukHj is 309KB 2024-09-10T20:57:45.094 DEBUG:teuthology.orchestra.run.smithi006:> rm -fr /tmp/tmp.UKUJZmukHj 2024-09-10T20:57:45.566 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899648/data/mon.b.tgz 2024-09-10T20:57:45.566 DEBUG:teuthology.orchestra.run.smithi150:> mktemp 2024-09-10T20:57:45.604 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.86TEHf8MG5 2024-09-10T20:57:45.604 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.86TEHf8MG5 2024-09-10T20:57:45.797 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.86TEHf8MG5 2024-09-10T20:57:45.891 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.86TEHf8MG5 is 412KB 2024-09-10T20:57:45.980 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.86TEHf8MG5 2024-09-10T20:57:46.015 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899648/data/mon.c.tgz 2024-09-10T20:57:46.015 DEBUG:teuthology.orchestra.run.smithi150:> mktemp 2024-09-10T20:57:46.089 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.BvGYcehv97 2024-09-10T20:57:46.090 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.BvGYcehv97 2024-09-10T20:57:46.266 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.BvGYcehv97 2024-09-10T20:57:46.362 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.BvGYcehv97 is 412KB 2024-09-10T20:57:46.452 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.BvGYcehv97 2024-09-10T20:57:46.487 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-10T20:57:46.487 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-10T20:57:46.491 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-10T20:57:46.620 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-10T20:57:46.655 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-10T20:57:46.656 INFO:tasks.ceph:Archiving crash dumps... 2024-09-10T20:57:46.657 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/lib/ceph/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899648/remote/smithi006/crash 2024-09-10T20:57:46.658 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-10T20:57:46.717 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899648/remote/smithi150/crash 2024-09-10T20:57:46.718 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-10T20:57:46.772 INFO:tasks.ceph:Shutting down logrotate 2024-09-10T20:57:46.772 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T20:57:46.776 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T20:57:46.888 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-10T20:57:46.943 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-10T20:57:46.999 INFO:tasks.ceph:Compressing logs... 2024-09-10T20:57:46.999 DEBUG:teuthology.orchestra.run.smithi006:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T20:57:47.003 DEBUG:teuthology.orchestra.run.smithi150:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T20:57:47.053 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-10T20:57:47.054 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42130.log 2024-09-10T20:57:47.055 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49408.log 2024-09-10T20:57:47.056 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50687.log 2024-09-10T20:57:47.056 INFO:teuthology.orchestra.run.smithi006.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.42130.log.gz 2024-09-10T20:57:47.056 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36365.log 2024-09-10T20:57:47.057 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42926.log 2024-09-10T20:57:47.057 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49408.log.gz 2024-09-10T20:57:47.059 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47176.log 87.4% 2024-09-10T20:57:47.059 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50687.log.gz 2024-09-10T20:57:47.059 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36889.log 2024-09-10T20:57:47.059 INFO:teuthology.orchestra.run.smithi006.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.42926.log.gz 2024-09-10T20:57:47.059 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-10T20:57:47.060 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.36365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36325.log 2024-09-10T20:57:47.060 INFO:teuthology.orchestra.run.smithi150.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36365.log.gz 2024-09-10T20:57:47.060 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-10T20:57:47.060 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.36325.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-10T20:57:47.060 INFO:teuthology.orchestra.run.smithi150.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.36325.log.gz 2024-09-10T20:57:47.061 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36405.log 2024-09-10T20:57:47.062 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46551.log 2024-09-10T20:57:47.062 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47176.log.gz 2024-09-10T20:57:47.062 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.36889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42340.log 2024-09-10T20:57:47.062 INFO:teuthology.orchestra.run.smithi006.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36889.log.gz 2024-09-10T20:57:47.062 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46551.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46551.log.gz 2024-09-10T20:57:47.062 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43684.log 2024-09-10T20:57:47.062 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41651.log 2024-09-10T20:57:47.063 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42340.log.gz 2024-09-10T20:57:47.066 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42172.log 2024-09-10T20:57:47.066 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43684.log.gz 2024-09-10T20:57:47.066 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.41651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47260.log 2024-09-10T20:57:47.066 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41651.log.gz 2024-09-10T20:57:47.066 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42172.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42172.log.gz 2024-09-10T20:57:47.066 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43320.log 2024-09-10T20:57:47.066 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47470.log 2024-09-10T20:57:47.066 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47260.log.gz 2024-09-10T20:57:47.067 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-10T20:57:47.067 INFO:teuthology.orchestra.run.smithi150.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-10T20:57:47.067 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.36405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41336.log 2024-09-10T20:57:47.067 INFO:teuthology.orchestra.run.smithi150.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36405.log.gz 2024-09-10T20:57:47.067 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-10T20:57:47.067 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.1.41336.log: gzip -5 93.7% --verbose -- replaced with /var/log/ceph/ceph.audit.log.gz -- 2024-09-10T20:57:47.067 INFO:teuthology.orchestra.run.smithi150.stderr: /var/log/ceph/ceph-client.admin.36245.log 2024-09-10T20:57:47.067 INFO:teuthology.orchestra.run.smithi150.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.1.41336.log.gz 2024-09-10T20:57:47.067 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-10T20:57:47.068 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.36245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36205.log 2024-09-10T20:57:47.068 INFO:teuthology.orchestra.run.smithi150.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36245.log.gz 2024-09-10T20:57:47.069 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36285.log 2024-09-10T20:57:47.069 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.36205.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.36205.log.gz 2024-09-10T20:57:47.069 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-10T20:57:47.071 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45218.log 2024-09-10T20:57:47.071 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43320.log.gz 2024-09-10T20:57:47.071 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42641.log 2024-09-10T20:57:47.071 INFO:teuthology.orchestra.run.smithi006.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47470.log.gz 2024-09-10T20:57:47.071 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45218.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45218.log.gz 2024-09-10T20:57:47.071 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51317.log 2024-09-10T20:57:47.071 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41274.log 2024-09-10T20:57:47.071 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42641.log.gz 2024-09-10T20:57:47.072 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51317.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-10T20:57:47.072 INFO:teuthology.orchestra.run.smithi006.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.51317.log.gz 2024-09-10T20:57:47.072 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.41274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43221.log 2024-09-10T20:57:47.072 INFO:teuthology.orchestra.run.smithi006.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.41274.log.gz 2024-09-10T20:57:47.074 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.36285.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-10T20:57:47.074 INFO:teuthology.orchestra.run.smithi150.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.36285.log.gz 2024-09-10T20:57:47.074 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-10T20:57:47.074 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-10T20:57:47.074 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-mds.d.log: 91.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-10T20:57:47.075 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.44917.log 2024-09-10T20:57:47.075 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42983.log 2024-09-10T20:57:47.075 INFO:teuthology.orchestra.run.smithi006.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43221.log.gz 2024-09-10T20:57:47.075 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.2.44917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45952.log 2024-09-10T20:57:47.075 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42983.log: 89.6% -- replaced with /var/log/ceph/ceph-client.2.44917.log.gz 2024-09-10T20:57:47.076 INFO:teuthology.orchestra.run.smithi006.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.42983.log.gz 2024-09-10T20:57:47.076 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46246.log 2024-09-10T20:57:47.076 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49865.log 2024-09-10T20:57:47.077 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-mgr.x.log: 92.2% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-10T20:57:47.077 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-10T20:57:47.077 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36165.log 2024-09-10T20:57:47.078 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45952.log: /var/log/ceph/ceph-client.admin.46246.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45952.log.gz 2024-09-10T20:57:47.078 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46763.log 2024-09-10T20:57:47.078 INFO:teuthology.orchestra.run.smithi006.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46246.log.gz 2024-09-10T20:57:47.078 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51555.log 2024-09-10T20:57:47.078 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49865.log.gz 2024-09-10T20:57:47.078 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46763.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46763.log.gz 2024-09-10T20:57:47.078 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42088.log 2024-09-10T20:57:47.080 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.36165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36445.log 2024-09-10T20:57:47.081 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47088.log 2024-09-10T20:57:47.081 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51555.log.gz 2024-09-10T20:57:47.081 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42088.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.42088.log.gz 2024-09-10T20:57:47.081 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46889.log 2024-09-10T20:57:47.083 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43276.log 2024-09-10T20:57:47.083 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47088.log.gz 2024-09-10T20:57:47.083 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46889.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46889.log.gz 2024-09-10T20:57:47.083 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36621.log 2024-09-10T20:57:47.083 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.36445.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36165.log.gz 2024-09-10T20:57:47.083 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.41792.log 2024-09-10T20:57:47.084 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47302.log 2024-09-10T20:57:47.084 INFO:teuthology.orchestra.run.smithi006.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43276.log.gz 2024-09-10T20:57:47.084 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.36621.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36621.log.gz 2024-09-10T20:57:47.084 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41609.log 2024-09-10T20:57:47.086 INFO:teuthology.orchestra.run.smithi150.stderr: 86.7%/var/log/ceph/ceph-client.3.41792.log: -- replaced with /var/log/ceph/ceph-client.admin.36445.log.gz 2024-09-10T20:57:47.086 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42946.log 2024-09-10T20:57:47.086 INFO:teuthology.orchestra.run.smithi006.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.47302.log.gz 2024-09-10T20:57:47.086 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.41609.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.41609.log.gz 2024-09-10T20:57:47.087 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49949.log 2024-09-10T20:57:47.087 INFO:teuthology.orchestra.run.smithi150.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.3.41792.log.gz 2024-09-10T20:57:47.088 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36360.log 2024-09-10T20:57:47.088 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42946.log.gz 2024-09-10T20:57:47.088 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49949.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49949.log.gz 2024-09-10T20:57:47.089 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46036.log 2024-09-10T20:57:47.089 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.36360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42638.log 2024-09-10T20:57:47.090 INFO:teuthology.orchestra.run.smithi006.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.36360.log.gz 2024-09-10T20:57:47.090 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46036.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46036.log.gz 2024-09-10T20:57:47.090 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49991.log 2024-09-10T20:57:47.091 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42632.log 2024-09-10T20:57:47.092 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42638.log.gz 2024-09-10T20:57:47.092 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49991.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49991.log.gz 2024-09-10T20:57:47.092 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42298.log 2024-09-10T20:57:47.093 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47028.log 2024-09-10T20:57:47.094 INFO:teuthology.orchestra.run.smithi006.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.42632.log.gz 2024-09-10T20:57:47.094 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42298.log: gzip -5 --verbose -- 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42298.log.gz /var/log/ceph/ceph-client.admin.50897.log 2024-09-10T20:57:47.095 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-09-10T20:57:47.095 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47130.log 2024-09-10T20:57:47.096 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47028.log.gz 2024-09-10T20:57:47.097 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50897.log: gzip 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50897.log.gz 2024-09-10T20:57:47.097 INFO:teuthology.orchestra.run.smithi006.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47218.log 2024-09-10T20:57:47.098 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45581.log 2024-09-10T20:57:47.098 INFO:teuthology.orchestra.run.smithi006.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47130.log.gz 2024-09-10T20:57:47.099 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47218.log: gzip 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47218.log.gz 2024-09-10T20:57:47.099 INFO:teuthology.orchestra.run.smithi006.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.51065.log 2024-09-10T20:57:47.100 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45023.log 2024-09-10T20:57:47.100 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45581.log.gz 2024-09-10T20:57:47.101 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51065.log: gzip 87.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.51065.log.gz --verbose 2024-09-10T20:57:47.101 INFO:teuthology.orchestra.run.smithi006.stderr: -- /var/log/ceph/ceph-client.admin.50813.log 2024-09-10T20:57:47.102 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45023.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45023.log.gz 2024-09-10T20:57:47.102 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36401.log 2024-09-10T20:57:47.103 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48851.log 2024-09-10T20:57:47.103 INFO:teuthology.orchestra.run.smithi006.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.50813.log.gz 2024-09-10T20:57:47.104 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.36401.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.36401.log.gz 2024-09-10T20:57:47.104 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46977.log 2024-09-10T20:57:47.105 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36579.log 2024-09-10T20:57:47.105 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48851.log.gz 2024-09-10T20:57:47.106 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46977.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46977.log.gz 2024-09-10T20:57:47.106 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46349.log 2024-09-10T20:57:47.107 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.36579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49206.log 2024-09-10T20:57:47.107 INFO:teuthology.orchestra.run.smithi006.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.36579.log.gz 2024-09-10T20:57:47.108 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46349.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46349.log.gz 2024-09-10T20:57:47.108 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36565.log 2024-09-10T20:57:47.109 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46933.log 2024-09-10T20:57:47.109 INFO:teuthology.orchestra.run.smithi006.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49206.log.gz 2024-09-10T20:57:47.110 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.36565.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.36565.log.gz 2024-09-10T20:57:47.110 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42982.log 2024-09-10T20:57:47.111 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50280.log 2024-09-10T20:57:47.111 INFO:teuthology.orchestra.run.smithi006.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.46933.log.gz 2024-09-10T20:57:47.112 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42982.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42982.log.gz 2024-09-10T20:57:47.112 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41693.log 2024-09-10T20:57:47.113 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42924.log 2024-09-10T20:57:47.113 INFO:teuthology.orchestra.run.smithi006.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50280.log.gz 2024-09-10T20:57:47.114 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.41693.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.41693.log.gz 2024-09-10T20:57:47.114 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49593.log 2024-09-10T20:57:47.115 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51149.log 2024-09-10T20:57:47.115 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42924.log.gz 2024-09-10T20:57:47.116 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49593.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49593.log.gz 2024-09-10T20:57:47.116 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41874.log 2024-09-10T20:57:47.117 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51149.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-10T20:57:47.117 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51149.log.gz 2024-09-10T20:57:47.118 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.41874.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41874.log.gz 2024-09-10T20:57:47.118 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41832.log 2024-09-10T20:57:47.119 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43219.log 2024-09-10T20:57:47.120 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.41832.log: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-10T20:57:47.120 INFO:teuthology.orchestra.run.smithi006.stderr:gzip 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41832.log.gz -5 2024-09-10T20:57:47.121 INFO:teuthology.orchestra.run.smithi006.stderr: --verbose -- /var/log/ceph/ceph-client.admin.50771.log 2024-09-10T20:57:47.121 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48649.log 2024-09-10T20:57:47.121 INFO:teuthology.orchestra.run.smithi006.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.43219.log.gz 2024-09-10T20:57:47.122 INFO:teuthology.orchestra.run.smithi150.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-10T20:57:47.122 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43912.log 2024-09-10T20:57:47.123 INFO:teuthology.orchestra.run.smithi006.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.50771.log.gz 2024-09-10T20:57:47.123 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48649.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48649.log.gz 2024-09-10T20:57:47.124 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51233.log 2024-09-10T20:57:47.124 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42004.log 2024-09-10T20:57:47.125 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43912.log.gz 2024-09-10T20:57:47.126 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51233.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51233.log.gz 2024-09-10T20:57:47.126 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49550.log 2024-09-10T20:57:47.127 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48483.log 2024-09-10T20:57:47.127 INFO:teuthology.orchestra.run.smithi006.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42004.log.gz 2024-09-10T20:57:47.128 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49550.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49550.log.gz 2024-09-10T20:57:47.128 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45833.log 2024-09-10T20:57:47.129 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36291.log 2024-09-10T20:57:47.129 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48483.log.gz 2024-09-10T20:57:47.130 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45833.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45833.log.gz 2024-09-10T20:57:47.130 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51191.log 2024-09-10T20:57:47.131 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.36291.log: 77.1% -- replaced with /var/log/ceph/ceph-client.admin.36291.log.gz 2024-09-10T20:57:47.131 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50364.log 2024-09-10T20:57:47.132 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46078.log 2024-09-10T20:57:47.132 INFO:teuthology.orchestra.run.smithi006.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.51191.log.gz 2024-09-10T20:57:47.133 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48923.log 2024-09-10T20:57:47.133 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50364.log.gz 2024-09-10T20:57:47.134 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46078.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46078.log.gz 2024-09-10T20:57:47.134 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45523.log 2024-09-10T20:57:47.135 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44496.log 2024-09-10T20:57:47.135 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48923.log.gz 2024-09-10T20:57:47.136 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45523.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45523.log.gz 2024-09-10T20:57:47.136 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51401.log 2024-09-10T20:57:47.137 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45994.log 2024-09-10T20:57:47.137 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44496.log.gz 2024-09-10T20:57:47.138 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51401.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.51401.log.gz 2024-09-10T20:57:47.138 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46593.log 2024-09-10T20:57:47.139 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46721.log 2024-09-10T20:57:47.139 INFO:teuthology.orchestra.run.smithi006.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45994.log.gz 2024-09-10T20:57:47.140 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46593.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46593.log.gz 2024-09-10T20:57:47.140 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51023.log 2024-09-10T20:57:47.141 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43285.log 2024-09-10T20:57:47.142 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46721.log.gz 2024-09-10T20:57:47.142 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51023.log: 87.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.51023.log.gz 2024-09-10T20:57:47.142 INFO:teuthology.orchestra.run.smithi006.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46120.log 2024-09-10T20:57:47.143 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51513.log 2024-09-10T20:57:47.144 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43285.log.gz 2024-09-10T20:57:47.144 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46120.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46120.log.gz 2024-09-10T20:57:47.144 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46204.log 2024-09-10T20:57:47.145 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51513.log: gzip 87.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.51513.log.gz 2024-09-10T20:57:47.145 INFO:teuthology.orchestra.run.smithi006.stderr: --verbose -- /var/log/ceph/ceph-client.admin.42648.log 2024-09-10T20:57:47.146 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46204.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46204.log.gz 2024-09-10T20:57:47.146 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41781.log 2024-09-10T20:57:47.147 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42648.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42648.log.gz 2024-09-10T20:57:47.147 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36309.log 2024-09-10T20:57:47.148 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.41781.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41781.log.gz 2024-09-10T20:57:47.148 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36642.log 2024-09-10T20:57:47.149 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.36309.log: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.36309.log.gz 2024-09-10T20:57:47.149 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-10T20:57:47.150 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.36642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49051.log 2024-09-10T20:57:47.150 INFO:teuthology.orchestra.run.smithi006.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.36642.log.gz 2024-09-10T20:57:47.151 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49009.log 2024-09-10T20:57:47.151 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49051.log: 92.2% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-10T20:57:47.152 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49051.log.gz 2024-09-10T20:57:47.152 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43600.log 2024-09-10T20:57:47.153 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36251.log 2024-09-10T20:57:47.153 INFO:teuthology.orchestra.run.smithi006.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49009.log.gz 2024-09-10T20:57:47.154 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36637.log 2024-09-10T20:57:47.154 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43600.log.gz 2024-09-10T20:57:47.155 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.36251.log: 76.7% -- replaced with /var/log/ceph/ceph-client.admin.36251.log.gz 2024-09-10T20:57:47.155 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42256.log 2024-09-10T20:57:47.156 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.36637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42647.log 2024-09-10T20:57:47.156 INFO:teuthology.orchestra.run.smithi006.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.36637.log.gz 2024-09-10T20:57:47.157 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42256.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.42256.log.gz 2024-09-10T20:57:47.157 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46306.log 2024-09-10T20:57:47.158 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37090.log 2024-09-10T20:57:47.158 INFO:teuthology.orchestra.run.smithi006.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42647.log.gz 2024-09-10T20:57:47.158 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46306.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46306.log.gz 2024-09-10T20:57:47.158 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47512.log 2024-09-10T20:57:47.159 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.37090.log: gzip -5 --verbose -- 86.7% /var/log/ceph/ceph-client.admin.41737.log -- replaced with /var/log/ceph/ceph-client.admin.37090.log.gz 2024-09-10T20:57:47.159 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-09-10T20:57:47.160 INFO:teuthology.orchestra.run.smithi150.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-10T20:57:47.160 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47512.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.47512.log.gz 2024-09-10T20:57:47.161 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45775.log 2024-09-10T20:57:47.161 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.41737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50220.log 2024-09-10T20:57:47.161 INFO:teuthology.orchestra.run.smithi006.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41737.log.gz 2024-09-10T20:57:47.162 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45775.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.45775.log.gz 2024-09-10T20:57:47.162 INFO:teuthology.orchestra.run.smithi006.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.51473.log 2024-09-10T20:57:47.163 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45260.log 2024-09-10T20:57:47.163 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50220.log.gz 2024-09-10T20:57:47.164 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51473.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51473.log.gz 2024-09-10T20:57:47.164 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-10T20:57:47.165 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50729.log 2024-09-10T20:57:47.165 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45260.log.gz 2024-09-10T20:57:47.166 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42645.log 2024-09-10T20:57:47.166 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50729.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50729.log.gz 2024-09-10T20:57:47.167 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43558.log 2024-09-10T20:57:47.168 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47344.log 2024-09-10T20:57:47.168 INFO:teuthology.orchestra.run.smithi006.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42645.log.gz 2024-09-10T20:57:47.169 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43558.log: gzip 86.8% -5 -- replaced with /var/log/ceph/ceph-client.admin.43558.log.gz --verbose 2024-09-10T20:57:47.169 INFO:teuthology.orchestra.run.smithi006.stderr: -- /var/log/ceph/ceph-client.admin.50561.log 2024-09-10T20:57:47.170 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47344.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.47344.log.gz 2024-09-10T20:57:47.170 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36664.log 2024-09-10T20:57:47.171 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45701.log 2024-09-10T20:57:47.172 INFO:teuthology.orchestra.run.smithi006.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.50561.log.gz 2024-09-10T20:57:47.173 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.36664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48967.log 2024-09-10T20:57:47.173 INFO:teuthology.orchestra.run.smithi006.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.36664.log.gz 2024-09-10T20:57:47.174 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45701.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45701.log.gz 2024-09-10T20:57:47.174 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45176.log 2024-09-10T20:57:47.175 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42382.log 2024-09-10T20:57:47.175 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45176.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48967.log.gz 2024-09-10T20:57:47.176 INFO:teuthology.orchestra.run.smithi006.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.45176.log.gz 2024-09-10T20:57:47.176 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50603.log 2024-09-10T20:57:47.177 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47596.log 2024-09-10T20:57:47.177 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42382.log.gz 2024-09-10T20:57:47.178 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50603.log: gzip 87.1% -- replaced with /var/log/ceph/ceph-client.admin.50603.log.gz 2024-09-10T20:57:47.178 INFO:teuthology.orchestra.run.smithi006.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49110.log 2024-09-10T20:57:47.179 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47596.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-10T20:57:47.180 INFO:teuthology.orchestra.run.smithi006.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47596.log.gz/var/log/ceph/ceph-client.admin.49110.log: 2024-09-10T20:57:47.181 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49110.log.gz 2024-09-10T20:57:47.181 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48808.log 2024-09-10T20:57:47.182 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49461.log 2024-09-10T20:57:47.183 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43318.log 2024-09-10T20:57:47.183 INFO:teuthology.orchestra.run.smithi006.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48808.log.gz 2024-09-10T20:57:47.184 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45659.log 2024-09-10T20:57:47.185 INFO:teuthology.orchestra.run.smithi006.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-10T20:57:47.185 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49461.log.gz 2024-09-10T20:57:47.185 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42466.log 2024-09-10T20:57:47.185 INFO:teuthology.orchestra.run.smithi006.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43318.log.gz 2024-09-10T20:57:47.186 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45659.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45659.log.gz 2024-09-10T20:57:47.187 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48274.log 2024-09-10T20:57:47.187 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46847.log 2024-09-10T20:57:47.188 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42466.log.gz 2024-09-10T20:57:47.189 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42046.log 2024-09-10T20:57:47.189 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48274.log.gz 2024-09-10T20:57:47.189 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50177.log 2024-09-10T20:57:47.190 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46847.log.gz 2024-09-10T20:57:47.191 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42046.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.42046.log.gz 2024-09-10T20:57:47.191 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-10T20:57:47.192 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46637.log 2024-09-10T20:57:47.192 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50177.log.gz 2024-09-10T20:57:47.193 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48702.log 2024-09-10T20:57:47.193 INFO:teuthology.orchestra.run.smithi150.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-10T20:57:47.194 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49646.log 2024-09-10T20:57:47.194 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46637.log.gz 2024-09-10T20:57:47.196 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48702.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-10T20:57:47.196 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48702.log.gz 2024-09-10T20:57:47.196 INFO:teuthology.orchestra.run.smithi006.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-10T20:57:47.196 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43516.log 2024-09-10T20:57:47.197 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49646.log.gz 2024-09-10T20:57:47.197 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45428.log 2024-09-10T20:57:47.199 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.43516.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.43516.log.gz 2024-09-10T20:57:47.199 INFO:teuthology.orchestra.run.smithi006.stderr: 84.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-10T20:57:47.199 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48606.log 2024-09-10T20:57:47.199 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42214.log 2024-09-10T20:57:47.200 INFO:teuthology.orchestra.run.smithi006.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45428.log.gz 2024-09-10T20:57:47.201 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36485.log 2024-09-10T20:57:47.201 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48606.log.gz 2024-09-10T20:57:47.202 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42214.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42214.log.gz 2024-09-10T20:57:47.202 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48231.log 2024-09-10T20:57:47.203 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.36485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50322.log 2024-09-10T20:57:47.204 INFO:teuthology.orchestra.run.smithi006.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.36485.log.gz 2024-09-10T20:57:47.204 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48231.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48231.log.gz 2024-09-10T20:57:47.204 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36129.log 2024-09-10T20:57:47.206 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50322.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50322.log.gz 2024-09-10T20:57:47.206 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46471.log 2024-09-10T20:57:47.207 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.36129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42949.log 2024-09-10T20:57:47.207 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36129.log.gz 2024-09-10T20:57:47.208 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49259.log 2024-09-10T20:57:47.208 INFO:teuthology.orchestra.run.smithi006.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46471.log.gz 2024-09-10T20:57:47.209 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42949.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42949.log.gz 2024-09-10T20:57:47.209 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49907.log 2024-09-10T20:57:47.210 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37183.log 2024-09-10T20:57:47.210 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9%/var/log/ceph/ceph-client.admin.49907.log: -- replaced with /var/log/ceph/ceph-client.admin.49259.log.gz 2024-09-10T20:57:47.211 INFO:teuthology.orchestra.run.smithi006.stderr:gzip 87.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.49907.log.gz --verbose 2024-09-10T20:57:47.211 INFO:teuthology.orchestra.run.smithi006.stderr: -- /var/log/ceph/ceph-client.admin.48440.log 2024-09-10T20:57:47.212 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.37183.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.37183.log.gz 2024-09-10T20:57:47.213 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43810.log 2024-09-10T20:57:47.213 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50855.log 2024-09-10T20:57:47.214 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48440.log.gz 2024-09-10T20:57:47.215 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36633.log 2024-09-10T20:57:47.215 INFO:teuthology.orchestra.run.smithi006.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.43810.log.gz 2024-09-10T20:57:47.216 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47428.log 2024-09-10T20:57:47.216 INFO:teuthology.orchestra.run.smithi006.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50855.log.gz 2024-09-10T20:57:47.217 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.36633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42633.log 2024-09-10T20:57:47.217 INFO:teuthology.orchestra.run.smithi150.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-10T20:57:47.218 INFO:teuthology.orchestra.run.smithi006.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.36633.log.gz 2024-09-10T20:57:47.218 INFO:teuthology.orchestra.run.smithi150.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-10T20:57:47.218 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47428.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.47428.log.gz 2024-09-10T20:57:47.219 INFO:teuthology.orchestra.run.smithi006.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43726.log 2024-09-10T20:57:47.219 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42633.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.42633.log.gz 2024-09-10T20:57:47.220 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43319.log 2024-09-10T20:57:47.220 INFO:teuthology.orchestra.run.smithi006.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-10T20:57:47.220 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47982.log 2024-09-10T20:57:47.221 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43726.log.gz 2024-09-10T20:57:47.221 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50075.log 2024-09-10T20:57:47.221 INFO:teuthology.orchestra.run.smithi006.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43319.log.gz 2024-09-10T20:57:47.222 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.47982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36437.log 2024-09-10T20:57:47.222 INFO:teuthology.orchestra.run.smithi150.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-10T20:57:47.223 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50075.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50075.log.gz 2024-09-10T20:57:47.223 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47704.log 2024-09-10T20:57:47.224 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.36437.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36437.log.gz 2024-09-10T20:57:47.225 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30073.log 2024-09-10T20:57:47.225 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41962.log 2024-09-10T20:57:47.226 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47704.log.gz 2024-09-10T20:57:47.227 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph.tmp-client.admin.30073.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30073.log.gz 2024-09-10T20:57:47.227 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50981.log 2024-09-10T20:57:47.228 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.41962.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.41962.log.gz 2024-09-10T20:57:47.228 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41509.log 2024-09-10T20:57:47.229 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50981.log: 92.7% -- replaced with /var/log/ceph/ceph-client.0.47982.log.gz 2024-09-10T20:57:47.229 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47638.log 2024-09-10T20:57:47.230 INFO:teuthology.orchestra.run.smithi006.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.50981.log.gz 2024-09-10T20:57:47.230 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.41509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51275.log 2024-09-10T20:57:47.230 INFO:teuthology.orchestra.run.smithi006.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.41509.log.gz 2024-09-10T20:57:47.231 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51107.log 2024-09-10T20:57:47.232 INFO:teuthology.orchestra.run.smithi006.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.47638.log.gz 2024-09-10T20:57:47.232 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51275.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.51275.log.gz 2024-09-10T20:57:47.232 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45344.log 2024-09-10T20:57:47.234 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43768.log 2024-09-10T20:57:47.234 INFO:teuthology.orchestra.run.smithi006.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.51107.log.gz 2024-09-10T20:57:47.235 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45344.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45344.log.gz 2024-09-10T20:57:47.235 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41916.log 2024-09-10T20:57:47.236 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45386.log 2024-09-10T20:57:47.236 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43768.log.gz 2024-09-10T20:57:47.237 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.41916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36651.log 2024-09-10T20:57:47.237 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41916.log.gz 2024-09-10T20:57:47.238 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45386.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45386.log.gz 2024-09-10T20:57:47.238 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50033.log 2024-09-10T20:57:47.238 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.36651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50939.log 2024-09-10T20:57:47.239 INFO:teuthology.orchestra.run.smithi006.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.36651.log.gz 2024-09-10T20:57:47.240 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50033.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50033.log.gz 2024-09-10T20:57:47.240 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42642.log 2024-09-10T20:57:47.241 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45302.log 2024-09-10T20:57:47.241 INFO:teuthology.orchestra.run.smithi006.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50939.log.gz 2024-09-10T20:57:47.241 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42984.log 2024-09-10T20:57:47.242 INFO:teuthology.orchestra.run.smithi006.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.42642.log.gz 2024-09-10T20:57:47.243 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45302.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45302.log.gz 2024-09-10T20:57:47.243 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49771.log 2024-09-10T20:57:47.243 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50117.log 2024-09-10T20:57:47.244 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42984.log.gz 2024-09-10T20:57:47.245 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49771.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49771.log.gz 2024-09-10T20:57:47.245 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48330.log 2024-09-10T20:57:47.246 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49365.log 2024-09-10T20:57:47.246 INFO:teuthology.orchestra.run.smithi150.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-10T20:57:47.247 INFO:teuthology.orchestra.run.smithi006.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50117.log.gz 2024-09-10T20:57:47.247 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48330.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48330.log.gz 2024-09-10T20:57:47.247 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41413.log 2024-09-10T20:57:47.248 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50645.log 2024-09-10T20:57:47.248 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49365.log.gz 2024-09-10T20:57:47.249 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.41413.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41413.log.gz 2024-09-10T20:57:47.249 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46679.log 2024-09-10T20:57:47.249 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-10T20:57:47.249 INFO:teuthology.orchestra.run.smithi150.stderr:real 0m0.214s 2024-09-10T20:57:47.250 INFO:teuthology.orchestra.run.smithi150.stderr:user 0m0.851s 2024-09-10T20:57:47.250 INFO:teuthology.orchestra.run.smithi150.stderr:sys 0m0.155s 2024-09-10T20:57:47.251 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43642.log 2024-09-10T20:57:47.251 INFO:teuthology.orchestra.run.smithi006.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.50645.log.gz 2024-09-10T20:57:47.251 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46679.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46679.log.gz 2024-09-10T20:57:47.251 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36196.log 2024-09-10T20:57:47.252 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46391.log 2024-09-10T20:57:47.252 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43642.log.gz 2024-09-10T20:57:47.253 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.36196.log: 76.1% -- replaced with /var/log/ceph/ceph-client.admin.36196.log.gz 2024-09-10T20:57:47.253 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43291.log 2024-09-10T20:57:47.254 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36107.log 2024-09-10T20:57:47.254 INFO:teuthology.orchestra.run.smithi006.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46391.log.gz 2024-09-10T20:57:47.255 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43291.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43291.log.gz 2024-09-10T20:57:47.255 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45910.log 2024-09-10T20:57:47.256 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.36107.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36107.log.gz 2024-09-10T20:57:47.256 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44356.log 2024-09-10T20:57:47.257 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45910.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45910.log.gz 2024-09-10T20:57:47.257 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42424.log 2024-09-10T20:57:47.258 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.44356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49153.log 2024-09-10T20:57:47.258 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42424.log: 90.2% -- replaced with /var/log/ceph/ceph-client.0.44356.log.gz 2024-09-10T20:57:47.259 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42424.log.gz 2024-09-10T20:57:47.259 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50406.log 2024-09-10T20:57:47.260 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47554.log 2024-09-10T20:57:47.260 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49153.log.gz 2024-09-10T20:57:47.261 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51359.log 2024-09-10T20:57:47.261 INFO:teuthology.orchestra.run.smithi006.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50406.log.gz 2024-09-10T20:57:47.262 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46162.log 2024-09-10T20:57:47.262 INFO:teuthology.orchestra.run.smithi006.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47554.log.gz 2024-09-10T20:57:47.263 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51359.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-10T20:57:47.263 INFO:teuthology.orchestra.run.smithi006.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51359.log.gz 2024-09-10T20:57:47.264 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46162.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46162.log.gz 2024-09-10T20:57:47.264 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47386.log 2024-09-10T20:57:47.265 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46805.log 2024-09-10T20:57:47.266 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47386.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47386.log.gz 2024-09-10T20:57:47.266 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-10T20:57:47.267 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46805.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46805.log.gz 2024-09-10T20:57:47.267 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45066.log 2024-09-10T20:57:47.268 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42948.log 2024-09-10T20:57:47.270 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45066.log: gzip 87.9% -5 -- replaced with /var/log/ceph/ceph-client.admin.45066.log.gz --verbose 2024-09-10T20:57:47.270 INFO:teuthology.orchestra.run.smithi006.stderr: -- /var/log/ceph/ceph-client.admin.48121.log 2024-09-10T20:57:47.271 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42948.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42948.log.gz 2024-09-10T20:57:47.272 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48121.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48121.log.gz 2024-09-10T20:57:47.290 INFO:teuthology.orchestra.run.smithi006.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-10T20:57:47.358 INFO:teuthology.orchestra.run.smithi006.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-10T20:57:47.365 INFO:teuthology.orchestra.run.smithi006.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-10T20:57:47.431 INFO:teuthology.orchestra.run.smithi006.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-10T20:57:47.434 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-09-10T20:57:47.434 INFO:teuthology.orchestra.run.smithi006.stderr:real 0m0.402s 2024-09-10T20:57:47.434 INFO:teuthology.orchestra.run.smithi006.stderr:user 0m0.847s 2024-09-10T20:57:47.434 INFO:teuthology.orchestra.run.smithi006.stderr:sys 0m0.569s 2024-09-10T20:57:47.435 INFO:tasks.ceph:Archiving logs... 2024-09-10T20:57:47.435 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899648/remote/smithi006/log 2024-09-10T20:57:47.436 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T20:57:47.761 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899648/remote/smithi150/log 2024-09-10T20:57:47.762 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T20:57:47.930 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-10T20:57:47.958 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-10T20:57:47.959 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T20:57:47.964 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T20:57:48.080 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-09-10T20:57:48.086 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-10T20:57:48.095 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-10T20:57:48.096 DEBUG:teuthology.orchestra.run.smithi006:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T20:57:48.100 DEBUG:teuthology.orchestra.run.smithi150:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T20:57:48.129 INFO:teuthology.orchestra.run.smithi006.stderr:bash: line 1: ntpq: command not found 2024-09-10T20:57:48.134 INFO:teuthology.orchestra.run.smithi150.stderr:bash: line 1: ntpq: command not found 2024-09-10T20:57:48.137 INFO:teuthology.orchestra.run.smithi006.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T20:57:48.137 INFO:teuthology.orchestra.run.smithi006.stdout:=============================================================================== 2024-09-10T20:57:48.137 INFO:teuthology.orchestra.run.smithi006.stdout:^* hv01.front.sepia.ceph.com 3 6 377 61 -389us[ -390us] +/- 42ms 2024-09-10T20:57:48.137 INFO:teuthology.orchestra.run.smithi006.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 61 +2070us[+2069us] +/- 78ms 2024-09-10T20:57:48.137 INFO:teuthology.orchestra.run.smithi006.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 60 -1209us[-1209us] +/- 72ms 2024-09-10T20:57:48.137 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T20:57:48.141 INFO:teuthology.orchestra.run.smithi150.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T20:57:48.141 INFO:teuthology.orchestra.run.smithi150.stdout:=============================================================================== 2024-09-10T20:57:48.141 INFO:teuthology.orchestra.run.smithi150.stdout:^* hv01.front.sepia.ceph.com 3 6 377 60 -387us[ -390us] +/- 42ms 2024-09-10T20:57:48.141 INFO:teuthology.orchestra.run.smithi150.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 62 +2112us[+2109us] +/- 78ms 2024-09-10T20:57:48.141 INFO:teuthology.orchestra.run.smithi150.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 60 -1219us[-1222us] +/- 72ms 2024-09-10T20:57:48.141 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T20:57:48.142 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-10T20:57:48.151 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-10T20:57:48.152 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-10T20:57:48.161 DEBUG:teuthology.orchestra.run.smithi006:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T20:57:48.299 DEBUG:teuthology.orchestra.run.smithi150:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T20:57:48.412 DEBUG:teuthology.orchestra.run.smithi006:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-10T20:57:48.472 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T20:57:48.473 DEBUG:teuthology.orchestra.run.smithi150:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-10T20:57:48.533 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T20:57:48.533 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-10T20:57:48.545 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-10T20:57:48.555 INFO:teuthology.task.internal:Duration was 612.183537 seconds 2024-09-10T20:57:48.556 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-10T20:57:48.565 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-10T20:57:48.565 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T20:57:48.569 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T20:57:48.653 INFO:teuthology.orchestra.run.smithi006.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T20:57:48.657 INFO:teuthology.orchestra.run.smithi150.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T20:57:49.110 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-10T20:57:49.110 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi006.front.sepia.ceph.com 2024-09-10T20:57:49.110 DEBUG:teuthology.orchestra.run.smithi006:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T20:57:49.163 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi150.front.sepia.ceph.com 2024-09-10T20:57:49.163 DEBUG:teuthology.orchestra.run.smithi150:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T20:57:49.213 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-10T20:57:49.213 DEBUG:teuthology.orchestra.run.smithi006:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T20:57:49.218 DEBUG:teuthology.orchestra.run.smithi150:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T20:57:49.276 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-10T20:57:49.277 DEBUG:teuthology.orchestra.run.smithi006:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T20:57:49.281 DEBUG:teuthology.orchestra.run.smithi150:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T20:57:49.424 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-10T20:57:49.434 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-10T20:57:49.434 DEBUG:teuthology.orchestra.run.smithi006:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T20:57:49.491 DEBUG:teuthology.orchestra.run.smithi150:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T20:57:49.548 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-10T20:57:49.559 DEBUG:teuthology.orchestra.run.smithi006:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T20:57:49.563 DEBUG:teuthology.orchestra.run.smithi150:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T20:57:49.631 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern = core 2024-09-10T20:57:49.634 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern = core 2024-09-10T20:57:49.664 DEBUG:teuthology.orchestra.run.smithi006:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T20:57:49.697 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T20:57:49.698 DEBUG:teuthology.orchestra.run.smithi150:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T20:57:49.731 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T20:57:49.731 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-10T20:57:49.741 INFO:teuthology.task.internal:Transferring archived files... 2024-09-10T20:57:49.742 DEBUG:teuthology.misc:Transferring archived files from smithi006:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899648/remote/smithi006 2024-09-10T20:57:49.742 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T20:57:49.808 DEBUG:teuthology.misc:Transferring archived files from smithi150:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899648/remote/smithi150 2024-09-10T20:57:49.808 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T20:57:49.871 INFO:teuthology.task.internal:Removing archive directory... 2024-09-10T20:57:49.872 DEBUG:teuthology.orchestra.run.smithi006:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T20:57:49.876 DEBUG:teuthology.orchestra.run.smithi150:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T20:57:49.912 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-10T20:57:49.925 INFO:teuthology.task.internal:Not uploading archives. 2024-09-10T20:57:49.925 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-10T20:57:49.935 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-10T20:57:49.935 DEBUG:teuthology.orchestra.run.smithi006:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T20:57:49.952 DEBUG:teuthology.orchestra.run.smithi150:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T20:57:49.983 INFO:teuthology.orchestra.run.smithi006.stdout: 393233 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 20:57 /home/ubuntu/cephtest 2024-09-10T20:57:49.987 INFO:teuthology.orchestra.run.smithi150.stdout: 393233 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 20:57 /home/ubuntu/cephtest 2024-09-10T20:57:49.990 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-10T20:57:50.001 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-10T20:57:50.025 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/backtrace} duration: 612.1835374832153 flavor: default mon.a-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a mon.b-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a owner: scheduled_hyelloji@teuthology success: true 2024-09-10T20:57:50.025 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T20:57:50.114 INFO:teuthology.run:pass